You've been logged out of GDC Vault since the maximum users allowed for this account has been reached. To access Members Only content on GDC Vault, please log out of GDC Vault from the computer which last accessed this account.

Click here to find out about GDC Vault Membership options for more users.

close

Session Name:

Virtual Sync: Terabytes on Demand

Overview:

For decades, the basic way we work on games has remained mostly unchanged - we sync the game's source data from something like Perforce, we change a few things, we validate locally, and we submit our changes. With AAA game source data exceeding 10 TB, and content creators needing to work across multiple branches, it has become steadily less practical to require these volumes of data transfer. When the Covid-19 pandemic sent all of our employees to work from their homes, our development process ran into the limitations of multi-day network data transfers and we were faced with the need to physically transport hard drives back and forth. VirtualSync is our answer: a virtual file system that seamlessly fetches assets on-demand as-needed, allowing us to shrink up-front syncs by 98% or more. We show how this simple idea requires a number of complex engineering challenges to be solved. We will present numerous problems encountered and the solutions we developed to solve performance issues, operating system limitations, service monitoring at scale and more.

Did you know free users get access to 30% of content from the last 2 years?


Get your team full access to the most up to date GDC content

  • Game Developers Conference 2022
  • Brandon Moro
  • Bungie, Inc.
  • free content
  • Programming
  • Programming