{"id":97423,"date":"2021-02-17T08:50:15","date_gmt":"2021-02-17T16:50:15","guid":{"rendered":"https:\/\/www.backblaze.com\/blog\/?p=97423"},"modified":"2024-08-23T17:14:10","modified_gmt":"2024-08-24T00:14:10","slug":"level-up-and-simmer-io-down-scaling-a-game-sharing-platform","status":"publish","type":"post","link":"https:\/\/www.backblaze.com\/blog\/level-up-and-simmer-io-down-scaling-a-game-sharing-platform\/","title":{"rendered":"Level Up and SIMMER.io Down: Scaling a Game-sharing Platform"},"content":{"rendered":"\r\n
\r\n
\"\"<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n

Much like gaming, starting a business means a lot of trial and error. In the beginning, you\u2019re just trying to get your bearings and figure out which enemy to fend off first. After a few hours (or a few years on the market), it\u2019s time to level up.<\/p>\r\n\r\n\r\n\r\n

SIMMER.io, a community site that makes sharing Unity WebGL games easy for indie game developers, leveled up in a big way to make their business sustainable for the long haul.<\/p>\r\n\r\n\r\n\r\n

When the site was founded in September 2017, the development team focused on getting the platform built and out the door, not on what egress costs would look like down the road. As it grew into a home for 80,000+ developers and 30,000+ games, though, those costs started to encroach on their ability to sustain and grow the business.<\/p>\r\n\r\n\r\n\r\n

After rolling the dice in \u201cA Hexagon\u2019s Adventures\u201d a few times (check it out below), we spoke with the SIMMER.io development team about their experience setting up a multi-cloud solution\u2014including their use of the Bandwidth Alliance<\/a> between Cloudflare and Backblaze B2 Cloud Storage<\/a> to reduce egress to $0\u2014to prepare the site for continued growth.<\/p>\r\n\r\n\r\n\r\n

How to Employ a Multi-cloud Approach for Scaling a Web Application<\/strong><\/h2>\r\n\r\n\r\n\r\n

In 2017, sharing games online with static hosting through a service like AWS S3 was possible<\/em> but certainly not easy. As one SIMMER.io team member put it, \u201cNo developer in the world would want to go through that.\u201d The team saw a clear market opportunity. If developers had a simple, drag-and-drop way to share games that worked for them, the site would get increased traffic that could be monetized through ad revenue. Further out, they envisioned a premium membership offering game developers unbranded sharing and higher bandwidth. They got to work building the infrastructure for the site.<\/p>\r\n\r\n\r\n\r\n

Prioritizing Speed and Ease of Use<\/strong><\/h3>\r\n\r\n\r\n\r\n

Starting a web application, your first priority is planning for speed and ease of use\u2014both for whatever you\u2019re developing but also from the apps and services you use to develop it.<\/p>\r\n\r\n\r\n\r\n

The team at SIMMER.io first tried setting up their infrastructure in AWS. They found it to be powerful, but not very developer-friendly. After a week spent trying to figure out how to implement single sign-on using Amazon Cognito, they searched for something easier and found it in Firebase\u2014Google\u2019s all-in-one development environment. It had most of the tools a developer might need baked in, including single sign-on.<\/p>\r\n\r\n\r\n\r\n

Firebase was already within the Google suite of products, so they used Google Cloud Platform (GCP) for their storage needs as well. It all came packaged together, and the team was moving fast. Opting into GCP made sense in the moment.<\/p>\r\n\r\n\r\n\r\n

\r\n
\"\"\r\n
“The Impossible Glide,” E&T Studios. Trust us, it does feel a little impossible.<\/figcaption>\r\n<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n

When Egress Costs Boil Over<\/strong><\/h3>\r\n\r\n\r\n\r\n

Next, the team implemented Cloudflare, a content delivery network, to ensure availability and performance no matter where users access the site. When developers uploaded a game, it landed in GCP, which served as SIMMER.io\u2019s origin store. When a user in Colombia wanted to play a game, for example, Cloudflare would call the game from GCP to a server node that\u2019s geographically closer to the user. But each time that happened, GCP charged egress fees for data transfer out.<\/p>\r\n\r\n\r\n\r\n

Even though popular content was cached on the Cloudflare nodes, egress costs from GCP still added up, comprising two-thirds of total egress. At one point, a \u201cCards Against Humanity\u201d-style game caught on like wildfire in France, spiking egress costs to more than double their average. The popularity was great for attracting new SIMMER.io business but tough on the bottom line.<\/p>\r\n\r\n\r\n\r\n

These costs increasingly ate into SIMMER.io\u2019s margins until the development team learned of the Bandwidth Alliance, a group of cloud and networking companies that discount or waive data transfer fees for shared customers, of which Backblaze and Cloudflare are both members.<\/p>\r\n\r\n\r\n\r\n

\r\n
\"\"\r\n
“Dragon Spirit Remake,” by Jin Seo, one of 30K+ games available on SIMMER.io.<\/figcaption>\r\n<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n

Testing a Multi-cloud Approach<\/strong><\/h3>\r\n\r\n\r\n\r\n

Before they could access Bandwidth Alliance savings, the team needed to make sure the data could be moved safely and easily and that the existing infrastructure would still function with the game data living in Backblaze B2.<\/p>\r\n\r\n\r\n\r\n

The SIMMER.io team set up a test bucket for free, integrated it with Cloudflare, and tested one game\u2014Connected Towers<\/a>. The Backblaze B2 test bucket allows for free self-serve testing up to 10GB, and Backblaze offers a free proof of concept<\/a> working with our solutions engineers for larger tests. When one game worked, the team decided to try it with all games uploaded to date. This would allow them to cash in on Bandwidth Alliance savings between Cloudflare and Backblaze B2 right away while giving them time to rewrite the code that governs uploads to GCP later.<\/p>\r\n\r\n\r\n\r\n

\r\n
\"\"\r\n
“Connected Towers,” NanningsGames. The first game tested on Backblaze B2.<\/figcaption>\r\n<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n

Choose Your Own Adventure: Migrate Yourself or With Support<\/strong><\/h3>\r\n\r\n\r\n\r\n

Getting 30,000+ games from one cloud provider to another seemed daunting, especially given that games are accessed constantly on the site. They wanted to ensure any downtime was minimal. So the team worked with Backblaze to plan out the process. Backblaze solution engineers recommended using rclone<\/a>, an open-source command line program that manages files on cloud storage<\/a>, and the SIMMER.io team took it from there.<\/p>\r\n\r\n\r\n\r\n

With rclone running on a Google Cloud server, the team copied game data uploaded prior to January 1, 2021 to Backblaze B2 over the course of about a day and a half. Since the games were copied rather than moved, there was no downtime at all. The SIMMER.io team just pointed Cloudflare to Backblaze B2 once the copy job finished.<\/p>\r\n\r\n\r\n\r\n

\r\n
\"\"\r\n
Left: “Wood Cutter Santa,” Zathos; Right: “Revolver\u2014Duels,” Zathos. “Wood Cutter Santa:” A Backblaze favorite.<\/figcaption>\r\n<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n

Combining Microservices Translates to Ease and Affordability<\/strong><\/h3>\r\n\r\n\r\n\r\n

Now, Cloudflare pulls games on-demand from Backblaze B2 rather than GCP, bringing egress costs to $0 thanks to the Bandwidth Alliance. SIMMER.io only pays for Backblaze B2 storage<\/a> costs at $5\/TB.<\/p>\r\n\r\n\r\n\r\n

For the time being, developers still upload games to GCP, but Backblaze B2 functions as the origin store. The games are mirrored between GCP and Backblaze B2, and to ensure fidelity between the two copies, the SIMMER.io team periodically runs an rclone sync. It performs a hash check on each file to look for changes and only uploads files that have been changed so SIMMER.io avoids paying any more egress than they have to from GCP. For users, there\u2019s no difference, and the redundancy gives SIMMER.io peace of mind while they finish the transition process.<\/p>\r\n\r\n\r\n\r\n

Moving forward, SIMMER.io has the opportunity to rewrite code so game uploads go directly to Backblaze B2. Because Backblaze offers the S3 Compatible<\/a> API, the SIMMER.io team can use existing documentation to accomplish the code rework, which they\u2019ve already started testing. Redirecting uploads would further reduce their costs by eliminating duplicate storage, but mirroring the data using rclone was the first step towards that end.<\/p>\r\n\r\n\r\n\r\n

Managing everything in one platform might make sense starting out\u2014everything lives in one place. But, like SIMMER.io, more and more developers are finding a combination of microservices to be better for their business, and not just based on affordability. With a vendor-agnostic environment, they achieve redundancy, capitalize on new functionality, and avoid vendor lock-in.<\/p>\r\n\r\n\r\n\r\n

\r\n
\"\"\r\n
“AmongDots,” RETRO2029. For the retro game enthusiasts among us.<\/figcaption>\r\n<\/figure>\r\n<\/div>\r\n\r\n\r\n\r\n

A Cloud to Cloud Migration Pays Off<\/strong><\/h2>\r\n\r\n\r\n\r\n

For now, by reclaiming their margins through reducing egress costs to $0, SIMMER.io can grow their site without having to worry about increasing egress costs over time or usage spikes when games go viral. By minimizing that threat to their business, they can continue to offer a low-cost subscription and operate a sustainable site that gives developers an easy way to publish their creative work. Even better, they can use savings to invest in the SIMMER.io community, hiring more community managers to support developers. And they also realized a welcome payoff in the process\u2014finally earning some profits after many years of operating on low margins.<\/p>\r\n\r\n\r\n\r\n

Leveling up, indeed.<\/p>\r\n\r\n\r\n\r\n

Check out our Cloud to Cloud Migration<\/a> offer and other transfer partners\u2014we\u2019ll pay for your data transfer if you need to move more than 10TB.<\/div>\r\n\r\n\r\n\r\n

Bonus Points: Roll the Dice for Yourself<\/strong><\/h2>\r\n\r\n\r\n\r\n

The version of \u201cA Hexagon\u2019s Adventures\u201d below is hosted on B2 Cloud Storage, served up to you via Cloudflare, and delivered easily by virtue of SIMMER.io\u2019s functionality. See how it all works for yourself, and test your typing survival skills.<\/p>\r\n\r\n\r\n\r\n