There’s Nothing to See Here—Backblaze 3.0

Backblaze 3.0

When Backblaze 1.0 was introduced it was a good product that solved a problem. Over the years, many people have used Backblaze to backup and restore billions of files. As with most software there were always things that could be done to improve the product and over time we added features such as Refer-a-Friend, Safety Freeze, Locate My Computer, unlimited file sizes, and many others. Following industry norms, we’d trumpet these new features for all to see by updating the version number to 1.5, 1.6, 2.0, and so on.

Today we are announcing Backblaze 3.0, but in this case there is really nothing for our customers to see—there are no UI (user interface) changes. There are plenty of changes however; massive changes actually, which will affect nearly every Backblaze customer over time. There are changes to the Mac and Windows applications, changes to the back-end servers, changes to our Storage Pod software, and more. All of these changes are behind the scenes and all of these changes will make Backblaze a better and more scalable product, but except for the version number changing to 3.0, there is nothing else to see.

Why call this release Backblaze 3.0 if there are no UI changes? Why not? The idea that only major UI changes are required for a major product version change ignores the contributions of nearly all of our engineers and many of our operations staff. There’s a ton of work in 3.0; here’s an overview of what you’ll never see:

Scalability:

    • When Backblaze 1.0 was being coded, a decision was made for Storage Pods to have three digits (e.g. 065, 732, etc.). Thanks to a growing number of customers and a growing amount of data, we’ll need more than 1,000 Storage Pods. We have over

100 petabytes stored

    • on about 800 Storage Pods now. We could have added a digit or gone “hex,” but instead we updated the entire referencing structure so it will scale to about 1.5 million Storage Pods.

Data center focus: Backblaze 3.0 switched the point of view for data storage from the client to the data center. This allows for more efficient data storage, improved throughput, and faster integrity checking for data stored.

Faster deduplication: If the same file exists on your computer in multiple folders/directories, Backblaze will dedupe the file for backup and restore. We’ve always done this. For 3.0, we’ve basically doubled the speed of the deduplication process. Backups, both initial and incremental, will be faster, especially for someone with lots of duplicated files.

Large-file improvements: Files have continued to increase in size over the years. It is not unusual to have a 3GB video file for example. Such files are broken down into parts before they are encrypted, transferred, and stored at Backblaze. We improved the speed and effectiveness of locating and reassembling these very large files when they need to be restored.

Nuts and Bolts

  • We updated a core programing class to support up to a full 2GB on 64 bit computers—up from 1GB previously. 32 bit systems continue to be 1GB. We can now move large chunks of data around within our system faster.
  • Updated the maximum size of our “file done” log to 2GB. This allows us to log the backup of four times as many files per day per client as before.
  • Mac: Updated binary signatures (installer, uninstaller, bzdownloader) to work on Mac OS X 10.10 and later 10.9.X builds.

While not visible, this massive internal overhaul enables Backblaze to continue scaling the service for decades to come. The new infrastructure, without any changes, can store approximately 500,000 petabytes of data using today’s 6TB hard drives. That’s more than 4,000 times as much storage as we have today. Call us optimistic.

Backblaze 3.0 details:

Version: 3.0.0 for both Mac OS and Windows.

Availability: October 9, 2014

Upgrade Methods:

  • Immediately when performing a “Check for Updates”
  • Immediately as a download from Backblaze Updates
  • Immediately as the default download on backblaze.com
  • Auto-update will begin in the next couple of weeks

Cost: Free as an update for all Backblaze customers.

Questions: Please contact Backblaze Support at www.backblaze.com/help.html.

print

About Brian Wilson

I completed my undergraduate at Oregon State University in 1990, then completed a Stanford Masters degree in 1991. Ever since then I've worked at various companies as a software engineer, in the last few years starting my own software startups called MailFrontier (started in 2002) and most recently Backblaze (started in 2007). I have a personal web site at http://www.ski-epic.com that I started in 1999 (it was originally just for one vacation, but it kept growing) where I put up my vacation pictures and videos. Nothing professional, it's all just for fun. In my spare time I enjoy skiing, motorcycling, and boating. I have been lucky enough to travel to a few countries, and I enjoy scouting out new places for the first time. Follow Brian on: Twitter: @brianwski YouTube: brianwski LinkedIn: brianwski Reddit: brianwski