There’s Nothing to See Here – Backblaze 3.0

By | October 9th, 2014

Backblaze 3.0

When Backblaze 1.0 was introduced it was a good product that solved a problem. Over the years many people have used Backblaze to backup and restore billions of files. As with most software there were always things that could be done to improve the product and over time we added features such as Refer-a-Friend, Safety Freeze, Locate My Computer, unlimited file sizes, and many others. Following industry norms we’d trumpet these new features for all to see by updating the version number to 1.5, 1.6, 2.0 and so on.

Today we are announcing Backblaze 3.0, but in this case there is really nothing for our customers to see – there are no UI (user interface) changes. There are plenty of changes however; massive changes actually, which will affect nearly every Backblaze customer over time. There are changes to the Mac and Windows applications, changes to the back-end servers, changes to our Storage Pod software and more. All of these changes are behind-the-scenes and all of these changes will make Backblaze a better and more scalable product, but except for the version number changing to 3.0, there is nothing else to see.

Why call this release Backblaze 3.0 if there are no UI changes? Why not? The idea that only major UI changes are required for a major product version change ignores the contributions of nearly all of our engineers and many of our operations staff. There’s a ton of work in 3.0, here’s an overview of what you’ll never see:

    Scalability: When Backblaze 1.0 was being coded a decision was made for Storage Pods to have 3 digits (e.g. 065, 732, etc). Thanks to a growing number of customers and a growing amount of data, we’ll need more than 1,000 Storage Pods. We have over 100 Petabytes stored on about 800 Storage Pods now. We could have added a digit or gone “hex”, but instead we updated the entire referencing structure so it will scale to about 1.5 million Storage Pods.

    Datacenter focus: Backblaze 3.0 switched the point-of-view for data storage from the client to the datacenter. This allows for more efficient data storage, improved throughput, and faster integrity checking for data stored.

    Faster deduplication: If the same file exists on your computer in multiple folders/directories, Backblaze will dedupe the file for backup and restore. We’ve always done this. For 3.0 we’ve basically doubled the speed of the deduplication process. Backups, both initial and incremental, will be faster, especially for someone with lots of duplicated files.

    Large-file improvements: Files have continued to increase in size over the years. It is not unusual to have a 3 GB video file for example. Such files are broken down into parts before they are encrypted, transferred and stored at Backblaze. We improved the speed and effectiveness of locating and reassembling these very large files when they need to be restored.

    Nuts and bolts:

  • We updated a core programing class to support up to a full 2 GB on 64 bit computers – up from 1 GB previously. 32 bit systems continue to be 1 GB. We can now move large chunks of data around within our system faster.
  • Updated the maximum size of our “file done” log to 2 GB. This allows us to log the back up of 4 times as many files per day per client as before.
  • Mac: Updated binary signatures (installer, uninstaller, bzdownloader) to work on Mac OS X 10.10 and later 10.9.X builds.

While not visible, this massive internal overhaul enables Backblaze to continue scaling the service for decades to come. The new infrastructure, without any changes, can store approximately 500,000 petabytes of data using today’s 6 TB hard drives. That’s more than 4,000 times as much storage as we have today. Call us optimistic.

Backblaze 3.0 details:

    Version: 3.0.0 for both Mac OS and Windows.

    Availability: 9-OCT-2014

    Upgrade Methods:

  • Immediately when performing a “Check for Updates”
  • Immediately as a download from files.backblaze.com
  • Immediately as the default download on backblaze.com
  • Auto-update will begin in the next couple of weeks

Cost: Free as an update for all Backblaze customers

Questions: Please contact Backblaze Support at www.backblaze.com/helpme

 

Brian Wilson
I completed my undergraduate at Oregon State University in 1990, then completed a Stanford Masters degree in 1991. Ever since then I've worked at various companies as a software engineer, in the last few years starting my own software startups called MailFrontier (started in 2002) and most recently Backblaze (started in 2007).

I have a personal web site at http://www.ski-epic.com that I started in 1999 (it was originally just for one vacation, but it kept growing) where I put up my vacation pictures and videos. Nothing professional, it's all just for fun.

In my spare time I enjoy skiing, motorcycling, and boating. I have been lucky enough to travel to a few countries, and I enjoy scouting out new places for the first time.

Follow Brian on:
Twitter: @brianwski
YouTube: brianwski
LinkedIn: brianwski
Google+: brianwski
Reddit: brianwski
Category:  Backblaze Bits · Release
  • Andy Klein

    We have tried both WD and Seagate 6TB drives. We’ll be posting about that experience shortly.

    • YevP

      I hope they’re pretty good!