{"id":95907,"date":"2020-08-27T09:00:21","date_gmt":"2020-08-27T16:00:21","guid":{"rendered":"https:\/\/www.backblaze.com\/blog\/?p=95907"},"modified":"2024-08-23T17:18:21","modified_gmt":"2024-08-24T00:18:21","slug":"increasing-thread-count-useful-in-sheets-and-cloud-storage-speed","status":"publish","type":"post","link":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/","title":{"rendered":"Increasing Thread Count: Useful in Sheets and Cloud Storage Speed"},"content":{"rendered":"

\"\"<\/p>\n

As the Solutions Engineering Manager, I have the privilege of getting to work with amazing customers day in and day out to help them find a solution that fits their needs. For Backblaze B2 Cloud Storage<\/a>, this includes helping them find an application to manage their media\u2014like iconik<\/a>, or setting up their existing infrastructure with our Backblaze S3 Compatible<\/a> APIs, or even providing support for developers writing to our B2 Native APIs.<\/p>\n

But regardless of the solution, one of the most common questions I get when talking with these customers is, \u201cHow do I maximize my performance to Backblaze??\u201d People want to go fast. And the answer almost always comes down to: threads.<\/p>\n

What Are<\/em> Threads?<\/h2>\n

If you do not know what a thread is used for besides sewing, you\u2019re not alone. First of all, threads go by many different names. Different applications may refer to them as streams, concurrent threads, parallel threads, concurrent upload, multi-threading, concurrency, parallelism, and likely some other names I haven\u2019t come across yet.<\/p>\n

But what all these terms refer to when we\u2019re discussing B2 Cloud Storage is the process of uploading files. When you begin to transmit files to Backblaze B2, they are being communicated by threads. (If you\u2019re dying for an academic description of threads, feel free to take some time with this post we wrote about them<\/a>). Multithreading, not surprisingly, is the ability to upload multiple files (or multiple parts of one file<\/a>) at the same time. It won\u2019t shock you to hear that many threads are faster than one thread. The good news is that B2 Cloud Storage is built from the ground up to take advantage of multithreading\u2014it is able to take as many threads as you can throw at it for no additional charge and your performance should scale accordingly. But it does not automatically do so, for reasons we\u2019ll discuss right now.<\/p>\n

Fine-tuning<\/h2>\n

Of course, this begs the question, why not just turn everything up to one million threads for UNLIMITED POWER!!!!????<\/p>\n

\"\"<\/p>\n

Well, chances are your device can\u2019t handle or take advantage of that many threads. The more threads you have open, the more taxing it will be on your device and your network, so it often takes some trial and error to find the sweet spot to get optimal performance without severely affecting the usability of your device.<\/p>\n

Try adding more threads and see how the performance changes after you\u2019ve uploaded for a while. If you see improvements in the upload rate and don\u2019t see any performance issues with your device, then try adding some more and repeating the process. It might take a couple of tries to figure out the optimal number of threads for your specific environment. You\u2019ll be able to rest assured that your data is moving at optimal power (not quite<\/em> as intoxicating as unlimited power, but you\u2019ll thank me when your computer doesn\u2019t just give up).<\/p>\n

How To Increase Your Thread Count<\/h2>\n

Some applications will take the guesswork out of this process and set the number of threads automatically (like our Backblaze Personal Backup and Backblaze Business Backup<\/a> client does for users) while others will use one thread unless you say otherwise. Each application that works with B2 Cloud Storage treats threads a little differently. So we\u2019ve included a few examples of how to adjust the number of threads in the most popular applications that work with B2 Cloud Storage\u2014including Veeam<\/a>, rclone<\/a>, and SyncBackPro.<\/p>\n

If you\u2019re struggling with slow uploads in any of the many other integrations we support, check out our knowledge base<\/a> to see if we offer a guide on how to adjust the threading. You can also reach out to our support team 24\/7 via email<\/a> for assistance in finding out just how to thread your way to the ultimate performance with B2 Cloud Storage.<\/p>\n

Veeam<\/h3>\n

This one is easy\u2014Veeam automatically uses up to 64 threads per VM (not to be confused with \u201cconcurrent tasks<\/a>\u201d) when uploading to Backblaze B2. To increase threading you\u2019ll need to use per-VM backup files. You\u2019ll find Veeam-recommended settings in the Advanced Settings of the Performance Tier in the Scale-out Repository. (See screenshot below).<\/p>\n

\"\"<\/p>\n

Rclone<\/h3>\n

Rclone allows you to use the --transfers<\/code> flag to adjust the number of threads up from the default of four. Rclone\u2019s developer team has found that their optimal setting was --transfers 32<\/code>, but every configuration is going to be different so you may find that another number will work better for you.<\/p>\n

rclone sync \/Users\/Troy\/Downloads b2:troydemorclone\/downloads\/ --transfers 20<\/code><\/p>\n

Tip: If you like to watch and see how fast each file is uploading, use the --progress<\/code> (or -P<\/code>) flag and you\u2019ll see the speeds of each upload thread!<\/p>\n

SyncBackPro<\/h3>\n

SyncBackPro is an awesome sync tool for Windows that supports Backblaze B2 as well the ability to only sync deltas of a file (the parts that have changed). SyncBackPro uses threads in quite a few places across its settings, but the part that concerns how many concurrent threads will upload to Backblaze B2 is in the \u201cNumber of upload\/download threads to use\u201d setting. You can find this in the Cloud Settings under the Advanced tab. You\u2019ll notice they even throw in a warning letting you know that too many will degrade performance!<\/p>\n

\"\"<\/p>\n

Happy Threading!<\/h2>\n

I hope this guide makes working with B2 Cloud Storage a little faster and easier for you. If you\u2019re able to make these integrations work for your use case, or you\u2019ve already got your threading perfectly calibrated, we\u2019d love to hear about your experience and learnings in the comments.<\/p>\n","protected":false},"excerpt":{"rendered":"

Read this post to learn more about increasing the speed of your uploads to Backblaze B2 Cloud Storage.<\/p>\n","protected":false},"author":147,"featured_media":95929,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[7],"tags":[468],"class_list":["post-95907","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cloud-storage","tag-b2cloud","entry"],"acf":[],"yoast_head":"\nIncreasing Thread Count: Useful in Sheets and Cloud Storage Speed<\/title>\n<meta name=\"description\" content=\"Read this post to learn more about increasing the speed of your uploads to Backblaze B2 Cloud Storage.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Increasing Thread Count: Useful in Sheets and Cloud Storage Speed\" \/>\n<meta property=\"og:description\" content=\"Read this post to learn more about increasing the speed of your uploads to Backblaze B2 Cloud Storage.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/\" \/>\n<meta property=\"og:site_name\" content=\"Backblaze Blog | Cloud Storage & Cloud Backup\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/backblaze\" \/>\n<meta property=\"article:published_time\" content=\"2020-08-27T16:00:21+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-08-24T00:18:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.backblaze.com\/blog\/wp-content\/uploads\/2020\/08\/bb-bh-threadspeed.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1440\" \/>\n\t<meta property=\"og:image:height\" content=\"820\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Troy Liljedahl\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@backblaze\" \/>\n<meta name=\"twitter:site\" content=\"@backblaze\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Troy Liljedahl\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Increasing Thread Count: Useful in Sheets and Cloud Storage Speed","description":"Read this post to learn more about increasing the speed of your uploads to Backblaze B2 Cloud Storage.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/","og_locale":"en_US","og_type":"article","og_title":"Increasing Thread Count: Useful in Sheets and Cloud Storage Speed","og_description":"Read this post to learn more about increasing the speed of your uploads to Backblaze B2 Cloud Storage.","og_url":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/","og_site_name":"Backblaze Blog | Cloud Storage & Cloud Backup","article_publisher":"https:\/\/www.facebook.com\/backblaze","article_published_time":"2020-08-27T16:00:21+00:00","article_modified_time":"2024-08-24T00:18:21+00:00","og_image":[{"width":1440,"height":820,"url":"https:\/\/www.backblaze.com\/blog\/wp-content\/uploads\/2020\/08\/bb-bh-threadspeed.jpg","type":"image\/jpeg"}],"author":"Troy Liljedahl","twitter_card":"summary_large_image","twitter_creator":"@backblaze","twitter_site":"@backblaze","twitter_misc":{"Written by":"Troy Liljedahl","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/#article","isPartOf":{"@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/"},"author":{"name":"Troy Liljedahl","@id":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/#\/schema\/person\/808a57c5bb0e25426d4eedf455a9d278"},"headline":"Increasing Thread Count: Useful in Sheets and Cloud Storage Speed","datePublished":"2020-08-27T16:00:21+00:00","dateModified":"2024-08-24T00:18:21+00:00","mainEntityOfPage":{"@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/"},"wordCount":945,"commentCount":2,"publisher":{"@id":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/#primaryimage"},"thumbnailUrl":"https:\/\/backblazeprod.wpenginepowered.com\/wp-content\/uploads\/2020\/08\/bb-bh-threadspeed.jpg","keywords":["B2Cloud"],"articleSection":["Cloud Storage"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/","url":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/","name":"Increasing Thread Count: Useful in Sheets and Cloud Storage Speed","isPartOf":{"@id":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/#primaryimage"},"image":{"@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/#primaryimage"},"thumbnailUrl":"https:\/\/backblazeprod.wpenginepowered.com\/wp-content\/uploads\/2020\/08\/bb-bh-threadspeed.jpg","datePublished":"2020-08-27T16:00:21+00:00","dateModified":"2024-08-24T00:18:21+00:00","description":"Read this post to learn more about increasing the speed of your uploads to Backblaze B2 Cloud Storage.","breadcrumb":{"@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/#primaryimage","url":"https:\/\/backblazeprod.wpenginepowered.com\/wp-content\/uploads\/2020\/08\/bb-bh-threadspeed.jpg","contentUrl":"https:\/\/backblazeprod.wpenginepowered.com\/wp-content\/uploads\/2020\/08\/bb-bh-threadspeed.jpg","width":1440,"height":820},{"@type":"BreadcrumbList","@id":"https:\/\/www.backblaze.com\/blog\/increasing-thread-count-useful-in-sheets-and-cloud-storage-speed\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Increasing Thread Count: Useful in Sheets and Cloud Storage Speed"}]},{"@type":"WebSite","@id":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/#website","url":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/","name":"Backblaze Cloud Solutions Blog","description":"Cloud Storage & Cloud Backup","publisher":{"@id":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/#organization","name":"Backblaze","url":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/i0.wp.com\/www.backblaze.com\/blog\/wp-content\/uploads\/2017\/12\/backblaze_icon_transparent.png?fit=512%2C512&ssl=1","contentUrl":"https:\/\/i0.wp.com\/www.backblaze.com\/blog\/wp-content\/uploads\/2017\/12\/backblaze_icon_transparent.png?fit=512%2C512&ssl=1","width":512,"height":512,"caption":"Backblaze"},"image":{"@id":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/backblaze","https:\/\/x.com\/backblaze","https:\/\/www.youtube.com\/user\/Backblaze","https:\/\/en.wikipedia.org\/wiki\/Backblaze"]},{"@type":"Person","@id":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/#\/schema\/person\/808a57c5bb0e25426d4eedf455a9d278","name":"Troy Liljedahl","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/backblazeprod.wpenginepowered.com\/wp-content\/uploads\/2019\/12\/Screen-Shot-2019-12-18-at-2.31.25-PM-150x150.png","url":"https:\/\/backblazeprod.wpenginepowered.com\/wp-content\/uploads\/2019\/12\/Screen-Shot-2019-12-18-at-2.31.25-PM-150x150.png","contentUrl":"https:\/\/backblazeprod.wpenginepowered.com\/wp-content\/uploads\/2019\/12\/Screen-Shot-2019-12-18-at-2.31.25-PM-150x150.png","caption":"Troy Liljedahl"},"description":"Troy Liljedahl is the solutions engineer manager at Backblaze. He has spent his career solving puzzles and helping people find answers to their questions. Now, he gets to continue doing what he loves by connecting users with the best backup and cloud storage products on the market.","url":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/author\/troy\/"}]}},"jetpack_featured_media_url":"https:\/\/backblazeprod.wpenginepowered.com\/wp-content\/uploads\/2020\/08\/bb-bh-threadspeed.jpg","_links":{"self":[{"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/posts\/95907","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/users\/147"}],"replies":[{"embeddable":true,"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/comments?post=95907"}],"version-history":[{"count":0,"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/posts\/95907\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/media\/95929"}],"wp:attachment":[{"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/media?parent=95907"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/categories?post=95907"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/backblazeprod.wpenginepowered.com\/blog\/wp-json\/wp\/v2\/tags?post=95907"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}