Contents x
Back Up Storage Volumes from CoreWeave to Backblaze B2
    • Print
    • Dark
      Light
    Contents

    Back Up Storage Volumes from CoreWeave to Backblaze B2

      • Print
      • Dark
        Light
      Article Summary

      CoreWeave is a specialized cloud that was built for GPU-accelerated workloads. You can back up storage volumes from CoreWeave to Backblaze B2 Cloud Storage and access Backblaze B2 buckets from apps that run on CoreWeave.

      This guide instructs you how to create a Backblaze B2 bucket and application key, back up storage volumes, and view your data in Backblaze B2. 

      The following video shows you how to back up storage volumes, specify additional arguments in the YAML file, and view your backed up data in Backblaze B2.

      This blog details how you can run AI/ML workloads on CoreWeave and and Backblaze.

      Enable Backblaze B2

      Before you begin: You must have a Backblaze B2 Cloud Storage account. You can sign up here. If you already have a Backblaze account and the left navigation menu contains a B2 Cloud Storage section, your account is already enabled for Backblaze B2.

      1. Sign in to your Backblaze account.
      2. In the left navigation menu under Account, click My Settings.
      3. Under Enabled Products, select the checkbox to enable B2 Cloud Storage.
      4. Review the Terms and Conditions, and click OK to accept them. 

      Create a Bucket

      1. Sign in to your Backblaze account.
      2. In the left navigation menu under B2 Cloud Storage, click Buckets.
      3. Click Create a Bucket.
      4. Enter a name for your bucket.
        Bucket names must be at least six characters and globally unique. A message is displayed if your bucket name is already in use.
      5. Select a privacy setting: Private or Public.
        Files that are in a private bucket require authentication to perform an action, for example, downloading. Public buckets do not require authentication so you can easily share files. You can change a bucket's privacy settings at any time.
      6. If applicable, enable a Backblaze B2 server-side encryption key.
      7. Enable Object Lock to restrict a file from being modified or deleted for a specified period of time.
      8. Click Create a Bucket, and copy the value that is in the Endpoint field; you may need this value for other processes.
      9. Click Lifecycle Settings to control how long to keep the files in your new bucket.

      Create an Application Key

      Application keys control access to your Backblaze B2 Cloud Storage account and the buckets that are contained in your account.

      1. Sign in to your Backblaze account.
      2. In the left navigation menu under Account, click Application Keys.
      3. Click Add a New Application Key, and enter an app key name.
            You cannot search an app key by this name; therefore, app key names are not required to be globally unique.
      4. Select All or a specific bucket in the Allow Access to Bucket(s) dropdown menu.
      5. Optionally, select your access type (Read and Write, Read Only, or Write Only).
      6. Optionally, select the Allow List All Bucket Names checkbox (required for the B2 Native API b2_list_buckets and the S3-Compatible API S3 List Buckets operations).
      7. Optionally, enter a file name prefix to restrict application key access only to files with that prefix. Depending on what you selected in step #4, this limits application key access to files with the specified prefix for all buckets or just the selected bucket.
      8. Optionally, enter a positive integer to limit the time, in seconds, before the application key expires. The value must be less than 1000 days (in seconds).
      9. Click Create New Key, and note the resulting keyID and applicationKey values.
      Note
      When you create a new app key, the response contains the actual key string, for example N2Zug0evLcHDlh_L0Z0AJhiGGdY. You can always find the keyID on this page, but for security, the applicationKey appears only once. Make sure you copy and securely save this value elsewhere.

      Back Up Storage Volumes to Backblaze B2

      Before you begin: You must set up a CoreWeave account. For more information, see the CoreWeave Quick-Start Guide.

      1. Sign in to your CoreWeave account.
      2. In the left navigation menu, select Catalog and click the backblaze-backup tile.
      3. Click Deploy.
      4. Leave the region of your pod as the default option.
      5. To run multiple threads for faster data transfer, use the slider to increase the amount of memory.

        Increase this value if you override --b2-chunk-size and --transfers.

      6. Enable Sync Now to run an initial synchronization when you deploy the sync job.
      7. Under Available Volumes, click + (add) next to the name of the volume to include it in the sync job.
      8.  Enter your Backblaze B2 credentials.
        1. Enter your bucket name.
        2. Enter your Application Key.
        3. Enter your Key ID.
      9. Select when your sync job should run, and use the Retries slider to set the number of times to retry the sync job.
      10. Click Deploy.

      View Your Data

      1. Sign in to your Backblaze account.
      2. In the left navigation menu under B2 Cloud Storage, click Browse Files.
      3. Select your bucket to view specific files.
      4. Click the image filename to see more details.
      Was this article helpful?
      Related articles
      What's Next