[DIGITALOCEAN] Steps to Sync Between Two DigitalOcean Spaces - fourslickz/notes GitHub Wiki

To synchronize files between two DigitalOcean Spaces (buckets) using rclone, follow these steps. This will allow you to sync data directly between two spaces without involving a local server.

# Steps to Sync Between Two DigitalOcean Spaces

  1. Ensure rclone is installed (as shown previously).

  2. Configure both DigitalOcean Spaces in rclone:

    • Run the command:

bash

rclone config

Add a new remote for each DigitalOcean Space by following the prompts.

You'll need to configure two different remotes, one for each space.

When prompted to add a new remote for the first space:

Choose n for new remote. Give it a name (e.g., space1). Choose the storage provider as s3. Choose DigitalOcean (option 4). Enter the access key and secret key for the first space. Set the appropriate region (e.g., nyc3). Enter the endpoint (e.g., nyc3.digitaloceanspaces.com). Complete the setup by saving this configuration. Repeat the process to configure the second space:

Choose n for a new remote. Give it another name (e.g., space2). Set the provider, access key, secret key, region, and endpoint for the second space.

  1. Sync files between the two DigitalOcean Spaces: Use the following rclone command to sync one space to the other:

bash

rclone sync space1:your-space-name-1 space2:your-space-name-2

Replace space1 and space2 with the names of your configured rclone remotes. Replace your-space-name-1 and your-space-name-2 with the names of the DigitalOcean spaces (buckets).

  1. Options (Optional):

You can add the --dry-run option to test the sync command without actually transferring data:

bash

rclone sync space1:your-space-name-1 space2:your-space-name-2 --dry-run

For more verbose output, add the -v flag:

bash

rclone sync space1:your-space-name-1 space2:your-space-name-2 -v
  1. Automate the Sync (Optional): If you'd like to automate the sync process between the spaces, you can create a cron job as shown earlier.

This process will keep your two DigitalOcean Spaces synchronized.