S3 data bucket: setup and connectivity - 3C-SCSU/Avatar GitHub Wiki

Have a S3 Data bucket provider

  1. E.g. Go to the Wasabi website (https://wasabi.com/) in your web browser.

  2. Sign Up for an Account:

  • Click on the "Sign Up" or "Get Started" button on the homepage.
  • Fill out the required information to create your account, including your email address, password, and company name if applicable.
  • Agree to the terms of service and privacy policy.
  1. Verify Your Email:
  • After signing up, Wasabi will send a verification email to the email address you provided. Open the email and click on the verification link to confirm your email address.

4.Log In to Your Account:

  • Once your email is verified, log in to your Wasabi account using the credentials you provided during sign-up.
  1. Navigate to the Wasabi Console:
  • After logging in, you'll be taken to the Wasabi console, where you can manage your storage buckets and settings.

Create a New S3 Bucket

  1. Creating a New Bucket
  • Go to the "Buckets" section in the Data Access tab of the Wasabi console.
  • Click on the "Create Bucket" button.
  • Provide a unique name for your bucket. Ensure that the bucket name is globally unique.
  • Select the region where you want to create the bucket. Choose the region that best suits your needs.
  • Optionally, configure additional settings such as encryption, bucket versioning, and access control according to your requirements.
  • Click on the "Create" or "Finish" button to finalize the creation of the bucket.
  1. Creating Folder Structure in the New Bucket
  • After creating the bucket proceed to create a folder structure within it as per the requirement.
  1. Uploading Files into Respective Folders
  • Once the folder structure is created, you can upload files into their respective folders.
  • Ensure that the files are organized correctly within their corresponding folders for ease of access and management.
  1. Go to Access Key
  • Click on Create/Generate New Access Key
  • It will create a new Access key and Secret key
  • Copy both the Access Key ID and the Secret Access Key to a secure location. These keys are crucial for accessing your Wasabi S3 resources programmatically.

VPS Server

  1. Login to VPS Server

  2. Configure s3cmd to connect from VPS server to Wasabi S3 bucket

  • s3cmd –configure
  • We need to enter Access key, Secret Key, Default Region, S3 Endpoint during Configuration we can check the connectivity
  1. To Create folders (use mkdir) and check the files in the path for the files (ls)
  • mkdir
  • ls
  1. To Check the Wasabi S3 bucket folders and path
  • s3cmd ls s3://bucketname
  1. To Check the VPS folders and path
  • ls
  • ls -l /filepath
  1. Check the permission, Add your user to the groups if not added. Enter ls -ld so you see the owner
  • ls -ld
  1. To add user to a group
  • sudo usermod -ag group username
  1. To check the groups you have access
  • groups username
  1. Get the file from Wasabi S3 Bucket to IONOS Server
  • Download from s3 to VPS
  • s3cmd get s3path/filename vpspath/filename
  • Upload from VPS to S3
  • s3cmd put s3path/filename vpspath/filename
  1. To see the files added by user
  • find /path -user username
  1. To create a file or to see the content of file use nano
  • nano filename