Transfer data from AWS EC2 to S3 - OXPHOS/GeneMiner GitHub Wiki

1. log on to control machine or master node, if the master node is aws configured

(sudo apt-get install awscli)

2. aws s3 ls to see current available buckets.

3. Copy data from EC2 to S3:

aws s3 cp --recursive local_dir/ s3://my-s3-bucket

or

aws s3 sync local_dir/ s3://my-s3-bucket

4. Rename folders

aws s3 mv --resursive s3://ori s3://new

Reference: https://github.com/churchlab/millstone/wiki/Moving-Data-Between-S3-and-EC2-Instances