AWS EMR EC2 S3 tips - mikec964/chelmbigstock GitHub Wiki
Link to AWS tutorial
Link to materials for the hands-on session we had
To acceess your S3 storage easily from EC2, install s3cmd
on your EC2.
- From a bash shell on an EC2 VM, run this command:
$ curl -L -O http://sourceforge.net/projects/s3tools/files/s3cmd/1.5.0-rc1/s3cmd-1.5.0-rc1.tar.gz
This creates s3cmd-1.5.0-rc1.tar.gz in the current directory. - To extract the tar.gz, run
$ tar -zxvf s3cmd-1.5.0-rc1.tar.gz
This creates a new directory s3cmd-1.5.0-rc1. - Go to the directory
$ cd s3cmd-1.5.0-rc1
- Install s3cmd
$ sudo python setup.py install
- Configure s3cmd
$ s3cmd --configure
s3cmd asks some questions: - Access Key: enter your AWSAccessKeyId
- Secret Key: enter your AWSSecretKey
- Encryption password: whatever you like
- You can skip the rest of questions by hitting the enter key
- All set!