Performance Measurements with AWS S3 - christianbaun/ossperf GitHub Wiki
Some performance results
Tested from Germany on March 30th from a Lenovo X240 Thinkpad. Internet connection was ADSL wie 16 MBps downstream and 1 MBps upstream. The services (buckets) tested were located in the US.
Amazon AWS S3 service
5 Files, 1 Byte (2^0 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 1 -p
...
Required time to create the bucket: 1.230s
Required time to upload the files: 2.079s
Required time to download the files: 2.214s
Required time to erase the objects: 1.519s
Required time to erase the bucket: 1.719s
Required time to perform all S3-related operations: 8.761s
5 Files, 2 Byte (2^1 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 2 -p
...
Required time to create the bucket: 1.272s
Required time to upload the files: 2.229s
Required time to download the files: 2.498s
Required time to erase the objects: 2.161s
Required time to erase the bucket: 1.176s
Required time to perform all S3-related operations: 9.336s
5 Files, 4 Byte (2^2 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 4 -p
...
Required time to create the bucket: 1.339s
Required time to upload the files: 2.434s
Required time to download the files: 1.807s
Required time to erase the objects: 3.334s
Required time to erase the bucket: 1.322s
Required time to perform all S3-related operations: 10.236s
5 Files, 8 Byte (2^3 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 8 -p
...
Required time to create the bucket: 1.203s
Required time to upload the files: 1.936s
Required time to download the files: 1.733s
Required time to erase the objects: 1.597s
Required time to erase the bucket: 0.944s
Required time to perform all S3-related operations: 7.413s
5 Files, 16 Byte (2^4 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 16 -p
...
Required time to create the bucket: 1.714s
Required time to upload the files: 2.959s
Required time to download the files: 1.883s
Required time to erase the objects: 1.492s
Required time to erase the bucket: 1.084s
Required time to perform all S3-related operations: 9.132s
5 Files, 32 Byte (2^5 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 32 -p
...
Required time to create the bucket: 1.531s
Required time to upload the files: 2.042s
Required time to download the files: 1.884s
Required time to erase the objects: 1.489s
Required time to erase the bucket: 1.020s
Required time to perform all S3-related operations: 7.966s
5 Files, 64 Byte (2^6 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 64 -p
...
Required time to create the bucket: 1.296s
Required time to upload the files: 2.187s
Required time to download the files: 1.965s
Required time to erase the objects: 1.854s
Required time to erase the bucket: 1.195s
Required time to perform all S3-related operations: 8.497s
5 Files, 128 Byte (2^7 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 128 -p
...
Required time to create the bucket: 1.498s
Required time to upload the files: 2.002s
Required time to download the files: 2.657s
Required time to erase the objects: 1.683s
Required time to erase the bucket: 1.524s
Required time to perform all S3-related operations: 9.364s
5 Files, 256 Byte (2^8 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 256 -p
...
Required time to create the bucket: 1.472s
Required time to upload the files: 2.147s
Required time to download the files: 2.721s
Required time to erase the objects: 1.976s
Required time to erase the bucket: 1.933s
Required time to perform all S3-related operations: 10.249s
5 Files, 512 Byte (2^9 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 512 -p
...
Required time to create the bucket: 1.451s
Required time to upload the files: 2.381s
Required time to download the files: 1.724s
Required time to erase the objects: 1.434s
Required time to erase the bucket: 1.265s
Required time to perform all S3-related operations: 8.255s
5 Files, 1 kb (2^10 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 1024 -p
...
Required time to create the bucket: 1.501s
Required time to upload the files: 2.031s
Required time to download the files: 5.488s
Required time to erase the objects: 1.784s
Required time to erase the bucket: 0.886s
Required time to perform all S3-related operations: 11.690s
5 Files, 2 kb (2^11 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 2048 -p
...
Required time to create the bucket: 1.650s
Required time to upload the files: 2.566s
Required time to download the files: 2.348s
Required time to erase the objects: 1.432s
Required time to erase the bucket: 1.468s
Required time to perform all S3-related operations: 9.464s
5 Files, 4 kb (2^12 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 4096 -p
...
Required time to create the bucket: 1.246s
Required time to upload the files: 2.100s
Required time to download the files: 2.519s
Required time to erase the objects: 1.587s
Required time to erase the bucket: 1.054s
Required time to perform all S3-related operations: 8.506s
5 Files, 8 kb (2^13 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 8192 -p
...
Required time to create the bucket: 1.248s
Required time to upload the files: 2.249s
Required time to download the files: 1.802s
Required time to erase the objects: 1.624s
Required time to erase the bucket: 1.067s
Required time to perform all S3-related operations: 7.990s
5 Files, 16 kb (2^14 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 16384 -p
...
Required time to create the bucket: 1.327s
Required time to upload the files: 2.229s
Required time to download the files: 3.415s
Required time to erase the objects: 1.597s
Required time to erase the bucket: 1.225s
Required time to perform all S3-related operations: 9.793s
5 Files, 32 kb (2^15 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 32768 -p
...
Required time to create the bucket: 1.688s
Required time to upload the files: 2.585s
Required time to download the files: 2.338s
Required time to erase the objects: 1.447s
Required time to erase the bucket: 0.977s
Required time to perform all S3-related operations: 9.035s
5 Files, 64 kb (2^16 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 65536 -p
...
Required time to create the bucket: 1.390s
Required time to upload the files: 2.608s
Required time to download the files: 2.496s
Required time to erase the objects: 2.444s
Required time to erase the bucket: 1.057s
Required time to perform all S3-related operations: 9.995s
5 Files, 128 kb (2^17 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 131072 -p
...
Required time to create the bucket: 1.571s
Required time to upload the files: 3.373s
Required time to download the files: 3.026s
Required time to erase the objects: 1.566s
Required time to erase the bucket: 1.474s
Required time to perform all S3-related operations: 11.010s
5 Files, 256 kb (2^18 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 262144 -p
...
Required time to create the bucket: 1.352s
Required time to upload the files: 4.505s
Required time to download the files: 3.442s
Required time to erase the objects: 1.674s
Required time to erase the bucket: 1.115s
Required time to perform all S3-related operations: 12.088s
5 Files, 512 kb (2^19 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 524288 -p
...
Required time to create the bucket: 1.468s
Required time to upload the files: 5.615s
Required time to download the files: 3.982s
Required time to erase the objects: 2.037s
Required time to erase the bucket: 1.324s
Required time to perform all S3-related operations: 14.426s
5 Files, 1 MB (2^20 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 1048576 -p
...
Required time to create the bucket: 1.959s
Required time to upload the files: 10.533s
Required time to download the files: 5.345s
Required time to erase the objects: 1.456s
Required time to erase the bucket: 1.162s
Required time to perform all S3-related operations: 20.455s
5 Files, 2 MB (2^21 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 2097152 -p
...
Required time to create the bucket: 1.635s
Required time to upload the files: 20.042s
Required time to download the files: 6.613s
Required time to erase the objects: 2.287s
Required time to erase the bucket: 2.255s
Required time to perform all S3-related operations: 32.832s
5 Files, 4 MB (2^22 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 4194304 -p
...
Required time to create the bucket: 1.976s
Required time to upload the files: 38.784s
Required time to download the files: 10.095s
Required time to erase the objects: 1.663s
Required time to erase the bucket: 1.137s
Required time to perform all S3-related operations: 53.655s
5 Files, 8 MB (2^23 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 8388608 -p
...
Required time to create the bucket: 1.452s
Required time to upload the files: 73.890s
Required time to download the files: 16.989s
Required time to erase the objects: 1.916s
Required time to erase the bucket: 1.336s
Required time to perform all S3-related operations: 95.583s
5 Files, 16 MB (2^24 Byte) each, parallel transfer
$ ./s3perf.sh -n 5 -s 16777216 -p
...
Required time to create the bucket: 1.452s
Required time to upload the files: 146.807s
Required time to download the files: 36.063s
Required time to erase the objects: 2.974s
Required time to erase the bucket: 1.582s
Required time to perform all S3-related operations: 188.878s