Non Amazon S3 - s3fs-fuse/s3fs-fuse GitHub Wiki

s3fs supports a variety of non-Amazon S3 services. Users can override the default URL via the -o url=https:// option. Some providers do not support the full S3 API, e.g., lacking multi-part upload. Examples follow:

Alibaba

s3fs BUCKET PATH \
    -o url=https://oss-ap-northeast-1.aliyuncs.com \
    -o nomixupload

• endpoints

Backblaze

s3fs BUCKET PATH \
    -o url=https://s3.us-west-001.backblazeb2.com

• endpoint instructions
• b2_fuse

Cloudflare R2

s3fs BUCKET PATH \
    -o url="https://[account-id].r2.cloudflarestorage.com" \
    -o nomixupload \
    -o endpoint=auto

DreamObjects

s3fs BUCKET PATH \
    -o url=https://objects-us-east-1.dream.io

Google Cloud Storage

With s3fs 1.89 or earlier:

s3fs BUCKET PATH \
    -o url=https://storage.googleapis.com \
    -o nomultipart

With s3fs 1.90 or later:

s3fs BUCKET PATH \
    -o url=https://storage.googleapis.com

• more detailed instructions
• gcsfuse

IBM Cloud Object Store

TODO: add endpoint

To use IBM IAM Authentication, use the -o ibm_iam_auth option, and specify the Service Instance ID and API Key in your credentials file:

echo SERVICEINSTANCEID:APIKEY > /path/to/passwd

The Service Instance ID is only required when using the -o create_bucket option.

iDrive

s3fs BUCKET PATH \
    -o url=https://s3.us-west-1.idrivecloud.io

Minio

s3fs BUCKET PATH \
    -o url=http://minio.server:9000/ \
    -o use_path_request_style

NetApp StorageGRID

s3fs BUCKET PATH \
    -o url=https://[api node]:8082 \ 
    -o use_path_request_style

Additional proven settings for transferring many large files:

-o readwrite_timeout=210,multipart_size=250,multipart_threshold=5120,parallel_count=20,tmpdir=[large directory for temp files]/,dbglevel=warn

Oracle Cloud Object Storage

s3fs BUCKET PATH \
    -o url=https://[tenant-id].compat.objectstorage.[region-id].oraclecloud.com/ \
    -o use_path_request_style \
    -o nomultipart 

For details on how to get tenant-id, region-id and AWSACCESSKEYID/AWSSECRETACCESSKEY values please follow this post Using Oracle Cloud Object Storage as Docker Volume.

Qiniu

s3fs BUCKET PATH \
    -o url=https://s3-cn-east-1.qiniucs.com \
    -o use_path_request_style

• more docs
• endpoints

S3Proxy

S3Proxy allows mounting non-S3 buckets, e.g., Microsoft Azure Blob.

s3fs BUCKET PATH \
    -o url=http://127.0.0.1:8081 \
    -o use_path_request_style

Scaleway

s3fs BUCKET PATH \
    -o url=https://s3.nl-ams.scw.cloud

• Scaleway documentation

Serverius EuroStack

s3fs BUCKET PATH \
    -o url=https://sdc1.storage.serverius.net
    -o use_path_request_style

See for further information the Serverius knowledgebase.

Synology C2 Object Storage

s3fs BUCKET PATH \
    -o url=https://eu-002.s3.synologyc2.net

Tencent Cloud Object Store

s3fs BUCKET PATH \
    -o url=https://cos.ap-shanghai.myqcloud.com

• endpoints

Vultr

s3fs BUCKET PATH \
    -o url=https://[REIGON].vultrobjects.com

For example, Silicon Valley (sjc1) would be https://sjc1.vultrobjects.com.

Wasabi

s3fs BUCKET PATH \
    -o url=https://s3.wasabisys.com

• Wasabi documentation

Yandex Cloud

s3fs BUCKET PATH \
    -o url=https://storage.yandexcloud.net \
    -o use_path_request_style