Minio - bobbae/gcp GitHub Wiki
MinIO is a High Performance Object Storage released under Apache License v2.0. It is API compatible with Amazon S3 cloud storage service. Use MinIO to build high performance infrastructure for machine learning, analytics and application data workloads.
https://docs.min.io/docs/minio-quickstart-guide.html
MinIO is a cloud-native application designed to scale in a sustainable manner in multi-tenant environments. Orchestration platforms provide perfect launchpad for MinIO to scale
https://docs.min.io/docs/minio-deployment-quickstart-guide.html
MinIO Client (mc) provides a modern alternative to UNIX commands like ls, cat, cp, mirror, diff, find etc. It supports filesystems and Amazon S3 compatible cloud storage service (AWS Signature v2 and v4).
https://docs.min.io/docs/minio-client-quickstart-guide.html
Erasure Code
MinIO protects data against hardware failures and silent data corruption using erasure code and checksums. With the highest level of redundancy, you may lose up to half (N/2) of the total drives and still be able to recover the data.
https://docs.min.io/docs/minio-erasure-code-quickstart-guide.html
Reed-Solomon
Erasure code is a mathematical algorithm to reconstruct missing or corrupted data. MinIO uses Reed-Solomon code to shard objects into variable data and parity blocks. For example, in a 12 drive setup, an object can be sharded to a variable number of data and parity blocks across all the drives - ranging from six data and six parity blocks to ten data and two parity blocks.
Distributed MinIO
MinIO in distributed mode lets you pool multiple drives (even on different machines) into a single object storage server. As drives are distributed across several nodes, distributed MinIO can withstand multiple node failures and yet ensure full data protection.
https://docs.min.io/docs/distributed-minio-quickstart-guide.html
MinIO on Kubernetes
https://docs.min.io/docs/deploy-minio-on-kubernetes.html
MinIO and TLS
https://docs.min.io/docs/how-to-secure-access-to-minio-server-with-tls.html
Server side encryption
https://docs.min.io/docs/minio-security-overview.html
SDK
https://docs.min.io/docs/golang-client-quickstart-guide.html
Multi-tenant
https://docs.min.io/docs/multi-tenant-minio-deployment-guide.html
Disaggregated Spark and Hadoop Hive with MinIO
https://docs.min.io/docs/disaggregated-spark-and-hadoop-hive-with-minio.html
Cookbooks
https://docs.min.io/docs/minio-client-quickstart-guide.html
Store PostgreSQL Backups in MinIO
https://docs.min.io/docs/store-postgresql-backups-in-minio.html
Awesome list
https://github.com/minio/awesome-minio
Other s3 compatible services
https://www.coralnodes.com/amazon-s3-alternatives/
GCS and minio
Minio GCS Gateway allows you access GCS with s3-compatible APIs.
https://docs.min.io/docs/minio-gateway-for-gcs.html
JuiceFS
JuiceFS is a POSIX/NFS/HDFS compatible shared filesystem layer that stores data in object stores in the cloud and meta-data in SQL databases.