SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Repository Index
97,836 visible repositories in the index
1–12 of 12 · Most stars
Ceph is a distributed object, block, and file storage platform
A simple to deploy but feature rich S3 object storage server for your filesystem
- filesystem
- s3
- s3-storage
- object-storage
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training
- gpu
- high-performance
- rdma
- rust
OpenStack Storage (Swift). Mirror of code maintained at opendev.org.
- service
Aliyun OSS(Object Storage Service) JavaScript SDK for the Browser and Node.js
- aliyun
- oss
- aliyun-oss
- sdk
AIStore: scalable storage for AI applications
- object-storage
- etl-offload
- linear-scalability
- batch-jobs
S3 compatible object storage service that stores metadata in Postgres
- postgres
- s3
- gotrue
- object-storage
Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.
An S3-compatible object store backed by iCloud Shared Photo Albums. Quota policy: Apple's Shared Album loophole.
The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)
- distributed-storage
- distributed-systems
- vertx
- rxjava
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.