SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Repository Index
47,133 repositories indexed
1–15 of 15 · Most stars
Storage Orchestration for Kubernetes
- storage
- kubernetes
- ceph
- storage-cluster
lakeFS - Data version control for your data lake | Git for data
- data-engineering
- data-versioning
- go
- object-storage
A feature complete and high performance multi-group Raft library in Go.
- raft
- paxos
- golang
- go
Google Cloud Client Libraries for Go.
- google-cloud
- golang
- go
- cloud-datastore
S3-Compatible Object Storage. A MinIO fork maintained by PGSTY
- object-storage
- minio
- s3
- pigsty
Parallel S3 and local filesystem execution tool.
MinIO Go client SDK for S3 compatible object storage
- libraries
- go
- minio
- client-sdk
OCI registry client - managing content like artifacts, images, packages
REX-Ray is a container storage orchestration engine enabling persistence for cloud native workloads
- go
- rex-ray
- storage-providers
- docker
s3git: git for Cloud Storage. Distributed Version Control for Data. Create decentralized and versioned repos that scale infinitely to 100s of millions of files. Clone huge PB-scale repos on your local SSD to make changes, commit and push back. Oh yeah, it dedupes too and offers directory versioning.
- cloud-storage
- git
- version-control
- decentralized
Simple key-value store abstraction and implementations for Go (Redis, Consul, etcd, bbolt, BadgerDB, LevelDB, Memcached, DynamoDB, S3, PostgreSQL, MongoDB, CockroachDB and many more)
- go
- golang
- key-value
- key-value-store
Storage and image processing server written in Go
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.
Generic Golang Key/Value trait for AWS storage services
- aws-dynamodb
- golang
- key-value
- type-safe