SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Repository Index
58,632 visible repositories in the index
1–21 of 21 · Most stars
Storage Orchestration for Kubernetes
- storage
- kubernetes
- ceph
- storage-cluster
Upspin: A framework for naming everyone's everything.
- storage
- golang
- cryptography
- sharing
cloud-native distributed storage
- distributed-storage
- cncf
- kubernetes
- cloud-storage
lakeFS - Data version control for your data lake | Git for data
- data-engineering
- data-versioning
- go
- object-storage
A feature complete and high performance multi-group Raft library in Go.
- raft
- paxos
- golang
- go
S3-Compatible Object Storage. A MinIO fork maintained by PGSTY
- object-storage
- minio
- s3
- pigsty
Google Cloud Client Libraries for Go.
- google-cloud
- golang
- go
- cloud-datastore
Parallel S3 and local filesystem execution tool.
go-fastdfs 是一个简单的分布式文件系统(私有云存储)，具有无中心、高性能，高可靠，免维护等优点，支持断点续传，分块上传，小文件合并，自动同步，自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic repair.(similar fastdfs).
- storage-servers
- distributed-file-storage
- distributed-file-system
- godfs
MinIO Go client SDK for S3 compatible object storage
- libraries
- go
- minio
- client-sdk
OCI registry client - managing content like artifacts, images, packages
REX-Ray is a container storage orchestration engine enabling persistence for cloud native workloads
- go
- rex-ray
- storage-providers
- docker
s3git: git for Cloud Storage. Distributed Version Control for Data. Create decentralized and versioned repos that scale infinitely to 100s of millions of files. Clone huge PB-scale repos on your local SSD to make changes, commit and push back. Oh yeah, it dedupes too and offers directory versioning.
- cloud-storage
- git
- version-control
- decentralized
Simple key-value store abstraction and implementations for Go (Redis, Consul, etcd, bbolt, BadgerDB, LevelDB, Memcached, DynamoDB, S3, PostgreSQL, MongoDB, CockroachDB and many more)
- go
- golang
- key-value
- key-value-store
Storage and image processing server written in Go
- golang
- image-processing
- storage
- docker
Abstract File Storage
- file-manager
- filesystem
- scp
- zip
📦 Premade storage drivers for 🚀 Fiber
go-test-coverage is a tool designed to report issues when test coverage falls below a specified threshold
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.
Generic Golang Key/Value trait for AWS storage services
- aws-dynamodb
- golang
- key-value
- type-safe