SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Repository Index
142,273 visible repositories in the index
1–24 of 31 · Most stars
Ceph is a distributed object, block, and file storage platform
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
- filesystem
- cloud-native
- golang
- redis
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
- distributed-file-system
Give your agent a computer 👾
FastDFS is a high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs
- distributed-file-system
- distributed-file-storage
- storage-servers
Alluxio, data orchestration for analytics and machine learning in the cloud
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
cloud-native distributed storage
- distributed-storage
- cncf
- kubernetes
- cloud-storage
Gluster Filesystem : Build your distributed storage in minutes
- gluster
- storage
- c
- distributed-systems
go-fastdfs 是一个简单的分布式文件系统(私有云存储),具有无中心、高性能,高可靠,免维护等优点,支持断点续传,分块上传,小文件合并,自动同步,自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic repair.(similar fastdfs).
- storage-servers
- distributed-file-storage
- distributed-file-system
- godfs
ZeroFS: A log-structured filesystem for S3. ZeroFS serves S3-compatible buckets as POSIX filesystems over NFS and 9P, or as raw block devices over NBD.
- nfs
- nfs-server
- nbd
- 9p
Ephemeral Workspaces, durable shared history. LayerFS gives every agent a complete, writable filesystem Workspace over shared committed history, without copying the base. Agents work in parallel, commit what changed as deduplicated checkpoints, then branch, rewind or merge. Try it with LayerFS × DSH.
- agent-infrastructure
- ai-agents
- checkpoint
- content-addressable-storage
Curve is a sandbox project hosted by the CNCF Foundation. It's cloud-native, high-performance, and easy to operate. Curve is an open-source distributed storage system for block and shared file storage.
- storage
- distributed-systems
- raft
- sds
Hyperdrive is a secure, real time distributed file system
MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage
- software-defined-storage
- posix
- filesystem
- distributed-storage
Nydus - a reliable, high-performance on-demand load filesytem framework for container image and data distribution.
- container
- container-image
- accelerator
- snapshotter
distributed file system(small file storage) writen in golang.
An exabyte-scale, multi-region distributed file system
Xbox ISO Creation/Extraction utility. Imported from SourceForge.
- xbox
- game
- iso
- dvd
Bootloader for root-on-ZFS systems with support for snapshots and native full disk encryption
- zfs
- linux
- bootloader
- boot-environment
YouTube File System
AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.
- s3
- rust
- cloud-native
- ai
LuaFileSystem is a Lua library developed to complement the set of functions related to file systems offered by the standard Lua distribution.