SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Repository Index
85,081 visible repositories in the index
1–24 of 26 · Most stars
Ceph is a distributed object, block, and file storage platform
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
- filesystem
- cloud-native
- golang
- redis
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
- distributed-file-system
macFUSE umbrella repository
- macfuse
FastDFS is a high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs
- distributed-file-system
- distributed-file-storage
- storage-servers
Alluxio, data orchestration for analytics and machine learning in the cloud
A little fail-safe filesystem designed for microcontrollers
The Universal Filesystem Abstraction for Go
- compression
- filesystem
- fs
- go
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
a high-performance, POSIX-ish Amazon S3 file system written in Go
- s3-bucket
- s3
- posix
- filesystem
Gluster Filesystem : Build your distributed storage in minutes
- gluster
- storage
- c
- distributed-systems
Free, open-source NTFS read-write for macOS, built on Apple FSKit. No kernel extension, no macFUSE, no admin password. Also on the Mac App Store.
- ntfs
- ntfs-read
- ntfstool
- ntfsformac
go-fastdfs 是一个简单的分布式文件系统(私有云存储),具有无中心、高性能,高可靠,免维护等优点,支持断点续传,分块上传,小文件合并,自动同步,自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic repair.(similar fastdfs).
- storage-servers
- distributed-file-storage
- distributed-file-system
- godfs
ZeroFS: A log-structured filesystem for S3. ZeroFS serves S3-compatible buckets as POSIX filesystems over NFS and 9P, or as raw block devices over NBD.
- nfs
- nfs-server
- nbd
- 9p
Ephemeral Workspaces, durable shared history. LayerFS gives every agent a complete, writable filesystem Workspace over shared committed history, without copying the base. Agents work in parallel, commit what changed as deduplicated checkpoints, then branch, rewind or merge. Try it with LayerFS × DSH.
- agent-infrastructure
- ai-agents
- checkpoint
- content-addressable-storage
A fast high-compression read-only file system for Linux, FreeBSD, macOS and Windows
- filesystem
- squashfs
- compression
- fuse-filesystem
Version controlled file system
- fuse-filesystem
- python
- git
Curve is a sandbox project hosted by the CNCF Foundation. It's cloud-native, high-performance, and easy to operate. Curve is an open-source distributed storage system for block and shared file storage.
- storage
- distributed-systems
- raft
- sds
MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage
- software-defined-storage
- posix
- filesystem
- distributed-storage
macOS: mount any linux-supported filesystem read/write using NFS and a microVM
- btrfs
- disk
- disk-management
- encrypted-data
Mount a torrent (or magnet link) as a filesystem in real time using torrent-stream and fuse. AKA MAD SCIENCE!
YAS3FS (Yet Another S3-backed File System) is a Filesystem in Userspace (FUSE) interface to Amazon S3. It was inspired by s3fs but rewritten from scratch to implement a distributed cache synchronized by Amazon SNS notifications. A web console is provided to easily monitor the nodes of a cluster.
Cross-platform library to create & extract archives, compress & decompress files, and walk virtual file systems across various formats
- 7zip
- archives
- brotli
- bzip2