SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Repository Index
47,133 repositories indexed
1–22 of 22 · Most stars
Ceph is a distributed object, block, and file storage platform
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
- distributed-file-system
FUSE-based file system backed by Amazon S3
- fuse
- s3
- aws-s3
- filesystem
A network filesystem client to connect to SSH servers
πfs - the data-free filesystem!
The Universal Filesystem Abstraction for Go
- compression
- filesystem
- fs
- go
a high-performance, POSIX-ish Amazon S3 file system written in Go
- s3-bucket
- s3
- posix
- filesystem
Ephemeral Workspaces, durable shared history. LayerFS gives every agent a complete, writable filesystem Workspace over shared committed history, without copying the base. Agents work in parallel, commit what changed as deduplicated checkpoints, then branch, rewind or merge. Try it with LayerFS × DSH.
- agent-infrastructure
- ai-agents
- checkpoint
- content-addressable-storage
Version controlled file system
- fuse-filesystem
- python
- git
Mount a torrent (or magnet link) as a filesystem in real time using torrent-stream and fuse. AKA MAD SCIENCE!
cppcryptfs is an implementation of the gocryptfs encrypted overlay filesystem in C++ for Windows.
YAS3FS (Yet Another S3-backed File System) is a Filesystem in Userspace (FUSE) interface to Amazon S3. It was inspired by s3fs but rewritten from scratch to implement a distributed cache synchronized by Amazon SNS notifications. A web console is provided to easily monitor the nodes of a cluster.
Cross-platform library to create & extract archives, compress & decompress files, and walk virtual file systems across various formats
- 7zip
- archives
- brotli
- bzip2
Abstract File Storage
- file-manager
- filesystem
- scp
- zip
A go library for reading and creating ISO9660 images
- iso
- iso9660
- cdrom
OpenCSD: eBPF Computational Storage Device (CSD) for Zoned Namespace (ZNS) SSDs in QEMU
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.
Create self-extracting compressed or self-mounting archives for MicroPython
Read and write FAT format filesystems from OCaml
Deno KV file system, compatible with Deno deploy. Saves files in 64kb chunks. You can organize files into directories. You can control the KB/s rate for saving and reading files, rate limit, user space limit and limit concurrent operations, useful for controlling uploads/downloads. Makes use of Web Streams API.