Sign in

Repository Index

73,362 visible repositories in the index

Tags: File system
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–20 of 20 · Most stars

SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

  • distributed-storage
  • s3
  • hdfs
  • fuse

Ceph is a distributed object, block, and file storage platform

  • storage
  • software-defined-storage
  • distributed-storage
  • s3

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

  • distributed-file-system

FastDFS is a high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs

  • distributed-file-system
  • distributed-file-storage
  • storage-servers

ZeroFS: A log-structured filesystem for S3. ZeroFS serves S3-compatible buckets as POSIX filesystems over NFS and 9P, or as raw block devices over NBD.

  • nfs
  • nfs-server
  • nbd
  • 9p

BrowserFS is an in-browser filesystem that emulates the Node JS filesystem API and supports storing and retrieving files from various backends.

Ephemeral Workspaces, durable shared history. LayerFS gives every agent a complete, writable filesystem Workspace over shared committed history, without copying the base. Agents work in parallel, commit what changed as deduplicated checkpoints, then branch, rewind or merge. Try it with LayerFS × DSH.

  • agent-infrastructure
  • ai-agents
  • checkpoint
  • content-addressable-storage

A fast high-compression read-only file system for Linux, FreeBSD, macOS and Windows

YAS3FS (Yet Another S3-backed File System) is a Filesystem in Userspace (FUSE) interface to Amazon S3. It was inspired by s3fs but rewritten from scratch to implement a distributed cache synchronized by Amazon SNS notifications. A web console is provided to easily monitor the nodes of a cluster.

Cross-platform library to create & extract archives, compress & decompress files, and walk virtual file systems across various formats

  • 7zip
  • archives
  • brotli
  • bzip2

S3FS-C is a FUSE (File System in User Space) based file system backed by Amazon S3 storage buckets. Once mounted, S3 can be used just like it was a local file system. This project was forked from S3FS (http://code.google.com/p/s3fs/) release 1.59 and being rewritten to be compatible with other S3 clients such as s3cmd, AWS Management Console, etc.

Deno KV file system, compatible with Deno deploy. Saves files in 64kb chunks. You can organize files into directories. You can control the KB/s rate for saving and reading files, rate limit, user space limit and limit concurrent operations, useful for controlling uploads/downloads. Makes use of Web Streams API.