SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Repository Index
47,133 repositories indexed
1–24 of 34 · Most stars
RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.
Pulumi - Infrastructure as Code in any programming language 🚀
Ceph is a distributed object, block, and file storage platform
contaiNERD CTL - Docker-compatible CLI for containerd, with support for Compose, Rootless, eStargz, OCIcrypt, IPFS, ...
- containerd
lakeFS - Data version control for your data lake | Git for data
- data-engineering
- data-versioning
- go
- object-storage
Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
Go client for the Docker Engine API.
A Terraform / OpenTofu state migration tool for GitOps
Old (2022) proof of concept: Zero-Config CLI to Deploy Static Websites to IPFS
- ipfs
- dnslink
- pinning
- deploying
Docker NFS, AWS EFS, Ceph & Samba/CIFS Volume Plugin
- docker
- volume-plugin
- nfs
- efs
🚀 Upload files via DDP or HTTP to ☄️ Meteor server FS, AWS, GridFS, DropBox or Google Drive. Fast, secure and robust.
- meteor
- meteor-package
- meteor-files
- gridfs
Nginx module for serving files from MongoDB's GridFS
Development repository for the aws cookbook
YAS3FS (Yet Another S3-backed File System) is a Filesystem in Userspace (FUSE) interface to Amazon S3. It was inspired by s3fs but rewritten from scratch to implement a distributed cache synchronized by Amazon SNS notifications. A web console is provided to easily monitor the nodes of a cluster.
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
- ipfs
- warc
- wayback
- web-archiving
A Flysystem integration for your Symfony projects.
- flysystem
- symfony
- filesystem
- php
A schema inspector for Terraform / OpenTofu providers
GitHub Action for upload to IPFS. Supports Pinata, Infura pinning service as well as direct upload.
FsConfig is a F# library for reading configuration data from environment variables and AppSettings with type safety.
- fsharp
- functional-programming
- generic-programming
- environment-variables
S3FS-C is a FUSE (File System in User Space) based file system backed by Amazon S3 storage buckets. Once mounted, S3 can be used just like it was a local file system. This project was forked from S3FS (http://code.google.com/p/s3fs/) release 1.59 and being rewritten to be compatible with other S3 clients such as s3cmd, AWS Management Console, etc.
The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)
- distributed-storage
- distributed-systems
- vertx
- rxjava
An F# Azure Type Provider which can be used to explore Blob, Table and Queue Azure Storage assets and easily apply CRUD operations on them.
- azure
- azure-storage
- fsharp
- typeprovider
Continuous Delivery of static websites to IPFS
- ipfs
- continuous-delivery
- python