"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
- golang
- go
- cloud-storage
- s3
Repository Index
47,133 repositories indexed
1–24 of 59 · Most stars
Translated🗂️A file list/WebDAV program that supports multiple storages, powered by Gin and Solidjs.
SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
🌩 Self-hosted file management and sharing system, supports multiple storage providers
Database migrations. CLI and Golang library.
- go
- golang
- migration
- migrations
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
- deduplication
- backup
- google-cloud-storage
- encryption
Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
- prometheus
- google-cloud-storage
- high-availability
- prometheus-ha-pairs
Storage Orchestration for Kubernetes
- storage
- kubernetes
- ceph
- storage-cluster
Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob
- sftp-server
- go
- sftp
- scp
The Open Source Firebase Alternative with GraphQL.
Google Drive client for the commandline
lakeFS - Data version control for your data lake | Git for data
- data-engineering
- data-versioning
- go
- object-storage
a high-performance, POSIX-ish Amazon S3 file system written in Go
- s3-bucket
- s3
- posix
- filesystem
A feature complete and high performance multi-group Raft library in Go.
- raft
- paxos
- golang
- go
Lightweight, fast and reliable key/value storage engine based on Bitcask.
- database
- kv-store
- golang
- data-structures
Google Cloud Client Libraries for Go.
- google-cloud
- golang
- go
- cloud-datastore
S3-Compatible Object Storage. A MinIO fork maintained by PGSTY
- object-storage
- minio
- s3
- pigsty
Archival and Restoration for databases in the Cloud
- go
- golang
- postgresql
- postgres
Parallel S3 and local filesystem execution tool.
Backup Docker volumes locally or to any S3, WebDAV, Azure Blob Storage, Dropbox, Google Drive or SSH compatible storage
- docker
- docker-volume
- backup
- docker-compose
A utility to improve performance and help manage storage on Steam Deck.
- steam-deck
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
- etl
- sql
- bigquery
- cloud-native
MinIO Go client SDK for S3 compatible object storage
- libraries
- go
- minio
- client-sdk