"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
- golang
- go
- cloud-storage
- s3
Repository Index
47,133 repositories indexed
1–24 of 39 · Most stars
SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Database migrations. CLI and Golang library.
- go
- golang
- migration
- migrations
:file_folder: Universal File Management Platform (for humans and agents)
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Streaming replication for SQLite.
Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
- prometheus
- google-cloud-storage
- high-availability
- prometheus-ha-pairs
Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob
- sftp-server
- go
- sftp
- scp
lakeFS - Data version control for your data lake | Git for data
- data-engineering
- data-versioning
- go
- object-storage
a high-performance, POSIX-ish Amazon S3 file system written in Go
- s3-bucket
- s3
- posix
- filesystem
S3-Compatible Object Storage. A MinIO fork maintained by PGSTY
- object-storage
- minio
- s3
- pigsty
Archival and Restoration for databases in the Cloud
- go
- golang
- postgresql
- postgres
Simple, extremely lightweight, extensible, configuration management library for Go. Supports JSON, TOML, YAML, env, command line, file, S3 etc. Alternative to viper.
- configuration
- configuration-management
- configuration-file
- golang
Parallel S3 and local filesystem execution tool.
Backup Docker volumes locally or to any S3, WebDAV, Azure Blob Storage, Dropbox, Google Drive or SSH compatible storage
- docker
- docker-volume
- backup
- docker-compose
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
- etl
- sql
- bigquery
- cloud-native
MinIO Go client SDK for S3 compatible object storage
- libraries
- go
- minio
- client-sdk
Lightweight selfhosted Firefox Send alternative without public upload. AWS S3 supported.
- selfhosted
- self-hosted
- download
- uploader
🐘 Effortless PostgreSQL backups with a user-friendly web interface! 🌐💾
s3git: git for Cloud Storage. Distributed Version Control for Data. Create decentralized and versioned repos that scale infinitely to 100s of millions of files. Clone huge PB-scale repos on your local SSD to make changes, commit and push back. Oh yeah, it dedupes too and offers directory versioning.
- cloud-storage
- git
- version-control
- decentralized
Fast, concurrent, streaming access to Amazon S3, including gof3r, a CLI. http://godoc.org/github.com/rlmcpherson/s3gof3r
Simple key-value store abstraction and implementations for Go (Redis, Consul, etcd, bbolt, BadgerDB, LevelDB, Memcached, DynamoDB, S3, PostgreSQL, MongoDB, CockroachDB and many more)
- go
- golang
- key-value
- key-value-store
Simple to use, simple to deploy, one time self destruct messaging service, with hashicorp vault as a backend
Storage and image processing server written in Go