Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–8 of 8 · Most stars
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
A library that allows you to easily mock out tests based on AWS infrastructure.
Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).
Continuous Archiving for Postgres
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Parallel uploads to Amazon AWS S3
Read and write Neuroglancer datasets programmatically.