Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–10 of 10 · Most stars
PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.
Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Continuous Archiving for Postgres
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Super S3 command line tool
Parallel uploads to Amazon AWS S3
Read and write Neuroglancer datasets programmatically.
micrOS - mini asynchronous automation OS for DIY projects.