Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
58,136 visible repositories in the index
1–7 of 7 · Most stars
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
The data transformation tool the open-source community deserves.
- data-engineering
- duckdb
- data-lineage
- data-pipeline
Code to download, process, and analyse the Online Encyclopedia of Integer Sequences
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
ETL scripts for EOS.
- eos
- eosio
- etl
- apache-beam
Data ingestion engine — Singer taps to Parquet in cloud buckets