Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–12 of 12 · Most stars
Migrate to PostgreSQL in a single command!
- postgresql
- migration
- mysql
- mssql
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Database Subsetting and Relational Data Browsing Tool.
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
- flow
- rust
- rust-lang
- stream
Distributed Data Transfer Service for MySQL
- mysql
- data-transfer
- data-migration
- replication
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
go-etl is a toolset for data extraction, transformation and loading.
A blazing fast fully-automated CSV to database importer
- csv2sql
- csvs
- database
- csv-files
An import river similar to the elasticsearch mysql river
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
Just swoof it in
- golang
- mysql