LarkMidTable 是一站式开源的数据中台，实现中台的 基础建设，数据治理，数据开发，监控告警，数据服务，数据的可视化，实现高效赋能数据前台并提供数据服务的产品。
- flink
- flinkx
- seatunnel
- datax
Repository Index
77,852 visible repositories in the index
25–46 of 46 · Most stars
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
- analytics
- bigquery
- data-modeling
- data-pipelines
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
- data-engineering
- reverse-etl
- data-pipeline
- data-activation
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 426 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
- data-engineering
- data-integration
- data-pipeline
- data-quality
Import CSV and JSON into PostgreSQL the easy way
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
- flow
- rust
- rust-lang
- stream
Distributed Data Transfer Service for MySQL
- mysql
- data-transfer
- data-migration
- replication
Import, validate, query, and export GTFS Schedule and Realtime data with SQLite, PostgreSQL, and MySQL.
This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
The data transformation tool the open-source community deserves.
- data-engineering
- duckdb
- data-lineage
- data-pipeline
go-etl is a toolset for data extraction, transformation and loading.
- etl
- mysql
- go
- postgresql
A plugin to push to Algolia based on graphQl queries
- gatsby
- algolia
- search
- static-site-generator
Event-driven OneLake pipeline with automated Upsert merge and Python reporting
- activator
- data-engineering
- data-factory
- data-pipeline
Analyse GTFS Schedule data by importing it into a PostgreSQL database.
A high performance data transfer tool that can be used to transfer data from Bitcoin Core blockchain files to a SQL Server database
A blazing fast fully-automated CSV to database importer
- csv2sql
- csvs
- database
- csv-files
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
Just swoof it in
- golang
- mysql
Java importer skeleton for complicated, business-logic-heavy high-performance Neo4j imports directly from SQL databases, CSV files, etc.
- neo4j
- java
- neo4j-graphaware-framework
Data logistics system enabling real-time pathogen surveillance. Built for the Seattle Flu Study.
- postgres
- postgresql
- python
- infectious-disease
Analyse GTFS Schedule data by importing it into a DuckDB database.
Reads EVE files into SQL as well as search stored data.