Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Repository Index
47,133 repositories indexed
1–19 of 19 · Most stars
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Turns Data and AI algorithms into production-ready web applications in no time.
An orchestration platform for the development, production, and observation of data assets.
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
Upserts, Deletes And Incremental Processing on Big Data.
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Where data access meets operational intelligence
Privacy and Security focused Segment-alternative, in Golang and React
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Connect your company's data, let an agent draft an ontology over it, and load it into HelixDB as one graph you can explore and ask questions of. Hosted at foundry.helix-db.com, or run it on your own machine.
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Fast, sensitive and accurate integration of single-cell data with Harmony
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
Reference mapping for single-cell genomics
Hetionet: an integrative network of disease