1.DataTalksClub / data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
+6,292 stars
from 40,290 · score 8.75
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
46 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
2.kestra-io / kestra
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
+3,664 stars
from 26,443 · score 8.21
3.cocoindex-io / cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
+3,272 stars
from 8,533 · score 8.09
4.apache / superset
Apache Superset is a Data Visualization and Data Exploration Platform
+3,149 stars
from 72,238 · score 8.06
5.GokuMohandas / Made-With-ML
Learn how to develop, deploy and iterate on production-grade ML applications.
+2,738 stars
from 47,154 · score 7.92
6.apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
+2,317 stars
from 45,026 · score 7.75
7.eugeneyan / applied-ml
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
+2,134 stars
from 28,632 · score 7.67
8.PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
+1,955 stars
from 22,150 · score 7.58
9.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
+1,213 stars
from 21,082 · score 7.10
10.dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
+1,030 stars
from 15,331 · score 6.94
11.growthbook / growthbook
Open Source Feature Flags, Experimentation, and Product Analytics
+859 stars
from 7,697 · score 6.76
12.evidence-dev / evidence
Business intelligence as code: build fast, interactive data visualizations in SQL and markdown
+821 stars
from 6,258 · score 6.71
13.dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
+782 stars
from 5,263 · score 6.66
14.andkret / Cookbook
The Data Engineering Cookbook
+524 stars
from 15,000 · score 6.26
15.fivetran / great_expectations
Always know what to expect from your data.
+516 stars
from 11,396 · score 6.25
16.argoproj / argo-workflows
Workflow Engine for Kubernetes
+486 stars
from 16,591 · score 6.19
17.risingwavelabs / risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
+459 stars
from 8,937 · score 6.13
18.Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
+457 stars
from 18,996 · score 6.13
19.xonsh / xonsh
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
+425 stars
from 9,259 · score 6.05
20.feast-dev / feast
The Open Source Feature Store for AI/ML
+385 stars
from 6,967 · score 5.96
21.treeverse / lakeFS
lakeFS - Data version control for your data lake | Git for data
+268 stars
from 5,307 · score 5.59
22.meltano / meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
+208 stars
from 2,466 · score 5.34
23.dathere / qsv
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
+207 stars
from 3,611 · score 5.34
24.cloudquery / cloudquery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
+178 stars
from 6,372 · score 5.19
25.redpanda-data / connect
Fancy stream processing made operationally mundane
+168 stars
from 8,624 · score 5.13
26.apache / hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
+155 stars
from 2,467 · score 5.05
27.rudderlabs / rudder-server
Privacy and Security focused Segment-alternative, in Golang and React
+134 stars
from 4,379 · score 4.91
28.datastacktv / data-engineer-roadmap
Roadmap to becoming a data engineer in 2021
+102 stars
from 12,653 · score 4.63
29.bytewax / bytewax
Python Stream Processing
+91 stars
from 1,979 · score 4.52
30.estuary / flow
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
+75 stars
from 912 · score 4.33
31.Multiwoven / multiwoven
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
+49 stars
from 1,635 · score 3.91
32.quixio / quix-streams
Python Streaming DataFrames for Kafka
+44 stars
from 1,539 · score 3.81
33.Desbordante / desbordante-core
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
+38 stars
from 477 · score 3.66
34.aws / aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
+32 stars
from 4,090 · score 3.50
35.ConduitIO / conduit
Conduit streams data between data stores. Kafka Connect replacement. No JVM required.
+30 stars
from 588 · score 3.43
36.eventum-generator / eventum
Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk
+29 stars
from 42 · score 3.40
37.pyjanitor-devs / pyjanitor
Clean APIs for data cleaning. Python implementation of R package Janitor
+25 stars
from 1,473 · score 3.26
38.datafold / data-diffArchived
Compare tables within or across databases
+24 stars
from 2,966 · score 3.22
39.nnnkkk7 / snowflake-emulator
A lightweight Snowflake emulator built with Go and DuckDB for local development and testing
+21 stars
from 36 · score 3.09
40.drt-hub / drt
Reverse ETL for the code-first data stack
+17 stars
from 19 · score 2.89
41.ploomber / ploomberArchived
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
+12 stars
from 3,609 · score 2.56
42.provero-org / provero
Declarative data quality engine. Define checks in YAML, run anywhere.
+6 stars
from 11 · score 1.95
43.mgillr / crdt-merge
Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.
+5 stars
from 2 · score 1.79
44.rdagumampan / yuniql
Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!
+3 stars
from 427 · score 1.39
45.godalida / koala-diff
Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.
+3 stars
from 6 · score 1.39
46.dataspoclab / dataspoc-pipe
Data ingestion engine — Singer taps to Parquet in cloud buckets
+3 stars
from 1 · score 1.39