1.hugues31 / duckpad
The data transformation tool the open-source community deserves.
+290 stars
from 0 · score 5.67
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
41 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
2.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+87 stars
from 28,531 · score 4.48
3.apache / superset
Apache Superset is a Data Visualization and Data Exploration Platform
- superset
- apache
- apache-superset
- data-visualization
- data-viz
- analytics
- +12 more
+85 stars
from 75,302 · score 4.45
4.marimo-team / marimo
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
- notebooks
- python
- data-science
- machine-learning
- artificial-intelligence
- data-visualization
- +7 more
+79 stars
from 23,318 · score 4.38
5.apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
+66 stars
from 47,277 · score 4.20
6.dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
- data-pipelines
- dagster
- workflow
- data-science
- workflow-automation
- python
- +9 more
+37 stars
from 16,324 · score 3.64
7.BlueRingsLabs / no-shortcuts
Free Course : Data, Machine Learning, Deep Learning and AI Engineering, the long way round: the math, the code, the systems and the security. 173 lessons, 166 runnable labs, no shortcuts. Free under CC BY-NC 4.0.
- ai-engineering
- course
- data-engineering
- deep-learning
- llm
- machine-learning
- +6 more
+34 stars
from 132 · score 3.56
8.dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
- data-loading
- data-warehouse
- +4 more
+32 stars
from 6,013 · score 3.50
9.PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
- python
- workflow
- data-engineering
- data-science
- workflow-engine
- prefect
- +8 more
+31 stars
from 24,074 · score 3.47
10.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
+31 stars
from 22,264 · score 3.47
11.tobymao / sqlglot
Python SQL Parser and Transpiler
- transpiler
- sql
- python
- parser
- optimizer
- bigquery
- +14 more
+22 stars
from 9,721 · score 3.14
12.bytewax / bytewax
Python Stream Processing
- python
- stream-processing
- rust
- data-engineering
- data-processing
- data-science
- +3 more
+14 stars
from 2,056 · score 2.71
13.fivetran / great_expectations
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
- data-science
- data-profiling
- +14 more
+11 stars
from 11,901 · score 2.48
14.ibis-project / ibis
the portable Python dataframe library
- python
- impala
- pandas
- database
- clickhouse
- postgresql
- +12 more
+9 stars
from 6,679 · score 2.30
15.ag2ai / faststream
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
- asyncio
- kafka
- python
- rabbitmq
- asyncapi
- distributed-systems
- +7 more
+8 stars
from 5,383 · score 2.20
16.Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
+7 stars
from 19,446 · score 2.08
17.andkret / Cookbook
The Data Engineering Cookbook
- data-engineer
- data-engineering
- big-data
- best-practices
- cookbook
+7 stars
from 15,517 · score 2.08
18.online-ml / river
🌊 Online machine learning in Python
- incremental-learning
- machine-learning
- python
- online-learning
- online-statistics
- data-science
- +6 more
+7 stars
from 6,134 · score 2.08
19.feast-dev / feast
The Open Source Feature Store for AI/ML
- machine-learning
- features
- ml
- big-data
- feature-store
- python
- +4 more
+5 stars
from 7,347 · score 1.79
20.meltano / meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
- dataops
- dataops-platform
- elt
- open-source
- opensource
- data
- +14 more
+5 stars
from 2,669 · score 1.79
21.elyra-ai / elyra
Elyra extends JupyterLab with an AI centric approach.
- notebooks
- notebook-jupyter
- jupyterlab
- jupyterlab-extensions
- ai
- machine-learning
- +14 more
+5 stars
from 1,999 · score 1.79
22.narwhals-dev / narwhals
Lightweight and extensible compatibility layer between dataframe libraries!
+5 stars
from 1,740 · score 1.79
23.mahmoud / boltons
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
- python
- utilities
- cache
- data-structures
- statistics
- data-science
- +5 more
+4 stars
from 6,940 · score 1.61
24.twisted / twisted
Event-driven networking engine written in Python.
- python
- twisted
- async
- async-python
- network
- event-driven
- +8 more
+4 stars
from 5,995 · score 1.61
+4 stars
from 1,266 · score 1.61
+3 stars
from 6,055 · score 1.39
27.quixio / quix-streams
Python Streaming DataFrames for Kafka
+3 stars
from 1,580 · score 1.39
28.donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
- python
- machine-learning
- deep-learning
- data-science
- big-data
- aws
- +13 more
+2 stars
from 29,384 · score 1.10
29.piskvorky / smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
+2 stars
from 3,466 · score 1.10
30.pyeventsourcing / eventsourcing
A library for event sourcing in Python.
- domain-driven-design
- ddd
- eventsourcing
- cqrs
- event-sourcing
- distributed-systems
- +4 more
+2 stars
from 1,687 · score 1.10
31.mrpowers-io / quinn
pyspark methods to enhance developer productivity 📣 👯 🎉
+2 stars
from 688 · score 1.10
32.empicano / aiomqtt
The idiomatic asyncio MQTT client
- mqtt
- internet-of-things
- iot
- python
- pubsub
- mqtt5
- +5 more
+2 stars
from 578 · score 1.10
33.vaexio / vaex
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
- dataframe
- python
- bigdata
- tabular-data
- visualization
- memory-mapped-file
- +5 more
+1 stars
from 8,517 · score 0.69
34.mher / flower
Real-time monitor and web admin for Celery distributed task queue
- celery
- task-queue
- monitoring
- administration
- workers
- rabbitmq
- +3 more
+1 stars
from 7,239 · score 0.69
35.nteract / papermill
📚 Parameterize, execute, and analyze notebooks
+1 stars
from 6,497 · score 0.69
36.pydoit / doit
CLI task management & automation tool
- python
- build-tool
- build-automation
- task-runner
- build-system
- workflow-management
- +6 more
+1 stars
from 2,095 · score 0.69
37.jupyter-incubator / sparkmagic
Jupyter magics and kernels for working with remote Spark clusters
+1 stars
from 1,368 · score 0.69
38.MrPowers / chispa
PySpark test helper methods with beautiful error messages
+1 stars
from 777 · score 0.69
39.eventum-generator / eventum
Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk
- clickhouse
- data-engineering
- data-generation
- devops
- elasticsearch
- fake-data
- +12 more
+1 stars
from 70 · score 0.69
40.rbmuller / scherlok
A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.
- anomaly-detection
- bigquery
- cli
- data-engineering
- data-observability
- data-quality
- +14 more
+1 stars
from 11 · score 0.69
41.dataspoclab / dataspoc-pipe
Data ingestion engine — Singer taps to Parquet in cloud buckets
- data
- data-engineering
- data-lake
- duckdb
- etl
- parquet
- +3 more
+1 stars
from 3 · score 0.69