1.apache / superset
Apache Superset is a Data Visualization and Data Exploration Platform
- superset
- apache
- apache-superset
- data-visualization
- data-viz
- analytics
- +12 more
+3,149 stars
from 72,238 · score 8.06
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
74 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
2.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+3,037 stars
from 25,581 · score 8.02
3.marimo-team / marimo
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
- notebooks
- python
- data-science
- machine-learning
- artificial-intelligence
- data-visualization
- +7 more
+2,778 stars
from 20,619 · score 7.93
4.apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
+2,317 stars
from 45,026 · score 7.75
5.PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
- python
- workflow
- data-engineering
- data-science
- workflow-engine
- prefect
- +8 more
+1,955 stars
from 22,150 · score 7.58
6.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
+1,213 stars
from 21,082 · score 7.10
7.dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
- data-pipelines
- dagster
- workflow
- data-science
- workflow-automation
- python
- +9 more
+1,030 stars
from 15,331 · score 6.94
8.pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
+854 stars
from 61,173 · score 6.75
9.dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
- data-loading
- data-warehouse
- +4 more
+782 stars
from 5,263 · score 6.66
10.tobymao / sqlglot
Python SQL Parser and Transpiler
- transpiler
- sql
- python
- parser
- optimizer
- bigquery
- +14 more
+582 stars
from 9,161 · score 6.37
11.andkret / Cookbook
The Data Engineering Cookbook
- data-engineer
- data-engineering
- big-data
- best-practices
- cookbook
+524 stars
from 15,000 · score 6.26
12.fivetran / great_expectations
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
- data-science
- data-profiling
- +14 more
+516 stars
from 11,396 · score 6.25
13.donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
- python
- machine-learning
- deep-learning
- data-science
- big-data
- aws
- +13 more
+472 stars
from 28,914 · score 6.16
14.Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
+457 stars
from 18,996 · score 6.13
15.xonsh / xonsh
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
- xonsh
- devops
- iterm2
- data-engineering
- security-automation
- raspberry-pi
- +13 more
+425 stars
from 9,259 · score 6.05
16.feast-dev / feast
The Open Source Feature Store for AI/ML
- machine-learning
- features
- ml
- big-data
- feature-store
- python
- +4 more
+385 stars
from 6,967 · score 5.96
17.online-ml / river
🌊 Online machine learning in Python
- incremental-learning
- machine-learning
- python
- online-learning
- online-statistics
- data-science
- +6 more
+360 stars
from 5,781 · score 5.89
18.ag2ai / faststream
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
- asyncio
- kafka
- python
- rabbitmq
- asyncapi
- distributed-systems
- +7 more
+280 stars
from 5,111 · score 5.64
19.meltano / meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
- dataops
- dataops-platform
- elt
- open-source
- opensource
- data
- +14 more
+208 stars
from 2,466 · score 5.34
20.ibis-project / ibis
the portable Python dataframe library
- python
- impala
- pandas
- database
- clickhouse
- postgresql
- +12 more
+190 stars
from 6,498 · score 5.25
+165 stars
from 5,893 · score 5.11
22.narwhals-dev / narwhals
Lightweight and extensible compatibility layer between dataframe libraries!
+145 stars
from 1,600 · score 4.98
23.spotify / luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
- python
- luigi
- orchestration-framework
- scheduling
- hadoop
+140 stars
from 18,642 · score 4.95
24.jina-ai / serve
☁️ Build multimodal AI applications with cloud-native stack
- neural-search
- cloud-native
- deep-learning
- machine-learning
- framework
- grpc
- +14 more
+118 stars
from 21,732 · score 4.78
25.mher / flower
Real-time monitor and web admin for Celery distributed task queue
- celery
- task-queue
- monitoring
- administration
- workers
- rabbitmq
- +3 more
+109 stars
from 7,131 · score 4.70
26.bytewax / bytewax
Python Stream Processing
- python
- stream-processing
- rust
- data-engineering
- data-processing
- data-science
- +3 more
+91 stars
from 1,979 · score 4.52
27.mahmoud / boltons
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
- python
- utilities
- cache
- data-structures
- statistics
- data-science
- +5 more
+87 stars
from 6,857 · score 4.48
28.nteract / papermill
📚 Parameterize, execute, and analyze notebooks
+81 stars
from 6,417 · score 4.41
29.twisted / twisted
Event-driven networking engine written in Python.
- python
- twisted
- async
- async-python
- network
- event-driven
- +8 more
+69 stars
from 5,930 · score 4.25
+61 stars
from 1,209 · score 4.13
31.GaiZhenbiao / ChuanhuChatGPT
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
- chatbot
- chatgpt-api
- chatglm
- claude
- dalle3
- ernie
- +11 more
+59 stars
from 15,194 · score 4.09
32.pydoit / doit
CLI task management & automation tool
- python
- build-tool
- build-automation
- task-runner
- build-system
- workflow-management
- +6 more
+56 stars
from 2,040 · score 4.04
33.celery / kombu
Messaging library for Python.
- celery
- messaging
- python
- message-queue
- kombu
- python-library
- +5 more
+51 stars
from 3,100 · score 3.95
34.pyeventsourcing / eventsourcing
A library for event sourcing in Python.
- domain-driven-design
- ddd
- eventsourcing
- cqrs
- event-sourcing
- distributed-systems
- +4 more
+46 stars
from 1,643 · score 3.85
35.vaexio / vaex
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
- dataframe
- python
- bigdata
- tabular-data
- visualization
- memory-mapped-file
- +5 more
+45 stars
from 8,473 · score 3.83
36.quixio / quix-streams
Python Streaming DataFrames for Kafka
+44 stars
from 1,539 · score 3.81
37.horovod / horovodArchived
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
- tensorflow
- uber
- machine-learning
- machinelearning
- mpi
- baidu
- +7 more
+42 stars
from 14,632 · score 3.76
38.aws / aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
- python
- aws
- pandas
- apache-arrow
- apache-parquet
- data-engineering
- +14 more
+32 stars
from 4,090 · score 3.50
39.capitalone / datacompy
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
- python
- pandas
- spark
- data
- data-science
- compare
- +8 more
+32 stars
from 632 · score 3.50
40.Aiven-Open / karapace
Karapace - Your Apache Kafka® essentials in one tool
- kafka
- schema-registry
- rest-proxy
+32 stars
from 609 · score 3.50
41.piskvorky / smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
+30 stars
from 3,438 · score 3.43
+29 stars
from 1,376 · score 3.40
43.eventum-generator / eventum
Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk
- clickhouse
- data-engineering
- data-generation
- devops
- elasticsearch
- fake-data
- +12 more
+29 stars
from 42 · score 3.40
44.faust-streaming / faust
Python Stream Processing. A Faust fork
- asyncio
- python-streaming
- kafka
- redis
- distributed-systems
+27 stars
from 1,863 · score 3.33
45.pyjanitor-devs / pyjanitor
Clean APIs for data cleaning. Python implementation of R package Janitor
- pandas
- dataframe
- data
- cleaning-data
- data-engineering
- pydata
- +1 more
+25 stars
from 1,473 · score 3.26
46.datafold / data-diffArchived
Compare tables within or across databases
- database
- mysql
- postgresql
- snowflake
- rdbms
- trino
- +14 more
+24 stars
from 2,966 · score 3.22
47.elyra-ai / elyra
Elyra extends JupyterLab with an AI centric approach.
- notebooks
- notebook-jupyter
- jupyterlab
- jupyterlab-extensions
- ai
- machine-learning
- +14 more
+24 stars
from 1,980 · score 3.22
48.empicano / aiomqtt
The idiomatic asyncio MQTT client
- mqtt
- internet-of-things
- iot
- python
- pubsub
- mqtt5
- +5 more
+24 stars
from 556 · score 3.22
49.robinhood / faust
Python Stream Processing
- kafka-streams
- kafka
- python
- asyncio
- distributed-systems
- stream-processing
+19 stars
from 6,804 · score 3.00
50.MrPowers / chispa
PySpark test helper methods with beautiful error messages
+19 stars
from 759 · score 3.00
51.drt-hub / drt
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
- duckdb
- etl
- +14 more
+17 stars
from 19 · score 2.89
52.crossbario / autobahn-python
WebSocket and WAMP in Python for Twisted and asyncio
+14 stars
from 2,525 · score 2.71
53.databricks / koalas
Koalas: pandas API on Apache Spark
+13 stars
from 3,358 · score 2.64
54.mara / mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
- etl
- data-integration
- python
- postgresql
- pipeline
- data
+13 stars
from 2,078 · score 2.64
55.AxeldeRomblay / MLBox
MLBox is a powerful Automated Machine Learning python library.
- machine-learning
- auto-ml
- kaggle
- deep-learning
- stacking
- pipeline
- +14 more
+13 stars
from 1,521 · score 2.64
56.ploomber / ploomberArchived
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
- workflow
- machine-learning
- data-science
- data-engineering
- mlops
- papermill
- +6 more
+12 stars
from 3,609 · score 2.56
+11 stars
from 1,295 · score 2.48
58.AgnostiqHQ / covalent
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
- hpc
- workflow
- workflow-automation
- workflow-management
- quantum-computing
- hpc-applications
- +14 more
+11 stars
from 857 · score 2.48
59.jupyter-incubator / sparkmagic
Jupyter magics and kernels for working with remote Spark clusters
+10 stars
from 1,359 · score 2.40
60.HALFpipe / HALFpipe
ENIGMA HALFpipe is a user-friendly software that facilitates reproducible analysis of fMRI data
- neuroimaging
- reproducibility
- pipeline
- meta-analysis
- bids
- fmri
+10 stars
from 121 · score 2.40
61.1kbgz / tributary
Streaming reactive and dataflow graphs in Python
- python
- python3
- stream
- data-pipeline
- streaming
- asynchronous
- +5 more
+9 stars
from 458 · score 2.30
62.yahoo / TensorFlowOnSpark
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
- tensorflow
- spark
- yahoo
- machine-learning
- cluster
- featured
- +2 more
+8 stars
from 3,840 · score 2.20
63.crossbario / crossbar
Crossbar.io - WAMP application router
+7 stars
from 2,054 · score 2.08
64.provero-org / provero
Declarative data quality engine. Define checks in YAML, run anywhere.
- airflow
- anomaly-detection
- data-contracts
- data-quality
- data-testing
- duckdb
- +6 more
+6 stars
from 11 · score 1.95
65.mrpowers-io / quinn
pyspark methods to enhance developer productivity 📣 👯 🎉
+5 stars
from 685 · score 1.79
66.dbcli / athenacli
AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.
- aws-cli
- athena-cli
- aws-athena
- python
- bigdata
- syntax-highlighting
- +3 more
+5 stars
from 223 · score 1.79
67.mgillr / crdt-merge
Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.
- collaborative-editing
- conflict-resolution
- crdt
- data-engineering
- data-synchronization
- distributed-systems
- +14 more
+5 stars
from 2 · score 1.79
68.polyaxon / traceml
Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
- pandas
- pandas-summary
- dataframes
- data-science
- spark
- dask
- +14 more
+4 stars
from 529 · score 1.61
69.lensacom / sparkit-learn
PySpark + Scikit-learn = Sparkit-learn
+3 stars
from 1,147 · score 1.39
70.grai-io / grai-core
No description provided by the repository host.
- hacktoberfest
- data
- datalineage
- dbt
- open-source
- postgresql
- +11 more
+3 stars
from 314 · score 1.39
71.godalida / koala-diff
Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.
- csv
- data-engineering
- data-quality
- diff
- high-performance
- parquet
- +4 more
+3 stars
from 6 · score 1.39
72.dataspoclab / dataspoc-pipe
Data ingestion engine — Singer taps to Parquet in cloud buckets
- data
- data-engineering
- data-lake
- duckdb
- etl
- parquet
- +3 more
+3 stars
from 1 · score 1.39
73.maxpumperla / elephas
Distributed Deep learning with Keras & Spark
+1 stars
from 1,573 · score 0.69
74.LaunchPlatform / bq
BeanQueue, a lightweight Python task queue framework based on SQLAlchemy, PostgreSQL SKIP LOCKED queries and NOTIFY / LISTEN statements.
- postgresql
- python
- queue
- sqlalchemy
- worker
- task-queue
+1 stars
from 27 · score 0.69