1.apache / superset
Apache Superset is a Data Visualization and Data Exploration Platform
- superset
- apache
- apache-superset
- data-visualization
- data-viz
- analytics
- +12 more
+1,460 stars
from 73,927 · score 7.29
Trending repositories
Ranked by Attention Score: stars gained over the last 90 complete days
75 repositories by Attention Score · Aug 5, 2026 – Nov 2, 2026 (UTC)
2.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+1,343 stars
from 27,275 · score 7.20
3.marimo-team / marimo
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
- notebooks
- python
- data-science
- machine-learning
- artificial-intelligence
- data-visualization
- +7 more
+1,293 stars
from 22,104 · score 7.17
4.apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
+1,113 stars
from 46,230 · score 7.02
5.PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
- python
- workflow
- data-engineering
- data-science
- workflow-engine
- prefect
- +8 more
+637 stars
from 23,468 · score 6.46
6.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
+565 stars
from 21,730 · score 6.34
7.dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
- data-pipelines
- dagster
- workflow
- data-science
- workflow-automation
- python
- +9 more
+481 stars
from 15,880 · score 6.18
8.dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
- data-loading
- data-warehouse
- +4 more
+364 stars
from 5,681 · score 5.90
9.andkret / Cookbook
The Data Engineering Cookbook
- data-engineer
- data-engineering
- big-data
- best-practices
- cookbook
+362 stars
from 15,162 · score 5.89
10.tobymao / sqlglot
Python SQL Parser and Transpiler
- transpiler
- sql
- python
- parser
- optimizer
- bigquery
- +14 more
+273 stars
from 9,470 · score 5.61
11.online-ml / river
🌊 Online machine learning in Python
- incremental-learning
- machine-learning
- python
- online-learning
- online-statistics
- data-science
- +6 more
+255 stars
from 5,886 · score 5.55
12.fivetran / great_expectations
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
- data-science
- data-profiling
- +14 more
+248 stars
from 11,664 · score 5.52
13.pathwaycom / pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
+238 stars
from 61,789 · score 5.48
14.feast-dev / feast
The Open Source Feature Store for AI/ML
- machine-learning
- features
- ml
- big-data
- feature-store
- python
- +4 more
+180 stars
from 7,172 · score 5.20
15.Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
+169 stars
from 19,284 · score 5.14
16.donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
- python
- machine-learning
- deep-learning
- data-science
- big-data
- aws
- +13 more
+166 stars
from 29,220 · score 5.12
17.xonsh / xonsh
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
- xonsh
- devops
- iterm2
- data-engineering
- security-automation
- raspberry-pi
- +13 more
+128 stars
from 9,556 · score 4.86
18.ag2ai / faststream
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
- asyncio
- kafka
- python
- rabbitmq
- asyncapi
- distributed-systems
- +7 more
+109 stars
from 5,282 · score 4.70
19.meltano / meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
- dataops
- dataops-platform
- elt
- open-source
- opensource
- data
- +14 more
+98 stars
from 2,576 · score 4.60
20.ibis-project / ibis
the portable Python dataframe library
- python
- impala
- pandas
- database
- clickhouse
- postgresql
- +12 more
+84 stars
from 6,604 · score 4.44
+84 stars
from 5,974 · score 4.44
22.narwhals-dev / narwhals
Lightweight and extensible compatibility layer between dataframe libraries!
+57 stars
from 1,688 · score 4.06
23.spotify / luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
- python
- luigi
- orchestration-framework
- scheduling
- hadoop
+53 stars
from 18,729 · score 3.99
24.mahmoud / boltons
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
- python
- utilities
- cache
- data-structures
- statistics
- data-science
- +5 more
+50 stars
from 6,894 · score 3.93
25.jina-ai / serve
☁️ Build multimodal AI applications with cloud-native stack
- neural-search
- cloud-native
- deep-learning
- machine-learning
- framework
- grpc
- +14 more
+47 stars
from 21,803 · score 3.87
26.nteract / papermill
📚 Parameterize, execute, and analyze notebooks
+45 stars
from 6,453 · score 3.83
27.mher / flower
Real-time monitor and web admin for Celery distributed task queue
- celery
- task-queue
- monitoring
- administration
- workers
- rabbitmq
- +3 more
+43 stars
from 7,197 · score 3.78
28.twisted / twisted
Event-driven networking engine written in Python.
- python
- twisted
- async
- async-python
- network
- event-driven
- +8 more
+38 stars
from 5,961 · score 3.66
29.bytewax / bytewax
Python Stream Processing
- python
- stream-processing
- rust
- data-engineering
- data-processing
- data-science
- +3 more
+37 stars
from 2,033 · score 3.64
+32 stars
from 1,238 · score 3.50
31.celery / kombu
Messaging library for Python.
- celery
- messaging
- python
- message-queue
- kombu
- python-library
- +5 more
+25 stars
from 3,126 · score 3.26
32.eventum-generator / eventum
Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk
- clickhouse
- data-engineering
- data-generation
- devops
- elasticsearch
- fake-data
- +12 more
+25 stars
from 46 · score 3.26
33.GaiZhenbiao / ChuanhuChatGPT
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
- chatbot
- chatgpt-api
- chatglm
- claude
- dalle3
- ernie
- +11 more
+23 stars
from 15,230 · score 3.18
34.vaexio / vaex
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
- dataframe
- python
- bigdata
- tabular-data
- visualization
- memory-mapped-file
- +5 more
+21 stars
from 8,497 · score 3.09
35.pydoit / doit
CLI task management & automation tool
- python
- build-tool
- build-automation
- task-runner
- build-system
- workflow-management
- +6 more
+20 stars
from 2,076 · score 3.04
36.quixio / quix-streams
Python Streaming DataFrames for Kafka
+19 stars
from 1,564 · score 3.00
37.Aiven-Open / karapace
Karapace - Your Apache Kafka® essentials in one tool
- kafka
- schema-registry
- rest-proxy
+19 stars
from 622 · score 3.00
38.piskvorky / smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
+16 stars
from 3,452 · score 2.83
39.elyra-ai / elyra
Elyra extends JupyterLab with an AI centric approach.
- notebooks
- notebook-jupyter
- jupyterlab
- jupyterlab-extensions
- ai
- machine-learning
- +14 more
+15 stars
from 1,989 · score 2.77
40.aws / aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
- python
- aws
- pandas
- apache-arrow
- apache-parquet
- data-engineering
- +14 more
+14 stars
from 4,108 · score 2.71
41.pyeventsourcing / eventsourcing
A library for event sourcing in Python.
- domain-driven-design
- ddd
- eventsourcing
- cqrs
- event-sourcing
- distributed-systems
- +4 more
+14 stars
from 1,675 · score 2.71
+12 stars
from 1,393 · score 2.56
43.capitalone / datacompy
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
- python
- pandas
- spark
- data
- data-science
- compare
- +8 more
+12 stars
from 652 · score 2.56
44.datafold / data-diffArchived
Compare tables within or across databases
- database
- mysql
- postgresql
- snowflake
- rdbms
- trino
- +14 more
+11 stars
from 2,979 · score 2.48
45.faust-streaming / faust
Python Stream Processing. A Faust fork
- asyncio
- python-streaming
- kafka
- redis
- distributed-systems
+11 stars
from 1,879 · score 2.48
46.pyjanitor-devs / pyjanitor
Clean APIs for data cleaning. Python implementation of R package Janitor
- pandas
- dataframe
- data
- cleaning-data
- data-engineering
- pydata
- +1 more
+11 stars
from 1,487 · score 2.48
47.empicano / aiomqtt
The idiomatic asyncio MQTT client
- mqtt
- internet-of-things
- iot
- python
- pubsub
- mqtt5
- +5 more
+11 stars
from 569 · score 2.48
48.MrPowers / chispa
PySpark test helper methods with beautiful error messages
+9 stars
from 769 · score 2.30
49.drt-hub / drt
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
- duckdb
- etl
- +14 more
+9 stars
from 27 · score 2.30
50.horovod / horovodArchived
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
- tensorflow
- uber
- machine-learning
- machinelearning
- mpi
- baidu
- +7 more
+8 stars
from 14,666 · score 2.20
51.robinhood / faust
Python Stream Processing
- kafka-streams
- kafka
- python
- asyncio
- distributed-systems
- stream-processing
+7 stars
from 6,816 · score 2.08
52.ploomber / ploomberArchived
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
- workflow
- machine-learning
- data-science
- data-engineering
- mlops
- papermill
- +6 more
+6 stars
from 3,615 · score 1.95
53.crossbario / autobahn-python
WebSocket and WAMP in Python for Twisted and asyncio
+6 stars
from 2,533 · score 1.95
54.mara / mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
- etl
- data-integration
- python
- postgresql
- pipeline
- data
+6 stars
from 2,085 · score 1.95
55.rbmuller / scherlok
A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.
- anomaly-detection
- bigquery
- cli
- data-engineering
- data-observability
- data-quality
- +14 more
+6 stars
from 6 · score 1.95
56.yahoo / TensorFlowOnSpark
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
- tensorflow
- spark
- yahoo
- machine-learning
- cluster
- featured
- +2 more
+5 stars
from 3,843 · score 1.79
57.databricks / koalas
Koalas: pandas API on Apache Spark
+4 stars
from 3,367 · score 1.61
58.hi-primus / optimus
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
- spark
- pyspark
- data-wrangling
- bigdata
- big-data-cleaning
- data-science
- +13 more
+4 stars
from 1,531 · score 1.61
59.jupyter-incubator / sparkmagic
Jupyter magics and kernels for working with remote Spark clusters
+4 stars
from 1,365 · score 1.61
+4 stars
from 1,302 · score 1.61
61.mrpowers-io / quinn
pyspark methods to enhance developer productivity 📣 👯 🎉
+4 stars
from 686 · score 1.61
62.HALFpipe / HALFpipe
ENIGMA HALFpipe is a user-friendly software that facilitates reproducible analysis of fMRI data
- neuroimaging
- reproducibility
- pipeline
- meta-analysis
- bids
- fmri
+3 stars
from 128 · score 1.39
63.AxeldeRomblay / MLBox
MLBox is a powerful Automated Machine Learning python library.
- machine-learning
- auto-ml
- kaggle
- deep-learning
- stacking
- pipeline
- +14 more
+2 stars
from 1,532 · score 1.10
64.AgnostiqHQ / covalent
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
- hpc
- workflow
- workflow-automation
- workflow-management
- quantum-computing
- hpc-applications
- +14 more
+2 stars
from 866 · score 1.10
65.1kbgz / tributary
Streaming reactive and dataflow graphs in Python
- python
- python3
- stream
- data-pipeline
- streaming
- asynchronous
- +5 more
+2 stars
from 465 · score 1.10
66.grai-io / grai-core
No description provided by the repository host.
- hacktoberfest
- data
- datalineage
- dbt
- open-source
- postgresql
- +11 more
+2 stars
from 315 · score 1.10
+2 stars
from 313 · score 1.10
68.godalida / koala-diff
Blazingly fast data comparison tool for Python, powered by Rust. Compare massive CSV/Parquet datasets instantly.
- csv
- data-engineering
- data-quality
- diff
- high-performance
- parquet
- +4 more
+2 stars
from 7 · score 1.10
69.mgillr / crdt-merge
Conflict-free merge for DataFrames, JSON, ML models & distributed agents — powered by CRDTs. The first merge library where every operation is mathematically guaranteed to converge.
- collaborative-editing
- conflict-resolution
- crdt
- data-engineering
- data-synchronization
- distributed-systems
- +14 more
+2 stars
from 5 · score 1.10
70.dataspoclab / dataspoc-pipe
Data ingestion engine — Singer taps to Parquet in cloud buckets
- data
- data-engineering
- data-lake
- duckdb
- etl
- parquet
- +3 more
+2 stars
from 2 · score 1.10
71.crossbario / crossbar
Crossbar.io - WAMP application router
+1 stars
from 2,060 · score 0.69
72.lensacom / sparkit-learn
PySpark + Scikit-learn = Sparkit-learn
+1 stars
from 1,149 · score 0.69
73.dbcli / athenacli
AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.
- aws-cli
- athena-cli
- aws-athena
- python
- bigdata
- syntax-highlighting
- +3 more
+1 stars
from 227 · score 0.69
74.seung-lab / cloud-volume
Read and write Neuroglancer datasets programmatically.
+1 stars
from 175 · score 0.69
75.dotflow-io / dotflow
🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines
+1 stars
from 9 · score 0.69