1.stepll2026 / OntiCards
OntiCards 是面向企业的 AI 数据中枢（AI Data Hub），围绕业务数据库提供一站式能力：数据源连接、元数据理解、自然语言查询、跨源融合、数据质检、查询审计与数据资产管理等
+478 stars
from 195 · score 6.17
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
65 repositories by Attention Score · Oct 4, 2026 – Nov 2, 2026 (UTC)
2.marimo-team / marimo
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
- notebooks
- python
- data-science
- machine-learning
- artificial-intelligence
- data-visualization
- +7 more
+427 stars
from 22,970 · score 6.06
3.apache / superset
Apache Superset is a Data Visualization and Data Exploration Platform
- superset
- apache
- apache-superset
- data-visualization
- data-viz
- analytics
- +12 more
+424 stars
from 74,963 · score 6.05
4.mlflow / mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- machine-learning
- ai
- ml
- mlflow
- apache-spark
- model-management
- +12 more
+409 stars
from 28,209 · score 6.02
5.apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
+346 stars
from 46,997 · score 5.85
6.PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
- python
- workflow
- data-engineering
- data-science
- workflow-engine
- prefect
- +8 more
+167 stars
from 23,938 · score 5.12
7.airbytehq / airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- data
- pipeline
- data-analysis
- data-engineering
- java
- python
- +14 more
+150 stars
from 22,145 · score 5.02
8.dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
- data-pipelines
- dagster
- workflow
- data-science
- workflow-automation
- python
- +9 more
+144 stars
from 16,217 · score 4.98
9.dlt-hub / dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
- data
- python
- data-engineering
- data-lake
- data-loading
- data-warehouse
- +4 more
+125 stars
from 5,920 · score 4.84
10.tobymao / sqlglot
Python SQL Parser and Transpiler
- transpiler
- sql
- python
- parser
- optimizer
- bigquery
- +14 more
+99 stars
from 9,644 · score 4.61
11.andkret / Cookbook
The Data Engineering Cookbook
- data-engineer
- data-engineering
- big-data
- best-practices
- cookbook
+76 stars
from 15,448 · score 4.34
12.fivetran / great_expectations
Always know what to expect from your data.
- pipeline-tests
- dataquality
- datacleaning
- datacleaner
- data-science
- data-profiling
- +14 more
+68 stars
from 11,844 · score 4.23
13.donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
- python
- machine-learning
- deep-learning
- data-science
- big-data
- aws
- +13 more
+46 stars
from 29,340 · score 3.85
14.feast-dev / feast
The Open Source Feature Store for AI/ML
- machine-learning
- features
- ml
- big-data
- feature-store
- python
- +4 more
+41 stars
from 7,311 · score 3.74
15.Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
+37 stars
from 19,416 · score 3.64
16.xonsh / xonsh
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
- xonsh
- devops
- iterm2
- data-engineering
- security-automation
- raspberry-pi
- +13 more
+37 stars
from 9,647 · score 3.64
17.ag2ai / faststream
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
- asyncio
- kafka
- python
- rabbitmq
- asyncapi
- distributed-systems
- +7 more
+34 stars
from 5,357 · score 3.56
18.online-ml / river
🌊 Online machine learning in Python
- incremental-learning
- machine-learning
- python
- online-learning
- online-statistics
- data-science
- +6 more
+33 stars
from 6,108 · score 3.53
19.meltano / meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
- dataops
- dataops-platform
- elt
- open-source
- opensource
- data
- +14 more
+29 stars
from 2,645 · score 3.40
20.ibis-project / ibis
the portable Python dataframe library
- python
- impala
- pandas
- database
- clickhouse
- postgresql
- +12 more
+26 stars
from 6,662 · score 3.30
21.narwhals-dev / narwhals
Lightweight and extensible compatibility layer between dataframe libraries!
+22 stars
from 1,723 · score 3.14
+20 stars
from 6,038 · score 3.04
23.mahmoud / boltons
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
- python
- utilities
- cache
- data-structures
- statistics
- data-science
- +5 more
+17 stars
from 6,927 · score 2.89
24.bytewax / bytewax
Python Stream Processing
- python
- stream-processing
- rust
- data-engineering
- data-processing
- data-science
- +3 more
+17 stars
from 2,053 · score 2.89
25.nteract / papermill
📚 Parameterize, execute, and analyze notebooks
+12 stars
from 6,486 · score 2.56
26.jina-ai / serve
☁️ Build multimodal AI applications with cloud-native stack
- neural-search
- cloud-native
- deep-learning
- machine-learning
- framework
- grpc
- +14 more
+10 stars
from 21,840 · score 2.40
+10 stars
from 1,260 · score 2.40
28.spotify / luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
- python
- luigi
- orchestration-framework
- scheduling
- hadoop
+9 stars
from 18,773 · score 2.30
29.twisted / twisted
Event-driven networking engine written in Python.
- python
- twisted
- async
- async-python
- network
- event-driven
- +8 more
+9 stars
from 5,990 · score 2.30
30.piskvorky / smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
+9 stars
from 3,459 · score 2.30
31.elyra-ai / elyra
Elyra extends JupyterLab with an AI centric approach.
- notebooks
- notebook-jupyter
- jupyterlab
- jupyterlab-extensions
- ai
- machine-learning
- +14 more
+9 stars
from 1,995 · score 2.30
32.mher / flower
Real-time monitor and web admin for Celery distributed task queue
- celery
- task-queue
- monitoring
- administration
- workers
- rabbitmq
- +3 more
+8 stars
from 7,232 · score 2.20
33.quixio / quix-streams
Python Streaming DataFrames for Kafka
+8 stars
from 1,575 · score 2.20
34.vaexio / vaex
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
- dataframe
- python
- bigdata
- tabular-data
- visualization
- memory-mapped-file
- +5 more
+7 stars
from 8,511 · score 2.08
35.pydoit / doit
CLI task management & automation tool
- python
- build-tool
- build-automation
- task-runner
- build-system
- workflow-management
- +6 more
+7 stars
from 2,089 · score 2.08
36.capitalone / datacompy
Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!
- python
- pandas
- spark
- data
- data-science
- compare
- +8 more
+7 stars
from 657 · score 2.08
37.Aiven-Open / karapace
Karapace - Your Apache Kafka® essentials in one tool
- kafka
- schema-registry
- rest-proxy
+6 stars
from 635 · score 1.95
38.celery / kombu
Messaging library for Python.
- celery
- messaging
- python
- message-queue
- kombu
- python-library
- +5 more
+5 stars
from 3,146 · score 1.79
39.empicano / aiomqtt
The idiomatic asyncio MQTT client
- mqtt
- internet-of-things
- iot
- python
- pubsub
- mqtt5
- +5 more
+5 stars
from 575 · score 1.79
40.robinhood / faust
Python Stream Processing
- kafka-streams
- kafka
- python
- asyncio
- distributed-systems
- stream-processing
+4 stars
from 6,819 · score 1.61
41.pyeventsourcing / eventsourcing
A library for event sourcing in Python.
- domain-driven-design
- ddd
- eventsourcing
- cqrs
- event-sourcing
- distributed-systems
- +4 more
+4 stars
from 1,685 · score 1.61
42.MrPowers / chispa
PySpark test helper methods with beautiful error messages
+4 stars
from 774 · score 1.61
43.aws / aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
- python
- aws
- pandas
- apache-arrow
- apache-parquet
- data-engineering
- +14 more
+3 stars
from 4,119 · score 1.39
44.ploomber / ploomberArchived
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
- workflow
- machine-learning
- data-science
- data-engineering
- mlops
- papermill
- +6 more
+3 stars
from 3,618 · score 1.39
45.faust-streaming / faust
Python Stream Processing. A Faust fork
- asyncio
- python-streaming
- kafka
- redis
- distributed-systems
+3 stars
from 1,887 · score 1.39
46.pyjanitor-devs / pyjanitor
Clean APIs for data cleaning. Python implementation of R package Janitor
- pandas
- dataframe
- data
- cleaning-data
- data-engineering
- pydata
- +1 more
+3 stars
from 1,495 · score 1.39
+3 stars
from 1,402 · score 1.39
48.horovod / horovodArchived
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
- tensorflow
- uber
- machine-learning
- machinelearning
- mpi
- baidu
- +7 more
+2 stars
from 14,672 · score 1.10
49.yahoo / TensorFlowOnSpark
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
- tensorflow
- spark
- yahoo
- machine-learning
- cluster
- featured
- +2 more
+2 stars
from 3,846 · score 1.10
50.datafold / data-diffArchived
Compare tables within or across databases
- database
- mysql
- postgresql
- snowflake
- rdbms
- trino
- +14 more
+2 stars
from 2,988 · score 1.10
51.mrpowers-io / quinn
pyspark methods to enhance developer productivity 📣 👯 🎉
+2 stars
from 688 · score 1.10
52.drt-hub / drt
Reverse ETL for the code-first data stack
- bigquery
- cli
- data-engineering
- dbt
- duckdb
- etl
- +14 more
+2 stars
from 34 · score 1.10
53.databricks / koalas
Koalas: pandas API on Apache Spark
+1 stars
from 3,370 · score 0.69
54.mara / mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
- etl
- data-integration
- python
- postgresql
- pipeline
- data
+1 stars
from 2,090 · score 0.69
55.hi-primus / optimus
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
- spark
- pyspark
- data-wrangling
- bigdata
- big-data-cleaning
- data-science
- +13 more
+1 stars
from 1,534 · score 0.69
56.jupyter-incubator / sparkmagic
Jupyter magics and kernels for working with remote Spark clusters
+1 stars
from 1,368 · score 0.69
+1 stars
from 1,305 · score 0.69
58.1kbgz / tributary
Streaming reactive and dataflow graphs in Python
- python
- python3
- stream
- data-pipeline
- streaming
- asynchronous
- +5 more
+1 stars
from 466 · score 0.69
+1 stars
from 314 · score 0.69
60.dbcli / athenacli
AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.
- aws-cli
- athena-cli
- aws-athena
- python
- bigdata
- syntax-highlighting
- +3 more
+1 stars
from 227 · score 0.69
61.seung-lab / cloud-volume
Read and write Neuroglancer datasets programmatically.
+1 stars
from 175 · score 0.69
62.eventum-generator / eventum
Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk
- clickhouse
- data-engineering
- data-generation
- devops
- elasticsearch
- fake-data
- +12 more
+1 stars
from 70 · score 0.69
63.rbmuller / scherlok
A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.
- anomaly-detection
- bigquery
- cli
- data-engineering
- data-observability
- data-quality
- +14 more
+1 stars
from 11 · score 0.69
64.dotflow-io / dotflow
🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines
+1 stars
from 9 · score 0.69
65.dataspoclab / dataspoc-pipe
Data ingestion engine — Singer taps to Parquet in cloud buckets
- data
- data-engineering
- data-lake
- duckdb
- etl
- parquet
- +3 more
+1 stars
from 3 · score 0.69