1.hugues31 / duckpad
The data transformation tool the open-source community deserves.
Ranked by Attention Score: stars gained over the last 7 complete days
42 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
The data transformation tool the open-source community deserves.
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Apache Superset is a Data Visualization and Data Exploration Platform
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
An orchestration platform for the development, production, and observation of data assets.
Free Course : Data, Machine Learning, Deep Learning and AI Engineering, the long way round: the math, the code, the systems and the security. 173 lessons, 166 runnable labs, no shortcuts. Free under CC BY-NC 4.0.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Python SQL Parser and Transpiler
Python Stream Processing
Always know what to expect from your data.
the portable Python dataframe library
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
Turns Data and AI algorithms into production-ready web applications in no time.
The Data Engineering Cookbook
🌊 Online machine learning in Python
The Open Source Feature Store for AI/ML
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Elyra extends JupyterLab with an AI centric approach.
Lightweight and extensible compatibility layer between dataframe libraries!
🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library. Nothing like Michael Bolton.
Event-driven networking engine written in Python.
Python3 client for NATS
macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.
a little task queue for python
Python Streaming DataFrames for Kafka
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Utils for streaming large files (S3, HDFS, gzip, bz2...)
A library for event sourcing in Python.
pyspark methods to enhance developer productivity 📣 👯 🎉
The idiomatic asyncio MQTT client
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
Real-time monitor and web admin for Celery distributed task queue
📚 Parameterize, execute, and analyze notebooks
CLI task management & automation tool
Jupyter magics and kernels for working with remote Spark clusters
PySpark test helper methods with beautiful error messages
Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk
A detective for your data. Zero-config data quality monitoring — works with dbt, Postgres, BigQuery, Snowflake. No YAML.
Data ingestion engine — Singer taps to Parquet in cloud buckets