Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Repository Index
47,133 repositories indexed
1–13 of 13 · Most stars
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
An orchestration platform for the development, production, and observation of data assets.
Always know what to expect from your data.
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
CLI task management & automation tool
Python Streaming DataFrames for Kafka
MLBox is a powerful Automated Machine Learning python library.
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
Build, test, deploy, iterate - Dev and prod tool for data science pipelines