Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Repository Index
47,133 repositories indexed
1–16 of 16 · Most stars
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
☁️ Build multimodal AI applications with cloud-native stack
Turns Data and AI algorithms into production-ready web applications in no time.
Always know what to expect from your data.
📚 Parameterize, execute, and analyze notebooks
【A common used C++ & Python DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork & 交流
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
MLBox is a powerful Automated Machine Learning python library.
The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
ENIGMA HALFpipe is a user-friendly software that facilitates reproducible analysis of fMRI data
Build and deploy a serverless data pipeline on AWS with no effort.
🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines
Pipeline de ingestão e busca semântica de documentos para RAG — com rate limiting, circuit breaker e fila resiliente.