Repository Index

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

• airflow
• apache
• apache-airflow
• python

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

• python
• workflow
• data-engineering
• data-science

Code for Machine Learning for Trading, 3rd edition — from data sourcing to live execution.

• machine-learning
• trading
• investment
• finance

Turns Data and AI algorithms into production-ready web applications in no time.

• automation
• data-engineering
• data-ops
• data-visualization

This open-source curriculum introduces the fundamentals of Model Context Protocol (MCP) through real-world, cross-language examples in .NET, Java, TypeScript, JavaScript, Rust and Python. Designed for developers, it focuses on practical techniques for building modular, scalable, and secure AI workflows from session setup to service orchestration.

• csharp
• java
• javascript
• mcp

Free MLOps course from DataTalks.Club. Register here 👇🏼 to get notified about the next cohort

• machine-learning
• mlops
• model-deployment
• model-monitoring

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

• kedro
• hacktoberfest
• mlops
• python

Modin: Scale your Pandas workflows by changing a single line of code

• dataframe
• pandas
• distributed
• datascience

Automate code & data workflows with interactive Elixir notebooks

• phoenix
• elixir
• notebooks
• collaborative

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

• mlops
• machine-learning
• data-science
• production-ready

AI Infra / AI Orchestration / AI Control Plane

• deep-learning
• machine-learning
• artificial-intelligence
• data-science

CLI task management & automation tool

• python
• build-tool
• build-automation
• task-runner

WFGY is heading toward WFGY 5.0 Polaris Protocol, a major open-source release for AI reasoning, RAG, agents, and real-world workflows. Includes Problem Map, Global Debug Card, WFGY 4.0, and the CFV Easter Egg.

• rag
• ai-agents
• alignment
• debugging

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

• spark
• pyspark
• data-wrangling
• bigdata

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

• hpc
• workflow
• workflow-automation
• workflow-management

Kaapana is an open source toolkit for state of the art platform provisioning in the field of medical data analysis. The applications comprise AI-based workflows and federated learning scenarios with a focus on radiological and radiotherapeutic imaging. The name Kaapana comes from the Hawaiian word kaʻāpana, meaning "distributor" or "part".

• imaging
• ai
• cloud-computing
• medical-imaging

BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.

• python3
• data-science
• machine-learning
• python

Centreon is a network, system and application monitoring tool. Centreon is the only AIOps Platform Providing Holistic Visibility to Complex IT Workflows from Cloud to Edge.

• alerting
• metrics
• monitoring
• analytics

A tool that supports one-button reproducible workflows with the Jupyter Notebook and Scons.

UV-first benchmark for protein-ligand docking with reproducible annotation, pocket similarity, and HPC workflows.

• benchmark
• bioinformatics
• cheminformatics
• computational-chemistry