Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Repository Index
47,133 repositories indexed
1–17 of 17 · Most stars
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
☁️ Build multimodal AI applications with cloud-native stack
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
Elyra extends JupyterLab with an AI centric approach.
A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.
Python Streaming DataFrames for Kafka
MLBox is a powerful Automated Machine Learning python library.
Extra blocks for scikit-learn pipelines.
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.
BatchFlow helps you conveniently work with random or sequential batches of your data and define data processing and machine learning workflows even for datasets that do not fit into memory.
Build and deploy a serverless data pipeline on AWS with no effort.
A Multilingual Latent Dirichlet Allocation (LDA) Pipeline with Stop Words Removal, n-gram features, and Inverse Stemming, in Python.