Repository Index

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

• deep-learning
• pytorch
• gpu
• machine-learning

TranslatedPArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (Core framework of 'PaddlePaddle' (飞桨, Feijiang), for deep learning & machine learning: high-performance single-machine and distributed training, and cross-platform deployment)

• paddlepaddle
• deep-learning
• scalability
• machine-learning

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

• deep-learning
• onnx
• neural-networks
• machine-learning

Python package built to ease deep learning on graph, on top of existing DL frameworks.

• deep-learning
• graph-neural-networks

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

• deep-learning
• machine-learning
• deep-neural-networks
• ml

A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility

• tensorflow
• deep-learning
• reinforcement-learning
• neural-networks

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

• spark
• pyspark
• azure
• scala

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

Open-source framework for the research and development of foundation models.

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

• federated-learning
• deep-learning
• distributed-training
• edge-ai

TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

• tensorflow
• spark
• yahoo
• machine-learning

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

• deep-learning
• machine-learning
• nvidia-gpu
• physics

Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.

• deep-learning
• machine-learning
• ml-platform
• ml-infrastructure

A distributed graph deep learning framework.

• graph
• graph-learning
• network-embedding
• deep-learning

Make huge neural nets fit in memory

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

• deep-learning
• pytorch
• volunteer-computing
• mixture-of-experts

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

• deep-learning
• flax
• jax
• language-model

An open-source framework for machine learning and other computations on decentralized data.

Minimalistic 4D-parallelism distributed training framework for education purpose

HRM-Text is a 1B text generation model based on the HRM architecture, strengthened by task completion and latent space reasoning.

• large-language-models
• pretraining
• hierarchical-reasoning-model
• hrm

The first distributed AGI system. Thousands of autonomous AI agents collaboratively train models, share experiments via P2P gossip, and push breakthroughs here. Fully peer-to-peer. Join from your browser or CLI.

• agi
• ai-agents
• ai-research
• artificial-general-intelligence

Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training