Repository Index

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

• ray
• distributed
• parallel
• machine-learning

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

• deep-learning
• pytorch
• gpu
• machine-learning

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

• python
• deep-learning
• artificial-intelligence
• ai

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

• deep-learning
• onnx
• neural-networks
• machine-learning

Ongoing research training transformer models at scale

• large-language-models
• model-para
• transformers

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

• nlp
• embedding
• bert
• ernie

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

• transformers
• vllm
• large-language-models
• raylib

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

A unified ecosystem and workspace for large-scale federated learning of Large Models & LLMS. Store compute as Wifi

• compute-orchestration
• distributed-systems
• edge-computing
• edge-intelligence

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

Flower: A Friendly Federated AI Framework

• flower
• federated-learning
• federated-learning-framework
• federated-analytics

A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility

• tensorflow
• deep-learning
• reinforcement-learning
• neural-networks

A PyTorch native platform for training generative AI models

PyTorch native post-training library

Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL

A Next-Generation Training Engine Built for Ultra-Large MoE Models

• llm
• agent
• deepseek-v3
• gpt-oss

EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL

• ai
• gpt
• llm
• nlp

Translatedcube studio is an open-source, cloud-native, one-stop machine learning / deep learning / large model AI platform. It covers the full mlops algorithm pipeline, a computing power rental platform, online notebook development, drag-and-drop task flow pipeline orchestration, multi-machine multi-GPU distributed training, hyperparameter search, inference services with VGPU virtualization, edge computing, a labeling platform with automated labeling, SFT fine-tuning / reward model / reinforcement learning training for large models such as deepseek, multi-machine large model inference with vllm/ollama/mindie, a private knowledge base, and an AI model marketplace. It supports domestic Chinese CPUs/GPUs/NPUs and the Ascend ecosystem, supports RDMA, and supports distributed frameworks such as pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano.

• kubernetes
• inference
• mlops
• workflow

The central nervous system and backend orchestrator for Fractal. It handles multi-tenant task scheduling, real-time TFLOPs budgeting, and federated weight aggregation using FedAvg.

• backend
• fedavg
• federated-learning
• flask

Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

• machine-learning
• pytorch
• reinforcement-learning

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

Massively Parallel Deep Reinforcement Learning. 🔥

• pytorch
• reinforcement-learning
• ppo
• sac

Open-source framework for the research and development of foundation models.