Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
109,091 visible repositories in the index
1–24 of 40 · Most stars
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
TranslatedPArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (Core framework of 'PaddlePaddle' (飞桨, Feijiang), for deep learning & machine learning: high-performance single-machine and distributed training, and cross-platform deployment)
- paddlepaddle
- deep-learning
- scalability
- machine-learning
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Python package built to ease deep learning on graph, on top of existing DL frameworks.
- deep-learning
- graph-neural-networks
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.
Flower: A Friendly Federated AI Framework
- flower
- federated-learning
- federated-learning-framework
- federated-analytics
A Flexible and Powerful Parameter Server for large-scale machine learning
- machine-learning
- parameter-server
- spark
- scala
A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility
A unified ecosystem and workspace for large-scale federated learning, bridging the gap between centralized model evolution and decentralized edge intelligence.
PyTorch native post-training library
Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL
Translatedcube studio is an open-source, cloud-native, one-stop machine learning / deep learning / large model AI platform. It covers the full mlops algorithm pipeline, a computing power rental platform, online notebook development, drag-and-drop task flow pipeline orchestration, multi-machine multi-GPU distributed training, hyperparameter search, inference services with VGPU virtualization, edge computing, a labeling platform with automated labeling, SFT fine-tuning / reward model / reinforcement learning training for large models such as deepseek, multi-machine large model inference with vllm/ollama/mindie, a private knowledge base, and an AI model marketplace. It supports domestic Chinese CPUs/GPUs/NPUs and the Ascend ecosystem, supports RDMA, and supports distributed frameworks such as pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano.
The central nervous system and backend orchestrator for Fractal. It handles multi-tenant task scheduling, real-time TFLOPs budgeting, and federated weight aggregation using FedAvg.
Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods
- deep-learning
- machine-learning
- nvidia-gpu
- physics
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
- deep-learning
- machine-learning
- ml-platform
- ml-infrastructure
A distributed graph deep learning framework.
- graph
- graph-learning
- network-embedding
- deep-learning
Make huge neural nets fit in memory
cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务,VGPU虚拟化,云边端协同,边缘计算,自动化标注平台,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库llmops智能体,AI模型市场,支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等,支持ib/roce/RDMA,信创支持