Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
132,241 visible repositories in the index
1–24 of 25 · Most stars
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.
Flower: A Friendly Federated AI Framework
- flower
- federated-learning
- federated-learning-framework
- federated-analytics
A Flexible and Powerful Parameter Server for large-scale machine learning
- machine-learning
- parameter-server
- spark
- scala
Model parallel transformers in JAX and Haiku
A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility
Translatedcube studio is an open-source, cloud-native, one-stop machine learning / deep learning / large model AI platform. It covers the full mlops algorithm pipeline, a computing power rental platform, online notebook development, drag-and-drop task flow pipeline orchestration, multi-machine multi-GPU distributed training, hyperparameter search, inference services with VGPU virtualization, edge computing, a labeling platform with automated labeling, SFT fine-tuning / reward model / reinforcement learning training for large models such as deepseek, multi-machine large model inference with vllm/ollama/mindie, a private knowledge base, and an AI model marketplace. It supports domestic Chinese CPUs/GPUs/NPUs and the Ascend ecosystem, supports RDMA, and supports distributed frameworks such as pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano.
The central nervous system and backend orchestrator for Fractal. It handles multi-tenant task scheduling, real-time TFLOPs budgeting, and federated weight aggregation using FedAvg.
FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
- tensorflow
- spark
- yahoo
- machine-learning
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
- deep-learning
- machine-learning
- ml-platform
- ml-infrastructure
cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务,VGPU虚拟化,云边端协同,边缘计算,自动化标注平台,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库llmops智能体,AI模型市场,支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等,支持ib/roce/RDMA,信创支持
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
- deep-learning
- flax
- jax
- language-model
An open-source framework for machine learning and other computations on decentralized data.
Distributed AI Model Training and LLM Fine-Tuning on Kubernetes
Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training
AI on Hadoop
- hadoop
- tensorflow
- caffe
- mxnet
Multimodal RL training framework for diffusion & omni models
- diffusion-models
- flow-matching
- grpo
- multimodal
A fast communication-overlapping library for tensor/expert parallelism on GPUs.
DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foundation.
- deep-learning
- machine-learning
- python
- scalability
SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
- pytorch
- transformer
- pretrained-models
🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
- llm
- vlm
- finetuning
- gemma3
Ring attention implementation with flash attention