Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
99,825 visible repositories in the index
1–21 of 21 · Most stars
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
Flower: A Friendly Federated AI Framework
- flower
- federated-learning
- federated-learning-framework
- federated-analytics
A Neural Net Training Interface on TensorFlow, with focus on speed + flexibility
Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
The central nervous system and backend orchestrator for Fractal. It handles multi-tenant task scheduling, real-time TFLOPs budgeting, and federated weight aggregation using FedAvg.
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
Open-source framework for the research and development of foundation models.
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
- federated-learning
- deep-learning
- distributed-training
- edge-ai
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
- tensorflow
- spark
- yahoo
- machine-learning
Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods
- deep-learning
- machine-learning
- nvidia-gpu
- physics
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
- deep-learning
- machine-learning
- ml-platform
- ml-infrastructure
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
- deep-learning
- flax
- jax
- language-model
An open-source framework for machine learning and other computations on decentralized data.
HRM-Text is a 1B text generation model based on the HRM architecture, strengthened by task completion and latent space reasoning.
- large-language-models
- pretraining
- hierarchical-reasoning-model
- hrm
Distributed AI Model Training and LLM Fine-Tuning on Kubernetes
AI on Hadoop
- hadoop
- tensorflow
- caffe
- mxnet
A fully open source framework for creating RL training swarms over the internet.
A fast communication-overlapping library for tensor/expert parallelism on GPUs.
A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).
- agentic-rl
- expert-parallelism
- fsdp
- llm