Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
74,860 visible repositories in the index
1–13 of 13 · Most stars
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- nlp
- embedding
- bert
- ernie
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
- model
DeepEP: an efficient expert-parallel communication library
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
- deepspeed-library
- gpt-3
- transformers
- language-model
PyTorch native post-training library
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
- federated-learning
- deep-learning
- distributed-training
- edge-ai
Scenic: A Jax Library for Computer Vision Research and Beyond
An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
- agentic
- rlhf
- rlvr
An Extensible Deep Learning Library
Framework and Library for Distributed Online Machine Learning
- machine-learning
- c-plus-plus
- ml
- distributed