Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Repository Index
56,638 visible repositories in the index
1–9 of 9 · Most stars
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
Python package built to ease deep learning on graph, on top of existing DL frameworks.
- deep-learning
- graph-neural-networks
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
- model
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
- deepspeed-library
- gpt-3
- transformers
- language-model
A Next-Generation Training Engine Built for Ultra-Large MoE Models
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
- deep-learning
- machine-learning
- ml-platform
- ml-infrastructure