🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
Repository Index
103,113 visible repositories in the index
1–3 of 3 · Most stars
Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training
DLRover: An Automatic Distributed Deep Learning System
- distributed-training
- k8s
- llm-training
- hacktoberfest