🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
Repository Index
93,846 visible repositories in the index
1–4 of 4 · Most stars
Training LLMs with QLoRA + FSDP
A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).
- agentic-rl
- expert-parallelism
- fsdp
- llm
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
- eagle
- eagle3
- pytorch
- sglang