DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Repository Index
47,133 repositories indexed
1–5 of 5 · Most stars
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Official Inference Code of EAGLE-4
🧱 Experimental library for building inference engines