DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
SGLang is a high-performance serving framework for large language models and multimodal models.
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.