SGLang is a high-performance serving framework for large language models and multimodal models.
Repository Index
47,133 repositories indexed
1–4 of 4 · Most stars
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Build, Manage and Deploy AI/ML Systems
- machine-learning
- model-management
- ai
- ml