SGLang is a high-performance serving framework for large language models and multimodal models.
Repository Index
47,133 repositories indexed
1–6 of 6 · Most stars
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Build, Manage and Deploy AI/ML Systems
A collection of libraries to optimise AI model performances
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Autonomous multi-agent framework to optimize scientific software