1.bojieli / ai-infra-book
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
+1,437 stars
from 5,783 · score 7.27
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
4 repositories by Attention Score · Oct 4, 2026 – Nov 2, 2026 (UTC)
2.syv-ai / HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
+662 stars
from 1,812 · score 6.50
3.LMCache / LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
+335 stars
from 11,921 · score 5.82
4.datawhalechina / zero-to-sglang
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
+321 stars
from 1,354 · score 5.77