《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Repository Index
47,133 repositories indexed
1–9 of 9 · Most stars
Official Inference Code of EAGLE-4
A blazingly fast programmatic video engine, made for agents.
🧱 Experimental library for building inference engines
A small, fast code editor written in Go, with a native GPU-drawn UI (no webview, no Electron)
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
Feel how fast a local LLM runs before you buy the hardware
A Go-first, GPU-native desktop framework. No WebView, no bundled runtime.