1.bojieli / ai-infra-book
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
+250 stars
from 6,970 · score 5.53
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
13 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
2.ekzhang / resin
🧱 Experimental library for building inference engines
+132 stars
from 230 · score 4.89
3.eagle-hq / EAGLE-4
Official Inference Code of EAGLE-4
+114 stars
from 989 · score 4.74
4.skypilot-org / skypilot
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
+29 stars
from 10,748 · score 3.40
5.apache / tvm
Open Machine Learning Compiler Framework
+24 stars
from 13,862 · score 3.22
6.google / tf-quant-finance
High-performance TensorFlow library for quantitative finance.
+14 stars
from 5,542 · score 2.71
7.plasma-umass / scalene
Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals
+12 stars
from 13,530 · score 2.56
8.cupy / cupy
NumPy & SciPy for GPU
+10 stars
from 12,380 · score 2.40
9.triton-inference-server / server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
+10 stars
from 11,112 · score 2.40
10.deepspeedai / DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
+8 stars
from 43,273 · score 2.20
11.NVIDIA / cuml
NVIDIA cuML: GPU-Accelerated Machine Learning
+7 stars
from 5,309 · score 2.08
12.intel / ipex-llmArchived
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
+1 stars
from 8,844 · score 0.69
13.graphistry / pygraphistry
PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer
+1 stars
from 2,575 · score 0.69