1.vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
+3,124 stars
from 92,954 · score 8.05
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
13 repositories by Attention Score · Oct 4, 2026 – Nov 2, 2026 (UTC)
2.jamiepine / voicebox
The open-source AI voice studio. Clone, dictate, create.
+3,097 stars
from 56,113 · score 8.04
3.sgl-project / sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
+1,692 stars
from 36,656 · score 7.43
4.syv-ai / HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
+662 stars
from 1,812 · score 6.50
5.TrenTorch / TrenTorch
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
+432 stars
from 332 · score 6.07
6.LMCache / LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
+335 stars
from 11,921 · score 5.82
7.datawhalechina / zero-to-sglang
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
+321 stars
from 1,354 · score 5.77
8.NVIDIA / TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
+252 stars
from 14,735 · score 5.53
9.roflcoopter / viseron
Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.
+121 stars
from 3,554 · score 4.80
10.cupy / cupy
NumPy & SciPy for GPU
+44 stars
from 12,346 · score 3.81
11.numba / numba
NumPy aware dynamic Python compiler using LLVM
+42 stars
from 11,154 · score 3.76
12.NVIDIA / cuml
NVIDIA cuML: GPU-Accelerated Machine Learning
+21 stars
from 5,295 · score 3.09
13.NVIDIAGameWorks / kaolin
A PyTorch Library for Accelerating 3D Deep Learning Research
+11 stars
from 5,179 · score 2.48