1.jamiepine / voicebox
The open-source AI voice studio. Clone, dictate, create.
+677 stars
from 58,533 · score 6.52
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
16 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
2.vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
+593 stars
from 95,485 · score 6.39
3.syv-ai / HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
+243 stars
from 2,231 · score 5.50
4.sgl-project / sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
+192 stars
from 38,156 · score 5.26
5.StartLuxLabs / StartLux-Prism
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
+154 stars
from 74 · score 5.04
6.ekzhang / resin
🧱 Experimental library for building inference engines
+132 stars
from 230 · score 4.89
7.alexturkey / voxcpm2-turkce-ses-tasarimi
Turkish voice design with VoxCPM2 on a 4 GB GPU: describe a voice, pick a variant, read text in 30 languages. Patched audio.cpp, local UI in 30 languages, 14 ready-made voices.
+119 stars
from 255 · score 4.79
8.LMCache / LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
+92 stars
from 12,164 · score 4.53
9.kanaworksai-hue / audio-studio-mcp
Local AI BGM and sound effects for Claude Code and any MCP client. Stable Audio 3 on Apple Silicon (MLX) and Windows NVIDIA GPUs (PyTorch). No cloud, no API key.
+68 stars
from 491 · score 4.23
10.datawhalechina / zero-to-sglang
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
+59 stars
from 1,616 · score 4.09
11.TrenTorch / TrenTorch
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
+51 stars
from 713 · score 3.95
12.NVIDIA / TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
+42 stars
from 14,945 · score 3.76
13.roflcoopter / viseron
Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.
+15 stars
from 3,660 · score 2.77
14.cupy / cupy
NumPy & SciPy for GPU
+10 stars
from 12,380 · score 2.40
15.numba / numba
NumPy aware dynamic Python compiler using LLVM
+9 stars
from 11,187 · score 2.30
16.NVIDIA / cuml
NVIDIA cuML: GPU-Accelerated Machine Learning
+7 stars
from 5,309 · score 2.08