1.vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
+3,124 stars
from 92,954 · score 8.05
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
17 repositories by Attention Score · Oct 4, 2026 – Nov 2, 2026 (UTC)
2.FlashML-org / FreeVideo
Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.
+2,138 stars
from 435 · score 7.67
3.sgl-project / sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
+1,692 stars
from 36,656 · score 7.43
4.StartLuxLabs / StartLux-Decision
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
+1,573 stars
from 59 · score 7.36
5.SYSTRAN / faster-whisper
Faster Whisper transcription with CTranslate2
+724 stars
from 25,650 · score 6.59
6.GeeeekExplorer / nano-vllm
Nano vLLM
+592 stars
from 15,661 · score 6.39
7.stas00 / ml-engineering
Machine Learning Engineering Open Book
+575 stars
from 19,069 · score 6.36
8.TrenTorch / TrenTorch
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
+432 stars
from 332 · score 6.07
9.Human-Agent-Society / reef
Infrastructure for continually self‑improving agents
+384 stars
from 7,402 · score 5.95
10.LMCache / LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
+335 stars
from 11,921 · score 5.82
11.ultralytics / yolov5
Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.
+204 stars
from 58,043 · score 5.32
12.deepspeedai / DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
+152 stars
from 43,129 · score 5.03
13.triton-inference-server / server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
+89 stars
from 11,033 · score 4.50
14.hpcaitech / ColossalAI
Making large AI models cheaper, faster and more accessible
+32 stars
from 41,401 · score 3.50
15.ultralytics / yolov3
PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.
+21 stars
from 10,610 · score 3.09
16.superduper-io / superduper
Superduper: End-to-end framework for building custom AI applications and agents.
+8 stars
from 5,320 · score 2.20
17.huggingface / text-generation-inferenceArchived
Large Language Model Text Generation Inference
+7 stars
from 10,875 · score 2.08