1.vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
+17,617 stars
from 78,461 · score 9.78
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
6 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
2.ray-project / ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
+2,008 stars
from 42,166 · score 7.61
3.NVIDIA / TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
+1,547 stars
from 13,440 · score 7.34
4.skypilot-org / skypilot
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
+907 stars
from 9,870 · score 6.81
5.bentoml / OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
+337 stars
from 12,238 · score 5.82
6.superduper-io / superduper
Superduper: End-to-end framework for building custom AI applications and agents.
+77 stars
from 5,251 · score 4.36