1.vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Ranked by Attention Score: stars gained over the last 7 complete days
13 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
A high-throughput and memory-efficient inference and serving engine for LLMs
Kill shader compilation stutter before you play. Compiles your games' shaders into the GPU driver's cache ahead of time. Windows, NVIDIA and AMD.
Low-latency local speech-to-speech voice assistant with Ming-3.0-audio-tiny on AMD and Nvidia GPUs. Easy setup on Windows and Linux
Lightweight Armoury Crate alternative for Asus laptops with nearly the same functionality. Works with ROG Zephyrus, Flow, TUF, Strix, Scar, ProArt, Vivobook, Zenbook, Expertbook, ROG Ally, and more.
The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B Q4_K_XL: 656.33pp, 70.56tg tok/s single user with DFlash2
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
SuperMimic-UniLab: An Independent reproduction of SuperMimic on UniLab for whole-body humanoid motion tracking.
GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm
A bundler for javascript and friends. Packs many modules into a few bundled assets. Code Splitting allows for loading parts of the application on demand. Through "loaders", modules can be CommonJs, AMD, ES6 modules, CSS, Images, JSON, Coffeescript, LESS, ... and your custom stuff.
Create graphs from your CommonJS, AMD or ES6 module dependencies
Awesome Vulkan ecosystem
ILGPU JIT Compiler for high-performance .Net GPU programs
Awesome D3D12 ecosystem