1.vllm-project / vllmA high-throughput and memory-efficient inference and serving engine for LLMsgptllmpytorchmodel-servingtransformerllm-serving+14 morePythonAPACHE-2.096K total24K forks+593 starsfrom 95,485 · score 6.39
2.JMS1717 / ming-voiceLow-latency local speech-to-speech voice assistant with Ming-3.0-audio-tiny on AMD and Nvidia GPUs. Easy setup on Windows and Linuxamdlocal-llmradeonrealtimerocmspeech-to-speech+3 morePythonMIT423 total25 forks+133 starsfrom 285 · score 4.90
3.LMCache / LMCacheLMCache: Supercharge Your LLM with the Fastest KV Cache Layeramdcudainferencekv-cachellmpytorch+4 morePythonAPACHE-2.012K total2.1K forks+92 starsfrom 12,164 · score 4.53
4.Motphys / Uni-SuperMimicSuperMimic-UniLab: An Independent reproduction of SuperMimic on UniLab for whole-body humanoid motion tracking.amdmotrixsimmujocorocmunilabmjwarp+4 morePythonAPACHE-2.0231 total19 forks+90 starsfrom 128 · score 4.51