1.SYSTRAN / faster-whisper
Faster Whisper transcription with CTranslate2
+724 stars
from 25,650 · score 6.59
Ranked by Attention Score: stars gained over the last 30 complete days
6 repositories by Attention Score · Oct 4, 2026 – Nov 2, 2026 (UTC)
Faster Whisper transcription with CTranslate2
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Dataflow compiler for QNN inference on FPGAs
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
QKeras: a quantization deep learning library for Tensorflow Keras