LLM inference in C/C++
- ggml
47,133 repositories indexed
1–4 of 4 · Most stars
LLM inference in C/C++
Port of OpenAI's Whisper model in C/C++
Tensor library for machine learning
Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.