Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
47,133 repositories indexed
1–10 of 10 · Most stars
Distribute and run LLMs with a single file.
Faster Whisper transcription with CTranslate2
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
Real-time, local speech-to-text with streaming ASR, speaker diarization, translation, and OpenAI/Deepgram-compatible APIs.
TranslatedA Windows local AI Agent Studio for Douyin live-streaming e-commerce, connecting streamer discovery, live stream insights, live stream review, and short-video content directing into one unified intelligent workflow.
Code and Pretrained Models for Interspeech 2023 Paper "Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong Audio Event Taggers"
TranslatedMeetDo — open-source Meeting-to-Action AI by 筑听 (Zhuting, "build listen") · JKinco Listen. Self-hosted live meetings, local ASR/LLM, structured minutes, DOCX/PDF.
OpenScribe is an open-source AI scribe that records patient encounters and generates structured clinical notes automatically. You keep full control over data, workflows, and patient privacy with no vendor lock-in.
Lightweight on-device keyword spotting engine for iOS using CoreML and real-time audio streaming.