Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
94,845 visible repositories in the index
1–6 of 6 · Most stars
Distribute and run LLMs with a single file.
Whisper realtime streaming for long speech-to-text transcription and translation
ggml speech-to-text inference for 16+ model families
Portable local AI studio for Windows, Linux, and macOS. Zero-setup GUI for Image Generation, GGUF LLMs, Text to Speech & Speech to Text
Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.
Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.