Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
47,133 repositories indexed
1–5 of 5 · Most stars
Distribute and run LLMs with a single file.
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.
Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.
🚀 LLM inference Engine in Swift/Metal, Load GGUF and safe tensors modes, no conversion, no cpp, pure swift