KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.
Repository Index
57,138 visible repositories in the index
1–4 of 4 · Most stars
lightweight, standalone C++ inference engine for Google's Gemma models.
Fast inference engine for Transformer models
- neural-machine-translation
- cpp
- mkl
- quantization
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
- anthropic-api
- cuda
- gemma
- gguf