1.mozilla-ai / llamafile
Distribute and run LLMs with a single file.
+2,358 stars
from 24,184 · score 7.77
Trending repositories
Ranked by Attention Score: stars gained over the last 180 complete days
6 repositories by Attention Score · May 7, 2026 – Nov 2, 2026 (UTC)
2.off-grid-ai / OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
+1,386 stars
from 1,930 · score 7.23
3.SciSharp / LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
+201 stars
from 3,622 · score 5.31
4.defilantech / LLMKube
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
+178 stars
from 71 · score 5.19
5.getumbrel / llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
+56 stars
from 10,868 · score 4.04
6.harshaneel / localaik
localaik is a local compatibility server for a subset of the Gemini and OpenAI APIs. Run one container locally, point your SDK to it, and the proxy serves both protocol shapes on the same port for tests and development.
+8 stars
from 8 · score 2.20