1.vladimirrott / mojo-dllm
Local inference for diffusion language models (LLaDA, Dream), written in Mojo
+307 stars
from 3 · score 5.73
Trending repositories
Ranked by Attention Score: stars gained over the last 7 complete days
13 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
2.VecSzn / PolyStrata
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
+248 stars
from 500 · score 5.52
3.AlexsJones / llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
+173 stars
from 38,375 · score 5.16
4.StartLuxLabs / StartLux-Prism
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
+154 stars
from 74 · score 5.04
5.sgaofen / humanizer-local-model
Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts
+148 stars
from 528 · score 5.00
6.Indras-Mirror / Xolotl
Xolotl (formerly Strata-DSV4.1): run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 90 GB RAM) at up to ~27 tok/s, 512K context, October 1017 builds included. Plus GLM-5.3-Flash and Qwen3.8. MoE experts tiered across VRAM, pinned RAM and NVMe; OpenAI + Anthropic API.
+80 stars
from 356 · score 4.39
7.StartLuxLabs / StartLux-Decision
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
+74 stars
from 1,558 · score 4.32
8.mozilla-ai / llamafile
Distribute and run LLMs with a single file.
+56 stars
from 26,486 · score 4.04
9.off-grid-ai / OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
+42 stars
from 3,274 · score 3.76
10.justxor / deepseek-local-guide-ru
🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки
+24 stars
from 145 · score 3.22
11.nobodywho-ooo / nobodywho
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
+23 stars
from 1,643 · score 3.18
12.kitops-ml / kitops
An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.
+4 stars
from 1,434 · score 1.61
13.defilantech / LLMKube
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
+4 stars
from 245 · score 1.61