1.Niko1221 / Strata
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
+27,862 stars
from 11,433 · score 10.24
Trending repositories
Ranked by Attention Score: stars gained over the last 30 complete days
16 repositories by Attention Score · Oct 5, 2026 – Nov 3, 2026 (UTC)
+3,433 stars
from 129,862 · score 8.14
+1,145 stars
from 40,311 · score 7.04
4.incoai / splash
A local inference engine for Apple silicon, built around the model.
- apple-silicon
- coding-agents
- llm-inference
- macos
- metal
- speculative-decoding
+873 stars
from 1,184 · score 6.77
5.cobanov / PS5LM
llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
+744 stars
from 59 · score 6.61
6.gufo-org / gufo
The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B Q4_K_XL: 656.33pp, 70.56tg tok/s single user with DFlash2
- amd
- llm
- strix-halo
- gfx1151
- ryzen-ai
+527 stars
from 530 · score 6.27
7.Soulmate-Halo / heterogeneous-gpu-pd-lab
TranslatedUsing dense-compute cards to accelerate sparse, large-VRAM hosts, where the hosts include AI Max+ 395, M3 512G, DGX Spark, and others.
- llama-cpp
- pipeline-parallelism
- prefill-decode
- rtx-3060
- strix-halo
- heterogeneous-gpu
+457 stars
from 629 · score 6.13
8.mozilla-ai / llamafile
Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
- local-inference
- local-llm
- +3 more
+430 stars
from 26,125 · score 6.07
9.nomic-ai / gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
- llm-inference
- ai-chat
+67 stars
from 77,281 · score 4.22
10.uxlfoundation / oneDNN
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
- onednn
- oneapi
- performance
- cpp
- x64
- aarch64
- +14 more
+34 stars
from 4,053 · score 3.56
11.cyberman54 / ESP32-Paxcounter
Wifi & BLE driven passenger flow metering with cheap ESP32 boards
- wifi
- ttgo
- lopy
- heltec
- ttn
- lorawan
- +14 more
+27 stars
from 2,101 · score 3.33
12.IvanMurzak / Unreal-MCP
AI Game Developer for Unreal Engine — MCP plugin (C++ editor plugin + .NET bridge), unreal-cli, connects Unreal Editor to AI agents via ai-game.dev or a local MCP server
- ai
- ai-tools
- gamedev
- mcp
- mcp-server
- unreal
- +14 more
+14 stars
from 43 · score 2.71
13.VectorDB-NTU / RaBitQ-Library
Official library for RaBitQ vector quantization and approximate nearest-neighbor search, in C++ and Python.
- nearest-neighbor-search
- quantization
- vector-database
- vector-search
- ann
- approximate-nearest-neighbor-search
- +7 more
+5 stars
from 288 · score 1.79
14.google / minja
A minimalistic C++ Jinja templating engine for LLM chat templates
+5 stars
from 231 · score 1.79
15.unum-cloud / UStore
Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️
- acid
- database
- key-value-store
- document-database
- graph-database
- json
- +14 more
+4 stars
from 642 · score 1.61
16.NGT-labs / NGT
Nearest Neighbor Search with Neighborhood Graph and Tree for High-dimensional Data
- approximate-nearest-neighbor-search
- k-nearest-neighbors
- knn-search
- nearest-neighbors
- nearest-neighbor-search
- vector-database
- +1 more
+3 stars
from 1,374 · score 1.39