Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
Repository Index
47,133 repositories indexed
1–5 of 5 · Most stars
TranslatedUsing dense-compute cards to accelerate sparse, large-VRAM hosts, where the hosts include AI Max+ 395, M3 512G, DGX Spark, and others.
- llama-cpp
- pipeline-parallelism
- prefill-decode
- rtx-3060
llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
llama.cpp fork that abliterates at inference