1Soulmate-Halo / heterogeneous-gpu-pd-lab使用稠密算力卡对稀疏大显存主机进行加速,主机包括 AI Max+ 395、M3 512G、DGX Spark 等。llama-cpppipeline-parallelismprefill-decodertx-3060strix-haloheterogeneous-gpuC++No license1.1K total165 forks+104 starsfrom 947 · score 4.65
2cobanov / PS5LMllama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8homebrewllama-cppllmplaystation-5ps5qwenC++GPL-3.0796 total72 forks+82 starsfrom 703 · score 4.42
3mozilla-ai / llamafileDistribute and run LLMs with a single file.cross-platformggufllama-cpplocal-ailocal-inferencelocal-llm+3 moreC++Other license27K total1.7K forks+56 starsfrom 26,486 · score 4.04
4heterodoxin / AbliteratedOutTheBoxllama.cpp fork that abliterates at inferenceabliterationaiinferencellama-cppllmllmsC++MIT163 total16 forks+20 starsfrom 142 · score 3.04