A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
Repository Index
94,845 visible repositories in the index
1–4 of 4 · Most stars
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
- llama
- llamacpp
- llm-inference
- ollama-api
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.