Python bindings for llama.cpp
Repository Index
47,133 repositories indexed
1–3 of 3 · Most stars
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts