Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts
Repository Index
142,273 visible repositories in the index
1–4 of 4 · Most stars
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
- avx2
- c
- cpu-inference
- gguf
AI 视频解说 Agent 技能包:自动切镜、看画面写解说词、配音混音合成成片,可导出剪映/CapCut 草稿,无需 GPU | Agent skills for narrated video recaps & CapCut drafts
- claude-code
- video-narration
- video-recap
- tts
Pure-Rust LLM inference engine for GGUF (Qwen, DeepSeek, GLM, Hy4, Flint). Runs models bigger than your VRAM on CUDA and Vulkan, with MTP drafts and an OpenAI/Anthropic server. 12 GB RTX 3060 vs llama.cpp: Qwen3.6-35B-A3B UD-Q5_K_M 80.5 vs 64.4 tok/s, Flint UD-Q5_K_XL 64.6 vs 48.6. With MTP: 108 tok/s (UD-Q3_K_M), up to 160 (UD-Q2_K_XL).