CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Repository Index
47,133 repositories indexed
1–6 of 6 · Most stars
🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
One API for every LLM: 170+ providers through one client, with a Rust core and native bindings for every major language.
Ultra-fast token & cost tracker for LLM Token Usage (e.g. Claude Code)
基于Rust编写的中转API破甲项目，支持Responses / Chat Completions / Anthropic Messages API，支持ChatGPT/Claude/Grok/Gemini/Deepseek/Glm/Kimi等大多数主流模型