Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Repository Index
132,241 visible repositories in the index
121–134 of 134 · Most stars
9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.
- ai-gateway
- ai-proxy
- ai-routing
- api-gateway
Go AI SDK, the Go way. One unified API across 21+ providers. Streaming, structured output, MCP support, stdlib only. Go AI SDK for AI applications inspired by Vercel AI SDK.
Fast, cross-platform, real-time token usage tracker and cost monitor for Claude Code / Codex CLI / Antigravity CLI / Qwen Code / Cline / Zoo Code / Kilo Code / GitHub Copilot / OpenCode / Pi Agent / Piebald.
- analyzer
- claude-code
- codex
- usage
A ~45 MB MaaS platform: one cluster across public and private clouds, on any mix of accelerators.
Cross-platform desktop LLM client for OpenAI ChatGPT, DeepSeek R1, Anthropic Claude and more, with a focus on privacy and security.
- desktop-app
- react
- rust
- tauri
PocketStrike is a privacy-first mobile AI workstation. It combines zero-cloud native on-device GGUF inference (ARM NEON accelerated) │ with frontier cloud LLMs, multi-step ReAct agent tools, Model Context Protocol (MCP) servers, self-evolving cross-session memory, and FLUX neural image │ generation.
VisSearch-Bench is a benchmark of 204 human-written tasks that test how well multimodal agents find, organize, and use visual evidence across multiple steps of web search.
Modern desktop application (Rust + Tauri v2 + Svelte 5 + Candle (HF)) for communicating with AI models that runs completely locally on your computer. No subscriptions, no data sent to the internet — just you and your personal AI assistant
- ai-chat
- artificial-intelligence
- candle
- chatbot
A cross-platform desktop and web app to translate and validate SRT subtitles using your existing LLM subscriptions (Gemini, ChatGPT, Claude, etc.) via CLIProxyAPI - no API keys needed.
TranslatedOpen-source unified usage dashboard for Claude — track tokens, quota, costs across Claude Code, claude.ai & API in one panel. Suitable for Pro/Max subscribers and developers. https://dyp23yngrtumg.ok.kimi.link
A Go toolkit for building AI agents and applications across multiple providers. Unified LLM client, agent framework with handoffs, tool calling, streaming, structured output, MCP integration, and cost tracking.
- ai
- golang
- llm
- structured-output
ChatGPT cross-platform client made with the Quasar Framework
Local-only observability for AI agents on your machine. One timeline across coding and non-coding agents.
- ai-agents
- claude-code
- cli
- cursor