Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
Repository Index
132,241 visible repositories in the index
2,017–2,040 of 2,137 · Most stars
Official code for Agent-Reflex: Teaching Language Agents to Act Reflectively
9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.
- ai-gateway
- ai-proxy
- ai-routing
- api-gateway
Find known secrets in your AI coding agent sessions (Claude Code, Codex, Cursor), then guard the next one with local hooks that trace risky commands to the content that dictated them. Open source, no telemetry.
- agent-security
- ai-agents
- ai-security
- claude-code
The official code of ToolSpace
Official Repository of paper OmniReasoning: Pushing the Limits of Audio-Visual Joint Reasoning
Capri — an AI desktop companion for Windows with local/API models, Hugging Face, optional voice, memory and permission-based desktop tools.
- ai-assistant
- desktop-companion
- huggingface
- local-llm
Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.
- cuda
- desktop-app
- gguf
- llm
Agent Speed — A lightweight, real-time token speed monitor for Codex and Claude Code. Track tokens per second (TPS), detect slowdowns, and monitor AI agent performance at a glance.
WorkBuddy2API-Hub - OpenAI-compatible local gateway
A DeepSeek Harness (dsh) plugin — turns dsh web into a SillyTavern-style roleplay frontend: character cards, prompt presets, lorebooks, personas, BM25 long-term memory, world-state deltas, and rollback-able floor operations, all on the dsh agent runtime.
- dsh-plugin
- deepseek-harness
- deepseek-harness-plugin
- sillytavern
Feather agent harness, training integrations, and evaluation tools for knowledge work
A minimalistic C++ Jinja templating engine for LLM chat templates
Free AI models for every coding tool — a local OpenAI-compatible gateway for Claude Code, Codex, Cursor, Cline and OpenCode. Based on 9router (MIT).
Fast, cross-platform, real-time token usage tracker and cost monitor for Claude Code / Codex CLI / Antigravity CLI / Qwen Code / Cline / Zoo Code / Kilo Code / GitHub Copilot / OpenCode / Pi Agent / Piebald.
- analyzer
- claude-code
- codex
- usage
Uncensored AI API and models — one key for Claude, GPT, Gemini, Grok, DeepSeek, GLM and Kimi, with uncensored and abliterated variants where available. OpenAI- and Anthropic-compatible. Pay per token.
- abliterated-models
- ai-gateway
- anthropic-compatible
- claude-api
TranslatedChinese edition of an AI reference image gallery | Costumes (1,407 realistic sets / 1,320 animation sets), 1,499 face shapes, 1,439 pose line drawings and 1,439 depth maps, 843 anime-style (二次元) entries. Designed for AI painting, character design, and comic-drama storyboards, with support for Chinese search, multi-angle browsing, and image copying and downloading. Open-source static site that preserves the original sources and terms of use.
- ai-art
- ai-comics
- art-reference
- character-design
learn stuff with pen + paper + AI
- ai-tutor
- education
- local-first
The repository host gives no description.
This is the official repo for paper InteractiveWorld A Verifiable Human-Centric Environment for Building Better Interactive MLLM Assistants
A 9-billion-parameter language model running on a PS4 GPU. Offline.
Serum 2 2026 standalone bundle with full plugin suite, multitrack editor, bundled instruments and portable offline mode for Windows 11
SkyDot: self-hosted personal AI assistant and team workbench
Microsoft Project 2026 standalone bundle with core scheduling modules, bundled resource packs and portable mode for Windows 11
- aspnetcore
- emoji
- fun
- jira