ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
Repository Index
132,241 visible repositories in the index
1,321–1,344 of 1,378 · Most stars
PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-correct), OpenAI-compatible local server, report and logs.
A comfortable CLI tool to use ChatGPT service🔥
The desktop companion for Open WebUI.
Local LLM API Intelligent Gateway — Open-source client + Server Open Core model, unified management of multiple LLM Provider channels, providing intelligent routing, session stickiness, cost optimization, full-chain observability, and team collaborative governance.
Self-hosted AI API gateway with OpenAI/Claude-compatible endpoints, multi-provider routing, quota management, and a built-in web console.
Production compatibility gateway bridge & observability platform connecting Claude Code CLI with Google Antigravity & Gemini inference models via Anthropic Messages API
Open source harness evals: which agent harness does tasks the best, for the least cost?
DeepWrite AI is Made with the Help of ChatGPT3 and Specific Model is Prepared for Generating Perfect Blog Post with atmost Clarity. This is Just the Version 1.0 More Improvement Will be Implemented.
TranslatedLocal-first Rust TUI/CLI for auditing AI coding-agent sessions: cost, tokens, latency, failures, and health
:dog: The open-source Gauge CLI. Hillclimb your Skills, CLI, SDK, MCP, API, or Docs to make something agents want.
- agent-skills
- agents
- cli
- docs
Wrap Gemini CLI as an OpenAI-compatible API service, allowing you to enjoy the free Gemini Pro model through API!
GLM 5.3 Abliterated or Uncensored AI model — 35 jailbreak prompts, model guide and API. One 7API key also covers Claude, GPT, Gemini, Grok, DeepSeek and Kimi.
- abliterated
- abliterated-models
- anthropic-compatible
- claude-code
JevStyle: local decision models for AI agents. Classify, route and score with a probability per option. systemone-compatible local server, MCP tools, Claude Code guard. Open weights, Apache-2.0.
- agent-skills
- calibration
- claude-code
- decision-model
SUGT - local AI gateway & skills console. Centralize LLM API keys, one OpenAI/Anthropic-compatible proxy for Claude Code, Codex & OpenCode. Homebrew & winget. Fully open source (Apache-2.0).
- ai
- ai-gateway
- anthropic
- claude-code
ReAlign models instantly, on demand. Per-request alignment for verified users and channels, or Always On. Use directly or with Hermes, OpenClaw and custom harnesses.
.NET 7 SDK for OpenAI with a Blazor Server playground
- openai
- openai-api
- sdk
- sdk-dotnet
Modern desktop application (Rust + Tauri v2 + Svelte 5 + Candle (HF)) for communicating with AI models that runs completely locally on your computer. No subscriptions, no data sent to the internet — just you and your personal AI assistant
- ai-chat
- artificial-intelligence
- candle
- chatbot
Run Qwen3.8-27B locally on Windows with one NVIDIA RTX GPU: chat and an OpenAI-compatible API. On an RTX 5090 the fastest model averaged 2,298 tok/s on our own JSONL edit task (one request at a time, thinking off, v0.1.4).
Open-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.
- agent-observability
- ai-agents
- claude-code
- codex
Integrate ChatGPT-style LLMs into Neovim: ask questions, keep multi-file context, pull diagnostics / command output, and chat without leaving your editor. Highly configurable, async, lua-only plugin.
See what your AI coding agents are doing and what they cost. Live activity map, tokens, cost, context and quota for Claude Code, Codex and OpenCode, in VS Code and a terminal dashboard. Plus usage reports, account switching and an MCP server your agent can query.
Shell wrapper for OpenAI's ChatGPT, Whisper, and TTS. Features LocalAI, Ollama, Gemini, Anthropic, and more.
PDF extraction that audits its own output — and certifies any other extractor's, catching pages they silently dropped. Verify signed manifests offline: free, MIT, no account. 0.903 on opendataloader-bench, #2 of 8 engines. 7-tool MCP server.