ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
Repository Index
57,637 visible repositories in the index
937–960 of 1,079 · Most stars
The repository host gives no description.
The repository host gives no description.
One command downloads a complete offline, no-internet emergency library: local AI (CPU/GPU), document Q&A, full Wikipedia, offline maps for any country/region (default US), survival/repair/medical archives, and public-domain manuals. Asks only where to save.
- claude
- claude-code
- emergency-preparedness
- kiwix
Official implementation of paper "Cache Engineering for Agents"
Local LLM API Intelligent Gateway — Open-source client + Server Open Core model, unified management of multiple LLM Provider channels, providing intelligent routing, session stickiness, cost optimization, full-chain observability, and team collaborative governance.
Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely
- ane
- apple
- apple-neural-engine
- neural-engine
TranslatedPhone-like KOReader home: curated AI news, AI translation and Q&A on selections, WeRead shortcut
- ebook-reader
- kindle
- koreader
- lua
PocketStrike is a privacy-first mobile AI workstation. It combines zero-cloud native on-device GGUF inference (ARM NEON accelerated) │ with frontier cloud LLMs, multi-step ReAct agent tools, Model Context Protocol (MCP) servers, self-evolving cross-session memory, and FLUX neural image │ generation.
🌳 Connecting ChatGPT with the Internet
PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-correct), OpenAI-compatible local server, report and logs.
DeepWrite AI is Made with the Help of ChatGPT3 and Specific Model is Prepared for Generating Perfect Blog Post with atmost Clarity. This is Just the Version 1.0 More Improvement Will be Implemented.
Production compatibility gateway bridge & observability platform connecting Claude Code CLI with Google Antigravity & Gemini inference models via Anthropic Messages API
Local multi-AI desktop workspace with official website panels, shared prompts and group collaboration.
- ai-chat
- chinese
- desktop-app
- electron
TranslatedChinese edition of an AI reference image gallery | Costumes (1,407 realistic sets / 1,320 animation sets), 1,499 face shapes, 1,439 pose line drawings and 1,439 depth maps, 843 anime-style (二次元) entries. Designed for AI painting, character design, and comic-drama storyboards, with support for Chinese search, multi-angle browsing, and image copying and downloading. Open-source static site that preserves the original sources and terms of use.
- ai-art
- ai-comics
- art-reference
- character-design
Integrates AI tools into Microsoft Word
- ai
- generative-ai
- microsoft-word
- office-addin
TranslatedMy RAG system, which can be used to import a knowledge base for knowledge Q&A, can integrate third-party MCP, and also has permission isolation, etc.
A Long-Horizon Benchmark for Self-Improving Inference Systems
TranslatedLocal-first Rust TUI/CLI for auditing AI coding-agent sessions: cost, tokens, latency, failures, and health
The repository host gives no description.
DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.
- benchmark
- calibration
- decision-making
- evaluation
Wrap Gemini CLI as an OpenAI-compatible API service, allowing you to enjoy the free Gemini Pro model through API!
TranslatedAn AI tweak development workbench on iPhone / iPad, supporting on-device compilation of dylib / deb, Logos, dual SDKs, GitHub / Gitee, and binary analysis. Channel: https://t.me/xxuegao6
TranslatedAn AI business workbench for small and medium-sized auto parts manufacturers: real product catalog, prospect discovery and evidence review, RAG-based document Q&A, multi-turn inquiries, human handoff and quotation follow-up, with reproducible tiered evaluation.