ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
Repository Index
104,105 visible repositories in the index
2,113–2,136 of 2,242 · Most stars
PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-correct), OpenAI-compatible local server, report and logs.
Enterprise-grade benchmark evaluating whether AI agents deliver verifiable business outcomes in real business systems — general domain, finance, supply chain, and manufacturing.
- mfg
- scm
- erp
- eval
project on fine-tuning qwen to generate text w/o letter 'e'
Official implementation of paper "Cache Engineering for Agents"
M-Courtyard: Local AI Model Fine-tuning Assistant for Apple Silicon. Zero-code, zero-cloud, privacy-first desktop app powered by Tauri + React + mlx-lm.
- ai-assistant
- apple-silicon
- desktop-app
- fine-tuning
One command downloads a complete offline, no-internet emergency library: local AI (CPU/GPU), document Q&A, full Wikipedia, offline maps for any country/region (default US), survival/repair/medical archives, and public-domain manuals. Asks only where to save.
- claude
- claude-code
- emergency-preparedness
- kiwix
Local LLM API Intelligent Gateway — Open-source client + Server Open Core model, unified management of multiple LLM Provider channels, providing intelligent routing, session stickiness, cost optimization, full-chain observability, and team collaborative governance.
TranslatedPhone-like KOReader home: curated AI news, AI translation and Q&A on selections, WeRead shortcut
- ebook-reader
- kindle
- koreader
- lua
LLM-powered Text-to-SQL evaluation toolkit: schema ingestion, retrieval eval, and standalone SQL judge/re-scorer.
Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely
- ane
- apple
- apple-neural-engine
- neural-engine
Production compatibility gateway bridge & observability platform connecting Claude Code CLI with Google Antigravity & Gemini inference models via Anthropic Messages API
PocketStrike is a privacy-first mobile AI workstation. It combines zero-cloud native on-device GGUF inference (ARM NEON accelerated) │ with frontier cloud LLMs, multi-step ReAct agent tools, Model Context Protocol (MCP) servers, self-evolving cross-session memory, and FLUX neural image │ generation.
Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell built into the app.
🌳 Connecting ChatGPT with the Internet
Capri — an AI desktop companion for Windows with local/API models, Hugging Face, optional voice, memory and permission-based desktop tools.
- ai-assistant
- desktop-companion
- huggingface
- local-llm
A Long-Horizon Benchmark for Self-Improving Inference Systems
DeepWrite AI is Made with the Help of ChatGPT3 and Specific Model is Prepared for Generating Perfect Blog Post with atmost Clarity. This is Just the Version 1.0 More Improvement Will be Implemented.
VisSearch-Bench is a benchmark of 204 human-written tasks that test how well multimodal agents find, organize, and use visual evidence across multiple steps of web search.
Local multi-AI desktop workspace with official website panels, shared prompts and group collaboration.
- ai-chat
- chinese
- desktop-app
- electron
The desktop companion for Open WebUI.
Integrates AI tools into Microsoft Word
- ai
- generative-ai
- microsoft-word
- office-addin
Clover, a 35B diffusion large language model.
- agentic-coding
- diffusion-language-models
- language-model
TranslatedLocal-first Rust TUI/CLI for auditing AI coding-agent sessions: cost, tokens, latency, failures, and health