ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.
Repository Index
47,133 repositories indexed
193–216 of 233 · Most stars
Run transformers directly on Apple's Neural Engine in Swift bypass coreml entirely
- ane
- apple
- apple-neural-engine
- neural-engine
Official implementation of paper "Cache Engineering for Agents"
PocketStrike is a privacy-first mobile AI workstation. It combines zero-cloud native on-device GGUF inference (ARM NEON accelerated) │ with frontier cloud LLMs, multi-step ReAct agent tools, Model Context Protocol (MCP) servers, self-evolving cross-session memory, and FLUX neural image │ generation.
DeepWrite AI is Made with the Help of ChatGPT3 and Specific Model is Prepared for Generating Perfect Blog Post with atmost Clarity. This is Just the Version 1.0 More Improvement Will be Implemented.
Local multi-AI desktop workspace with official website panels, shared prompts and group collaboration.
- ai-chat
- chinese
- desktop-app
- electron
One command downloads a complete offline, no-internet emergency library: local AI (CPU/GPU), document Q&A, full Wikipedia, offline maps for any country/region (default US), survival/repair/medical archives, and public-domain manuals. Asks only where to save.
- claude
- claude-code
- emergency-preparedness
- kiwix
A Long-Horizon Benchmark for Self-Improving Inference Systems
.NET 7 SDK for OpenAI with a Blazor Server playground
- openai
- openai-api
- sdk
- sdk-dotnet
Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell built into the app.
Modern desktop application (Rust + Tauri v2 + Svelte 5 + Candle (HF)) for communicating with AI models that runs completely locally on your computer. No subscriptions, no data sent to the internet — just you and your personal AI assistant
- ai-chat
- artificial-intelligence
- candle
- chatbot
A cross-platform desktop and web app to translate and validate SRT subtitles using your existing LLM subscriptions (Gemini, ChatGPT, Claude, etc.) via CLIProxyAPI - no API keys needed.
Integrate ChatGPT-style LLMs into Neovim: ask questions, keep multi-file context, pull diagnostics / command output, and chat without leaving your editor. Highly configurable, async, lua-only plugin.
Roleplay chat with customizable character cards, interactive charts, animated SVG graphics, local GIF stickers, web search, and ChatGPT subscription support. Powered by Rust, SolidJS, and WebAssembly.
Evolved DSH plugin harnesses for five agent benchmarks, with versioned artifacts, evolution curves and Life-Harness comparisons
- agent-benchmark
- dsh
- harness
- leaderboard
Manage and use multiple Ollama instances with automatic offline detection/failover and model availability tracking
Shell wrapper for OpenAI's ChatGPT, Whisper, and TTS. Features LocalAI, Ollama, Gemini, Anthropic, and more.
[ACL 2025] The official implementation of the paper "PIGuard: Prompt Injection Guardrail via Mitigating Overdefense for Free".
See what your AI coding agent is doing. Multi-provider assistant & session monitor for VS Code and the terminal — inline completions, code transforms, and a full TUI dashboard tracking tokens, cost, and context across Claude Code, OpenCode, and Codex. Switch between multiple Claude Code and Codex accounts.
- copilot-alternative
- inline-completion
- claude-code-cli
- code-reviews
A fastlane plugin that provides an action to translate text using OpenAI API.
GPTModels - a multi model, window based LLM AI plugin for neovim, with an emphasis on stability and clean code
Research experiments exploring uncommon quant techniques.
- analysis
- jupyter-notebook
- python
- quant
A Go toolkit for building AI agents and applications across multiple providers. Unified LLM client, agent framework with handoffs, tool calling, streaming, structured output, MCP integration, and cost tracking.
- ai
- golang
- llm
- structured-output
FairPlayCombined is a platform designed to accelerate app development using .NET, Blazor, and more. It includes real-world templates like video sharing and dating apps, reducing costs and time-to-market. Perfect for developers, startups, and businesses, it empowers innovation and delivers value with pre-built tools and resources.
- aspire
- blazor
- csharp
- dotnet