Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source
- kotlin-android
- litert
- litert-lm
- llm
140,194 visible repositories in the index
73–96 of 102 · Most stars
Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source
A high-performance HTTP/2-enabled proxy server designed specifically to enable Cursor IDE's Composer to use DeepSeek's and OpenRouter's language models. This proxy translates OpenAI-compatible API requests to DeepSeek/OpenRouter API format, allowing Cursor's Composer and other OpenAI API-compatible tools to seamlessly work with these models.
Free MIT AI coding agent — no API key needed. Built-in free model, or bring Claude, GPT, Gemini, DeepSeek, Ollama +50 more. Swarm mode, 40+ tools, browser & desktop automation, built in Rust.
TranslatedFerry OpenCode's free models over to WorkBuddy — isolated runtime, concurrent detection, verdict caching, one-click import, and a local OpenAI-compatible forwarding port
Community driven, reusable components for distributed, durable, and agentic AI applications across all cloud service providers
One local endpoint that routes Claude Code, Cursor, Cline, Aider, Codex CLI and the SDKs through the Claude and ChatGPT plans you already pay for: seats first, then the fallback chain you configure, and a ledger of who paid. Zero runtime dependencies.
Lightweight Claude OAuth to OpenAI-compatible API proxy
🔥 Instantly create AI chatbots for any website with RAG-powered search, streaming responses, and OpenAI-compatible API endpoints
Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.
A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management. 🍥
OpenAI-compatible async gateway for muse.ai with pluggable drivers (mock / browser-CDP / http)
Capri — an AI desktop companion for Windows with local/API models, Hugging Face, optional voice, memory and permission-based desktop tools.
WorkBuddy2API-Hub - OpenAI-compatible local gateway
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
A multi-model Muse: personal AI voice assistant on ESP32 - wake word or knob, any OpenAI-compatible brain (STT/chat/TTS mix-and-match), streaming replies, out of the box. Built on muse-gadget-sdk.
自托管 AI Coding Agent(Rust):常驻 Runtime 撑起终端 / 浏览器 / 手机三端;每行改动可追溯到具体 Agent 与工具调用,子 Agent 的活由退出码裁决,检查点回退、目标 token 预算与验收清单跨轮次跨重启累计,用量与反馈账本留在本地。接任意 OpenAI 兼容或 Anthropic 端点。Self-hosted auditable AI coding agent: per-line attribution, exit-code-verified sub-agents, restart-safe goal budgets, local usage and feedback ledgers.
📡 Legal free LLM APIs & coding agents — self-updating, probe-verified twice a week. Free tiers, no-card trials, free models.
Fast local LLM inference for the GPU you already have: one Rust binary, GGUF models, an OpenAI-compatible server and a chat page with a ghost.
TranslatedBring the Codex imagegen workflow and prompt library to any agent; supports one-command installation with npm/pnpm, a companion skill, a standalone API, and a Qwen-Image compatible gateway.
Free AI models for every coding tool — a local OpenAI-compatible gateway for Claude Code, Codex, Cursor, Cline and OpenCode. Based on 9router (MIT).
Uncensored AI API and models — one key for Claude, GPT, Gemini, Grok, DeepSeek, GLM and Kimi, with uncensored and abliterated variants where available. OpenAI- and Anthropic-compatible. Pay per token.
On-device Vision Model - a fully offline, free vision pipeline that gives text-only models (e.g. DeepSeek) image understanding and multilingual OCR through an OpenAI-compatible local API. Only tokens are needed: no API key, no subscription, no cloud cost. Recommended for native speakers of Chinese, English, Japanese and Korean.
PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-correct), OpenAI-compatible local server, report and logs.
Loopcut: an AI agent that works inside Blender. A fork of Blender (GPL).