GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
- llm-inference
- ai-chat
131,939 visible repositories in the index
1–24 of 141 · Most stars
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build, Muse Code, Devin as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini Series, GPT Series, Grok Series, Claude model through API
🦍 The API and AI Gateway
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.
The Cloud-Native API Gateway and AI Gateway
Sub-50mb agentic, voice and vision intelligence for consumer devices.
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
TranslatedCRS - a self-hosted Claude Code mirror, a one-stop open-source relay service that lets Claude, OpenAI, Gemini, and Droid subscriptions be accessed in a unified way. It supports carpool-style shared use to split costs more efficiently, and native tools work seamlessly.
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Device-native foundation models: 145B on a laptop, 35B on a phone. Latent MoE, SSD-streamed weights, a router that predicts loads a step ahead. Mac, iPhone, Android, Windows.
MiniCPM5: SOTA on-device LLMs, small yet powerful.
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Open-source AI brand visibility and competitor reports. Official website: https://niubigeo.ai/ | Paid services: AI testing by real people and GEO optimization. Pricing: https://niubigeo.ai/pricing
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
TranslatedFirefly: a large model training tool that supports training large models such as Qwen2.5, Qwen2, Yi1.5, Phi-3, Llama3, Gemma, MiniCPM, Yi, Deepseek, Orion, Xverse, Mixtral-8x7B, Zephyr, Mistral, Baichuan2, Llma2, Llama, Qwen, Baichuan, ChatGLM2, InternLM, Ziya2, Vicuna, Bloom, etc.
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
Venom is a high-performance system developed with JavaScript to create a bot for WhatsApp, support for creating any interaction, such as customer service, media sending, sentence recognition based on artificial intelligence and all types of design architecture for WhatsApp.
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
Translated🌻 One click access to your own ChatGPT+Many AI web services
Next Generation Agentic Proxy for AI Agents and MCP servers