Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
- fine-tuning
- llama
- llms
- gemma
Repository Index
47,133 repositories indexed
1–24 of 62 · Most stars
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
- llm-inference
- ai-chat
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
- rag
- localai
- vector-database
- llm
Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Run frontier AI locally.
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
- llamacpp
- localai
- self-hosted
- gpt
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
TranslatedLangchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
- chatglm
- langchain
- llm
- knowledge-base
Hundreds of models & providers. One command to find what runs on your hardware.
- llm
- skill
- localai
- gguf
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
- semantic-search
- emacs
- obsidian-md
- chat
One local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay fully in control.
Memory and context engine + app that is extremely fast, scalable, and can be run fully locally. The Memory API for the AI era.
- cloudflare-pages
- cloudflare-workers
- drizzle-orm
- tailwindcss
The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.
- text-similarity
- natural-language-processing
- word-embeddings
- python
Distribute and run LLMs with a single file.
- cross-platform
- gguf
- llama-cpp
- local-ai
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.
Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
- ai-vtuber
- ai-waifu
- ai
- neuro-sama
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
The simplest way to run LLaMA on your local machine
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!