Repository Index

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

• llama
• llm
• llms
• go

LLM inference in C/C++

• ggml

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

• fine-tuning
• llama
• llms
• gemma

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

• llm-inference
• ai-chat

Inference code for Llama models

Grok open release

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

• llama
• ai
• llm
• stable-diffusion

Run frontier AI locally.

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

• llamacpp
• localai
• self-hosted
• gpt

AirLLM 2.8T LLM inference with single 4GB GPU

• chinese-nlp
• finetune
• generative-ai
• instruct-gpt

Official inference framework for 1-bit LLMs

TranslatedChatGLM-6B: An Open Bilingual Dialogue Language Model

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

Hundreds of models & providers. One command to find what runs on your hardware.

• llm
• skill
• localai
• gguf

Distribute and run LLMs with a single file.

• cross-platform
• gguf
• llama-cpp
• local-ai

DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

• apple-silicon
• inference-server
• llm
• macos

Inference Llama 2 in one file of pure C

The simplest way to run LLaMA on your local machine

• ai
• llama
• llm

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

• avx2
• c99
• cpu-inference
• deep-learning

Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported

Run LLMs with MLX

• llms
• mlx

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

• privacy-first
• gguf
• llama-cpp
• local-ai