Repository Index

Ekko Studio is a local-first AI workspace for multi-agent chat, coding, and visual workflows, available on desktop and the web.

• ai-agent
• chat-ui
• dashboard
• hermes-agent

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

• ai
• chatgpt
• gpt
• gpt-4

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

• python
• fine-tuning
• gguf
• huggingface

Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.

• embeddinggemma
• embeddings
• llama-cpp
• local-first

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

• llava
• llm
• mlx
• vision-transformer

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

• privacy-first
• gguf
• llama-cpp
• local-ai

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

• kv-cache
• llm-inference
• local-llm
• quantization

Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.

• cuda
• glm
• glm-5
• llm

A local inference engine for Apple silicon, built around the model.

• apple-silicon
• coding-agents
• llm-inference
• macos

TranslatedLocal AI routing gateway with Agent client takeover — reuse existing client logins, call 50+ AI clients through one base URL, with unified OpenAI / Anthropic / Images APIs, multi-account routing, check-in, balance and request reports

• autoclaw
• catpaw
• local-proxy
• openai-compatible

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

• godot
• godot-engine
• godot-plugin
• godot4

Local CLI Copilot, powered by Ollama. 💻🦙

• llm
• bash
• powershell
• llama3

Run many AI agents at once on your Mac, up to 3x faster.

• agents
• apple-silicon
• artificial-intelligence
• inference-acceleration

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

• anthropic-api
• cuda
• gemma
• gguf

Localize your websites with AI assistance.

• chatgpt
• ai
• frontend
• gpt

The repository host gives no description.

Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts

• gguf
• humanizer
• llama-cpp
• llm

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

• ai-gateway
• anthropic
• claude-code
• codex

Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

• apple-silicon
• llm
• llm-inference
• local-llm

Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

• avx2
• c
• cpu-inference
• gguf

A local AI gateway for AI agents, unifying your subscriptions and API providers with smart routing and on-device privacy protection.

• ai-gateway

Web/desktop UI for Gemini CLI/Qwen Code. Manage projects, switch between tools, search across past conversations, and manage MCP servers, all from one multilingual interface, locally or remotely.

• desktop
• gemini
• gemini-api
• gemini-cli

An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.

• ai-agent
• ai-assistant
• chatgpt-alternative
• claude-alternative