Repository Index

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

• llamacpp
• localai
• self-hosted
• gpt

The fast, precise document-intelligence engine for every language: text, tables and metadata from 100+ formats, with OCR, transcription and code intelligence.

• text-extraction
• document-intelligence
• metadata-extraction
• pdf-extraction

A Datacenter Scale Distributed Inference Serving Framework

• diffusion
• disaggregated-serving
• kubernetes
• llm-inference

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

• llama
• llamacpp
• llm-inference
• ollama-api

🛰️ Track token usage across AI coding agents from your terminal. 🏅 Global leaderboard with trillions of tokens tracked.

• claude
• claude-code
• codex
• cursor

LeanCTX is the Context Gateway for AI Systems. Select task-relevant context, apply supported controls, connect local knowledge and inspect recorded evidence. Open-source Engine: CLI, MCP, hooks and supported proxy paths.

• ai
• cursor
• llm
• mcp

Multi-agent AI orchestration platform for automation, workflows, and developer tools. Golutra transforms Codex, Claude Code, and OpenClaw into a unified agent system with parallel execution, task orchestration, long-running workflows, and AI productivity workspace.

• agent
• automation
• claude-code
• codex

TranslatedLocal AI routing gateway with Agent client takeover — reuse existing client logins, call 50+ AI clients through one base URL, with unified OpenAI / Anthropic / Images APIs, multi-account routing, check-in, balance and request reports

• autoclaw
• catpaw
• local-proxy
• openai-compatible

TranslatedA Rust-based, low-risk-control, high-performance, self-hosted multi-account transparent proxy gateway

• codex
• openai
• responses-api
• 2api

Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.

• ai-gateway
• claude-code
• codex
• coding-agent

TranslatedA relay API jailbreak project written in Rust, supporting the Responses / Chat Completions / Anthropic Messages APIs, and supporting most mainstream models such as ChatGPT/Claude/Grok/Gemini/Deepseek/Glm/Kimi

Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.

• cuda
• gguf
• inference
• llama-cpp

The repository host gives no description.

TranslatedLocal-first Rust TUI/CLI for auditing AI coding-agent sessions: cost, tokens, latency, failures, and health

• ai-agents
• tui
• claude-code
• codex-cli

Modern desktop application (Rust + Tauri v2 + Svelte 5 + Candle (HF)) for communicating with AI models that runs completely locally on your computer. No subscriptions, no data sent to the internet — just you and your personal AI assistant

• ai-chat
• artificial-intelligence
• candle
• chatbot