Self-hosted AI coding assistant
Repository Index
132,241 visible repositories in the index
1–18 of 18 · Most stars
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
- llama
- llamacpp
- llm-inference
- ollama-api
LeanCTX is the Context Gateway for AI Systems. Select task-relevant context, apply supported controls, connect local knowledge and inspect recorded evidence. Open-source Engine: CLI, MCP, hooks and supported proxy paths.
Like htop, but for AI coding agents. Monitor Claude Code & Codex CLI sessions, tokens, context window, rate limits, and ports in real-time.
- ai-agents
- ai-coding-agent
- btop
- claude-code
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
- ai
- auto-completion
- developer-tools
- ide
Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
- artificial-intelligence
- developers
- machine-learning
- data
Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.
- generative-ai
- llm-evaluation
- llms
- promptengineering
Cross-platform desktop app for cleaning development artifacts, managing local developer tools, and checking common environment issues.
- developer-tools
- ai-tools
- cleanup
- desktop-app
Terminal UI to chat with large language models (LLM) using different model backends, and integrations with your favourite editors!
- chat
- large-language-models
- llm
- rust
Local code intelligence MCP server and CLI for AI coding agents
- ai-agents
- call-graph-analysis
- code-indexing
- code-intelligence
Rust-powered code intelligence CLI for AI coding agents. Builds call graphs and hybrid semantic search indexes (Dense + Sparse + RRF + Reranker) across 7 languages. Ships as native MCP tools for Claude Code and Codex CLI.
- bm25
- call-graph
- claude-code
- cli
Rust Agent Development Kit (ADK-Rust): Build AI agents in Rust with modular components for models, tools, memory, realtime voice, and more. ADK-Rust is a flexible framework for developing AI agents with simplicity and power. Model-agnostic, deployment-agnostic, optimized for frontier AI models. Includes support for real-time voice agents.
- adk
- adk-google
- google-adk
- adk-agent
Context compression for AI coding agents: compresses tool output before it enters the model, dedups repeats to 13-token refs. Claude Code, Cursor, Codex, Kiro, Zed, any MCP client. Rust, zero LLM calls.
Build agent that uses 80% less token and delivers better results.
- agent
- agentic-ai
- coding-agent
- context-engineering
Deterministic Operating System and Causal Nervous System for Artificial Intelligence.
Menu bar app for macOS, Windows and Linux that cuts Claude Code and ChatGPT Codex token costs by ~50%
Private, provider-neutral context compression for LLMs. Reversibly compress schemas and logs inside your perimeter with zero third-party calls.
- cli
- compression
- context-window
- cost-reduction
Ultra-fast token & cost tracker for LLM Token Usage (e.g. Claude Code)