⚙️🦀 Build modular and scalable LLM Applications in Rust
Repository Index
136,206 visible repositories in the index
1–11 of 11 · Most stars
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
- gateway
- generative-ai
- llm-inference
- llms
Bionic is sovereign Agentic AI for the enterprise — Runs on-premise and can securely work with your sensitive data and systems.
- architecture
- full-stack
- llmops
- llms
AICI: Prompts as (Wasm) Programs
Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
🧠 Motorhead is a memory and information retrieval server for LLMs.
- machine-learning
- ml
- mlops
- rust
Fast, streaming indexing, query, and agentic LLM applications in Rust
Counter-Strike 2 replay parser for Python and JavaScript
- counter-strike
- counter-strike-2
- cs2
- csgo
The open-source safety layer for AI agents — block unsafe tool calls, require approval, enforce budgets, audit, replay.