Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Repository Index
138,199 visible repositories in the index
1–5 of 5 · Most stars
AI-native open-source alternative to Vercel + Sentry + PostHog + Pingdom + Resend + E2B. 440+ CLI operations with drop-in skills for Claude Code, Codex & OpenCode — deployments, analytics, session replay, error tracking, OpenTelemetry, email, sandboxes & AI gateway in one self-hosted Rust binary.
Learn vector search with Rust and DataFusion; the C++/BusTub track is deprecated.
- vector-database
- tutorial
- apache-arrow
- approximate-nearest-neighbor
A multi-agent framework written in Rust that enables you to build, deploy, and coordinate multiple intelligent agents
Rust Agent Development Kit (ADK-Rust): Build AI agents in Rust with modular components for models, tools, memory, realtime voice, and more. ADK-Rust is a flexible framework for developing AI agents with simplicity and power. Model-agnostic, deployment-agnostic, optimized for frontier AI models. Includes support for real-time voice agents.
- adk
- adk-google
- google-adk
- adk-agent