⚙️🦀 Build modular and scalable LLM Applications in Rust
Repository Index
56,139 visible repositories in the index
73–96 of 352 · Most stars
🧱 easy, fast, programmable and local-first microVM runtime and library
LLRT (Low Latency Runtime) is an experimental, lightweight JavaScript runtime designed to address the growing demand for fast and efficient Serverless applications.
Command-line client for WebSockets, like netcat (or curl) for ws:// with advanced socat-like functions
- websockets
- websocket-server
- websocket-client
- proxy
A Datacenter Scale Distributed Inference Serving Framework
- diffusion
- disaggregated-serving
- kubernetes
- llm-inference
Cross-session memory. Reads local memory state and injects it into the system prompt through hooks. Part of Unicity AOS.
System prompt builder. Assembles agent identity from workspace config and spark.toml. Part of Unicity AOS.
Educational blog posts for Rust beginners
Filesystem tools for agents. Read, write, replace, grep, list, create, delete, move via VFS airlock. Part of Unicity AOS.
“Zero setup” cross compilation and “cross testing” of Rust crates
- rust
- cross-compilation
- cross-testing
- cargo
A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases
- command-line-tool
- tool
- regex
- regexp
Friendly and fast tool for sending HTTP requests
CADCraft: computer-aided design and drafting — an open-source, clean-room CAD application in pure Rust
Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.
Fly through your shell history. Great Scott!
- rust
- shell
- history
- search
Fast, Declarative, Reproducible, and Composable Developer Environments using Nix
- developer-tools
- devenv
- nix
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
- ai-workflows
- artifical-intelligense
- claude-3-7-sonnet
- command-line
Translated🎉 Cross-platform clipboard management tool
Distributed SQL database in Rust, written as an educational project
- rust
- distributed
- database
- raft
Executes commands in response to file modifications
A Scalable, User-Friendly Source Control System.
The world's first open-source AI-native vector design tool and the first to feature concurrent Agent Teams. Design-as-Code. Turn prompts into UI directly on the live canvas. A modern alternative to Pencil.
An embeddable, portable, branchable virtual machine to safely run Agents locally.
- containers
- crun
- libkrun
- microvm
Application level tracing for Rust.