NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
Repository Index
107,098 visible repositories in the index
49–72 of 95 · Most stars
Rust Programming Language Tutorials for Everyone!
- rust-lang
- documentation
- reference
- tutorial
NativeLink is a Nix-powered, open source, high-performance build cache and remote execution server, compatible with Bazel, Soong, Pants, Buck2, Reclient, and other RE-compatible build systems. It offers drastically faster builds, reduced test flakiness, and support for specialized hardware.
- apache2
- bazel
- build-automation
- build-system
Import .sql files into TypeScript with full type inference and zero codegen.
The Rust Reference
- rust-lang
- reference
- documentation
- rust
🚀 Apache RocketMQ built in Rust 🦀 — faster, safer, and more memory-efficient. Powering high-performance messaging for the AI era, with AI Agent, MCP, and AI-SRE capabilities.
- rocketmq
- rust
- cloud-native
- rocketmq-rust
Generate Nix packages from URLs with hash prefetching, dependency inference, license detection, and more [maintainer=@figsoda]
- go
- nix
- rust
- cargo
Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.
- decision-models
- jev
- laya
- local-inference
A crate for managing memory bit by bit
- rust
- bitset
- bitvector
Fast and multi-source CLI program for managing Minecraft mods and modpacks from Modrinth, CurseForge, and GitHub Releases
- minecraft
- minecraft-mod
- modrinth
- rust
Fast, robust, accurate diffing
- ast-diff
- ast-diff-tool
- ast-differencing
- code-quality
Guard offers a policy-as-code domain-specific language (DSL) to write rules and validate JSON- and YAML-formatted data such as CloudFormation Templates, K8s configurations, and Terraform JSON plans/configurations against those rules. Take this survey to provide feedback about cfn-guard: https://amazonmr.au1.qualtrics.com/jfe/form/SV_bpyzpfoYGGuuUl0
Distributed zkML
- zkml
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
- machine-learning
- indexing
- rag
- rust
JSTprove - Fast, verifiable AI
- zkml
Interactive find-and-replace in the terminal
Secure multithreaded packet sniffer
Efficient, deferred formatting for logging on embedded systems
- logging
- embedded-systems
- rust
- rust-tools
ezkl is an engine for doing inference for deep learning models and other computational graphs in a zk-snark (ZKML). Use it from Python, Javascript, or the command line.
- ai
- cryptography
- zero-knowledge
- zkml
Cross platform window and framebuffer crate for Rust
- rust
- rust-crate
- framebuffer
- window
Run, serve, query and edit AI models — a Rust model runtime built on VINDEX3, an executable, inspectable model format.
- huggingface
- inference
- llm
- mechanistic-interpretability
Tensors and dynamic neural networks in pure Rust.
- deeplearning
- rust
- autodifferentiation
- neural-networks
AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.
- s3
- rust
- cloud-native
- ai
Rust implementation of Magic Wormhole, with new features and enhancements
- rust
- wormhole
- magic-wormhole
- file-transfer