Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Repository Index
100,822 visible repositories in the index
337–360 of 679 · Most stars
A JSON Query Language CLI tool
- json
- rust
- rustlang
- cli
Rusty wrapper for the Unified Extensible Firmware Interface (UEFI). This crate makes it easy to develop Rust software that leverages safe, convenient, and performant abstractions for UEFI functionality.
- uefi
- rust
- osdev
Interactive, file-level Time Machine-like tool for ZFS/btrfs/nilfs2 (and even Time Machine and Restic backups!)
- zfs
- rust
- unix-shell
- unix
A CLI code-typing game that turns your source code into typing challenges
- cli-game
- cli-tool
- code-practice
- coding-skills
3D City Builder without a grid
- society
- simulation
- rust-lang
- emergent-behavior
A Rust implementation of Glidesort, my stable adaptive quicksort/mergesort hybrid sorting algorithm.
A toy web rendering engine
《构筑大语言模型应用:应用开发与架构设计》一本关于 LLM 在真实世界应用的开源电子书,介绍了大语言模型的基础知识和应用,以及如何构建自己的模型。其中包括Prompt的编写、开发和管理,探索最好的大语言模型能带来什么,以及LLM应用开发的模式和架构设计。
NativeLink is a Nix-powered, open source, high-performance build cache and remote execution server, compatible with Bazel, Soong, Pants, Buck2, Reclient, and other RE-compatible build systems. It offers drastically faster builds, reduced test flakiness, and support for specialized hardware.
- apache2
- bazel
- build-automation
- build-system
Heimdall is an advanced EVM smart contract toolkit specializing in bytecode analysis and extracting information from unverified contracts.
A socket.io server implementation in Rust that integrates with the Tower ecosystem and the Tokio stack.
- hyper
- rust
- socket-io
- tokio
Let your AI agent get the sources behind logins and paywalls.
A flight-compliant WebAssembly interpreter.
- flight-software
- webassembly
- embedded-systems
Global DNS propagation checker TUI — watch a DNS record propagate across 34 public resolvers worldwide, on a world map in your terminal
Rust utility library for nice command line prompts and similar things
Headless 3D and VFX engine for agents. Research preview.
A WebSocket (RFC6455) library written in Rust
⚡ A native app for all your coding agents.
- agent
- amp
- claude-code
- codex
Flashy Synthesia Like Software For Linux, Windows and MacOs
- synthesia
- midi
- rust
- wgpu
Graft is an open-source transactional storage engine optimized for lazy, partial, and strongly consistent replication—perfect for edge, offline-first, and distributed applications.
- edge
- replication
- storage
- storage-engine
Open-source, local-first Granola/Otter alternative that Claude Code, Codex, Cursor, and any MCP client can query. Meetings, calls, and voice memos transcribed on-device into markdown you own.
- agent-skills
- meetings
- ai
- claude
`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes