A Datacenter Scale Distributed Inference Serving Framework
- diffusion
- disaggregated-serving
- kubernetes
- llm-inference
132,241 visible repositories in the index
1–22 of 22 · Most stars
A Datacenter Scale Distributed Inference Serving Framework
A Rust HTTP server for Python applications
A git prepare-commit-msg hook for authoring commit messages with LLMs.
A state-driven web development framework for Rust with full support for server-side rendering and static generation.
SGN — polymorphic binary encoder
Global DNS propagation checker TUI — watch a DNS record propagate across 34 public resolvers worldwide, on a world map in your terminal
Occlum is a memory-safe, multi-process library OS for Intel SGX
MessagePack implementation for Rust / msgpack.org[Rust]
The fastest GUI file manager on Omarchy.
:rocket: An open source alternative to searx which provides a modern-looking :sparkles:, lightning-fast :zap:, privacy respecting :disguised_face:, secure :lock: meta search engine
Apache Teaclave™ SGX SDK helps developers to write Intel SGX applications in the Rust programming language, and also known as Rust SGX SDK.
A minimal Linux kernel module written in rust.
Zine - a simple and opinionated tool to build your own magazine.
Markdown makes sites - A Static Site Generator for Blogs
An OS kernel written in rust. Non POSIX
Counter-Strike 2 replay parser for Python and JavaScript
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Osgood is a secure, fast, and simple platform for running JavaScript HTTP servers.
Python library to parse, analyze and visualize Counter-Strike 2 data
A fur-ociously secure encryption tool that encodes your secrets as adorable cat and dog sounds, using real elliptic curve cryptography with a playful disguise.
IDX - Analyze the Indonesian stock market (IDX/IHSG) from web terminal, CLI, or any AI agents via MCP server. IHSG Prices, Fundamentals, and Screening. Free and No API keys required.
:dizzy: A coroutines-driven Low & Slow traffic sender, written in Rust