A Rust userspace WARP core for censored networks, built around MASQUE over HTTP/3 and HTTP/2.
- cloudflare
- gool
- masque
- rust
80,339 visible repositories in the index
1–2 of 2 · Most stars
A Rust userspace WARP core for censored networks, built around MASQUE over HTTP/3 and HTTP/2.
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.