1.T-Crypt / berth
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.
+84 stars
from 182 · score 4.44
Ranked by Attention Score: stars gained over the last 7 complete days
3 repositories by Attention Score · Oct 27, 2026 – Nov 2, 2026 (UTC)
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.
Manages Unified Access to Generative AI Services built on Envoy Gateway
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.