Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Repository Index
132,241 visible repositories in the index
1–3 of 3 · Most stars
High-performance serverless GPU task orchestration — the scheduling layer behind wavespeed.ai
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.