Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.
Repository Index
132,241 visible repositories in the index
25–29 of 29 · Most stars
High-performance serverless GPU task orchestration — the scheduling layer behind wavespeed.ai
GPU worker client for the Talos network. Pairs with your Talos account, serves open-model inference jobs over a WebSocket, and reports uptime for payouts.
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off.
Open source compiler for your whole ML repo (support python, CUDA C/C++) into sass and cuda binary (which are closed sourced by Nvidia); 3-40% faster than Openai Triton for Neural Network (primarily LLM) based training/inferencing
- compiler
- compiler-backend
- compiler-optimization
- gpu-acceleration