Sign in

Repository Index

98,836 visible repositories in the index

Tags: Kubernetes operator
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

1–11 of 11 · Most stars

🦥 Easy and simple Prometheus SLO (service level objectives) generator

  • slo
  • service-level-objective
  • service-level
  • sli

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.