Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
Repository Index
132,241 visible repositories in the index
1–3 of 3 · Most stars
Reference implementations of MLPerf® inference benchmarks
Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization