Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
Repository Index
132,241 visible repositories in the index
1–6 of 6 · Most stars
Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?
Reference implementations of MLPerf® inference benchmarks
Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization
Local-first engineering agent that deploys, benchmarks and tunes vLLM/SGLang inference services on your own GPUs, with auditable run evidence.
- benchmarking
- deployment
- gpu
- llm-agent
Feel how fast a local LLM runs before you buy the hardware