FlashInfer: Kernel Library for LLM Serving
Repository Index
55,140 visible repositories in the index
1–2 of 2 · Most stars
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
55,140 visible repositories in the index
1–2 of 2 · Most stars
FlashInfer: Kernel Library for LLM Serving
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.