FlashInfer: Kernel Library for LLM Serving
Repository Index
105,102 visible repositories in the index
1–5 of 5 · Most stars
FlashKDA: high-performance Kimi Delta Attention kernels
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
- ai-infra
- attention
- inference-acceleration
- llm
Flash Attention in ~100 lines of CUDA (forward pass only)
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
- attention
- blackwell
- cuda-kernels
- flash-attention