DeepGEMM: clean and efficient BLAS kernel library on GPU
Repository Index
111,085 visible repositories in the index
1–7 of 7 · Most stars
FlashInfer: Kernel Library for LLM Serving
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
- attention
- inference-acceleration
- llm
- quantization
CUDA Library Samples
- cufft
- curand
- cusolver
- cusparse
FlashKDA: high-performance Kimi Delta Attention kernels
Flash Attention in ~100 lines of CUDA (forward pass only)
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
- attention
- blackwell
- cuda-kernels
- flash-attention