FlashInfer: Kernel Library for LLM Serving
Repository Index
108,094 visible repositories in the index
1–7 of 7 · Most stars
Fast CUDA matrix multiplication from scratch
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
- ai-infra
- attention
- inference-acceleration
- llm
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
- anns
- building-blocks
- clustering
- cuda
[CVPR 2023 Highlight] Neural Kernel Surface Reconstruction
- 3d-reconstruction
- computer-vision
- graphics
- neural-kernel
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
- attention
- blackwell
- cuda-kernels
- flash-attention
cuVS - a library for vector search and clustering on the GPU
- anns
- clustering
- cuda
- distance