DeepGEMM: clean and efficient BLAS kernel library on GPU
Repository Index
108,094 visible repositories in the index
1–6 of 6 · Most stars
FlashInfer: Kernel Library for LLM Serving
Tile primitives for speedy kernels
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
- ai-infra
- attention
- inference-acceleration
- llm
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
- anns
- building-blocks
- clustering
- cuda
cuVS - a library for vector search and clustering on the GPU
- anns
- clustering
- cuda
- distance