Fast CUDA matrix multiplication from scratch
Repository Index
132,241 visible repositories in the index
25–48 of 54 · Most stars
FlashKDA: high-performance Kimi Delta Attention kernels
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
- ai-infra
- attention
- inference-acceleration
- llm
Learn CUDA Programming, published by Packt
Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions 🖼️
- huggingface-transformers
- language-vision
- multimodal
- pytorch
Flash Attention in ~100 lines of CUDA (forward pass only)
GPU database engine
CUDA 算子手撕与面试指南
GPU accelerated decision optimization
- gpu
- linear-programming
- optimization
- cuda
Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
- anns
- building-blocks
- clustering
- cuda
[CVPR 2023 Highlight] Neural Kernel Surface Reconstruction
- 3d-reconstruction
- computer-vision
- graphics
- neural-kernel
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
- attention
- blackwell
- cuda-kernels
- flash-attention
Code from the "CUDA Crash Course" YouTube series by CoffeeBeforeArch
CUDA Kernel Benchmarking Library
Examples demonstrating available options to program multiple GPUs in a single node or a cluster
cuVS - a library for vector search and clustering on the GPU
- anns
- clustering
- cuda
- distance
Graphics Processing Units Molecular Dynamics
- molecular-dynamics-simulation
- heat-transport
- cuda
- molecular-dynamics
Automatically exported from code.google.com/p/cuda-convnet2
Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches
Code release for "Convolutional Two-Stream Network Fusion for Video Action Recognition", CVPR 2016.
Distributed multigrid linear solver library on GPU
The repository host gives no description.
UNet diffusion model in pure CUDA