[MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.
- pytorch
- acceleration
111,821 visible repositories in the index
25–48 of 50 · Most stars
[MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.
MatConvNet: CNNs for MATLAB
FSA/FST algorithms, differentiable, with PyTorch compatibility.
This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.
Fast CUDA matrix multiplication from scratch
FlashKDA: high-performance Kimi Delta Attention kernels
Learn CUDA Programming, published by Packt
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions 🖼️
Flash Attention in ~100 lines of CUDA (forward pass only)
GPU database engine
CUDA 算子手撕与面试指南
GPU accelerated decision optimization
Fork of SageAttention for Windows wheels and easy installation
Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
[CVPR 2023 Highlight] Neural Kernel Surface Reconstruction
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
Code from the "CUDA Crash Course" YouTube series by CoffeeBeforeArch
CUDA Kernel Benchmarking Library
Examples demonstrating available options to program multiple GPUs in a single node or a cluster
cuVS - a library for vector search and clustering on the GPU
Graphics Processing Units Molecular Dynamics
The repository host gives no description.