Instant neural graphics primitives: lightning fast NeRF and more
Repository Index
132,241 visible repositories in the index
1–18 of 18 · Most stars
Tile primitives for speedy kernels
how to optimize some algorithm in cuda.
Mirage Persistent Kernel: Compiling LLMs into a MegaKernel
Sample codes for my CUDA programming book
- cuda-programming
- gpu-programming
- molecular-dynamics-simulation
[MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.
- pytorch
- acceleration
This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.
- gpu-acceleration
- elementwise
- reduce
- sgemm
FlashKDA: high-performance Kimi Delta Attention kernels
Learn CUDA Programming, published by Packt
Flash Attention in ~100 lines of CUDA (forward pass only)
GPU accelerated decision optimization
- gpu
- linear-programming
- optimization
- cuda
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
- anns
- building-blocks
- clustering
- cuda
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
- attention
- blackwell
- cuda-kernels
- flash-attention
Code from the "CUDA Crash Course" YouTube series by CoffeeBeforeArch
Examples demonstrating available options to program multiple GPUs in a single node or a cluster
cuVS - a library for vector search and clustering on the GPU
- anns
- clustering
- cuda
- distance
Graphics Processing Units Molecular Dynamics
- molecular-dynamics-simulation
- heat-transport
- cuda
- molecular-dynamics
Additional utils and helpers to extend TensorFlow when build recommendation systems, contributed and maintained by SIG Recommenders.
- tensorflow-recommenders-addons
- sig-recommenders
- recommender-system
- tensorflow