LLM training in simple, raw C/CUDA
Repository Index
111,821 visible repositories in the index
1–24 of 50 · Most stars
Instant neural graphics primitives: lightning fast NeRF and more
HVM1 (2022): a massively parallel, optimal functional runtime in Rust
DeepEP: an efficient expert-parallel communication library
DeepGEMM: clean and efficient BLAS kernel library on GPU
FlashInfer: Kernel Library for LLM Serving
Code and data for paper "Deep Painterly Harmonization": https://arxiv.org/abs/1804.03189
The project is an official implementation of our CVPR2019 paper "Deep High-Resolution Representation Learning for Human Pose Estimation"
- human-pose-estimation
- deep-learning
- coco-keypoints-detection
- mpii-dataset
The repository host gives no description.
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
- attention
- inference-acceleration
- llm
- quantization
Tile primitives for speedy kernels
Squeeze-and-Excitation Networks
- senet
- caffe
- gpu
how to optimize some algorithm in cuda.
This package contains the original 2012 AlexNet code.
The repository host gives no description.
Mirage Persistent Kernel: Compiling LLMs into a MegaKernel
CUDA Library Samples
- cufft
- curand
- cusolver
- cusparse
cuGraph - RAPIDS Graph Analytics Library
Sample codes for my CUDA programming book
- cuda-programming
- gpu-programming
- molecular-dynamics-simulation
GPU Accelerated t-SNE for CUDA with Python bindings
NCCL Tests
Fully Convolutional Instance-aware Semantic Segmentation
The repository host gives no description.
Deformable ConvNets V2 (DCNv2) in PyTorch