FlashInfer: Kernel Library for LLM Serving
Repository Index
99,825 visible repositories in the index
1–15 of 15 · Most stars
Code and data for paper "Deep Painterly Harmonization": https://arxiv.org/abs/1804.03189
The project is an official implementation of our CVPR2019 paper "Deep High-Resolution Representation Learning for Human Pose Estimation"
- human-pose-estimation
- deep-learning
- coco-keypoints-detection
- mpii-dataset
Tile primitives for speedy kernels
Sample codes for my CUDA programming book
- cuda-programming
- gpu-programming
- molecular-dynamics-simulation
GPU Accelerated t-SNE for CUDA with Python bindings
Deformable ConvNets V2 (DCNv2) in PyTorch
[MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.
- pytorch
- acceleration
MatConvNet: CNNs for MATLAB
This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.
- gpu-acceleration
- elementwise
- reduce
- sgemm
FlashKDA: high-performance Kimi Delta Attention kernels
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
- ai-infra
- attention
- inference-acceleration
- llm
Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions 🖼️
- huggingface-transformers
- language-vision
- multimodal
- pytorch
Flash Attention in ~100 lines of CUDA (forward pass only)
Fork of SageAttention for Windows wheels and easy installation