DeepEP: an efficient expert-parallel communication library
Repository Index
132,241 visible repositories in the index
1–4 of 4 · Most stars
DeepGEMM: clean and efficient BLAS kernel library on GPU
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
- attention
- inference-acceleration
- llm
- quantization
[MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.
- pytorch
- acceleration