Sign in

Repository Index

108,094 visible repositories in the index

Tags: All Tags
Tags

A repository shows when it has any selected Tag.

Filters (1)

Filters

Clear all filters

1–19 of 19 · Most stars

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.

  • gpu-acceleration
  • elementwise
  • reduce
  • sgemm

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

  • ai-infra
  • attention
  • inference-acceleration
  • llm

Distributed training & inference for multimodal perception: shared embeddings across text, images, video, audio, code & graphs from 64 to 1024 dimensions 🖼️

  • huggingface-transformers
  • language-vision
  • multimodal
  • pytorch

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

  • anns
  • building-blocks
  • clustering
  • cuda