USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
- attention-is-all-you-need
- llm-inference
- llm-training
- pytorch
132,241 visible repositories in the index
1–1 of 1 · Most stars
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference