Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
- artificial-intelligence
- attention
- attention-is-all-you-need
- attention-mechanisms
132,241 visible repositories in the index
1–1 of 1 · Most stars
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"