⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
- python
- t5
- onnx
- onnxruntime
140,194 visible repositories in the index
1–2 of 2 · Most stars
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
[ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"