Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
Repository Index
65,764 visible repositories in the index
1–1 of 1 · Most stars
65,764 visible repositories in the index
1–1 of 1 · Most stars
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads