LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- cuda-kernels
- deepspeed
- fastertransformer
- llm-inference
Repository Index
55,140 visible repositories in the index
1–1 of 1 · Most stars
55,140 visible repositories in the index
1–1 of 1 · Most stars
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.