Universal LLM Deployment Engine with ML Compilation
- llm
- machine-learning-compilation
- language-model
- tvm
47,133 repositories indexed
1–3 of 3 · Most stars
Universal LLM Deployment Engine with ML Compilation
High-performance In-browser LLM Inference Engine
Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.