LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
- edge-ai
- on-device-ai
- on-device-llm
Repository Index
75,859 visible repositories in the index
1–2 of 2 · Most stars
On-device, real-time multimodal AI with features similar to GPT-Live
- gemma
- kokoro
- litert-lm
- local-llm