The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
Repository Index
100,822 visible repositories in the index
1–2 of 2 · Most stars
Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models.