The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
Repository Index
56,638 visible repositories in the index
1–1 of 1 · Most stars
56,638 visible repositories in the index
1–1 of 1 · Most stars
The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.