Repository Index

Lucebox inference engine for heterogeneous hardware & consumer GPUs

• kernel
• llama-cpp
• local-ai
• qwen

The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

• aws
• glm
• inference
• llm