Repository Index

SGLang is a high-performance serving framework for large language models and multimodal models.

• cuda
• inference
• llama
• llm

Official Inference Code of EAGLE-4

• eagle
• gpu
• llm-inference
• sglang

ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.

• ansible
• ascend
• gpu
• helmfile

ReAlign models instantly, on demand. Per-request alignment for verified users and channels, or Always On. Use directly or with Hermes, OpenClaw and custom harnesses.

• abliteration
• hermes
• inference
• llama-cpp