Repository Index

SGLang is a high-performance serving framework for large language models and multimodal models.

• cuda
• inference
• llama
• llm

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

• data
• data-cleaning
• data-pipelines
• data-processing

Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.

• infra
• llm
• sglang
• cuda

Official Inference Code of EAGLE-4

• eagle
• gpu
• llm-inference
• sglang

Official repository for MemT-1.0

• ai-agents
• deepseek
• llm
• long-context