Repository Index

SGLang is a high-performance serving framework for large language models and multimodal models.

• cuda
• inference
• llama
• llm

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

• data
• data-cleaning
• data-pipelines
• data-processing

Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.

• infra
• llm
• sglang
• cuda

Official Inference Code of EAGLE-4

• eagle
• gpu
• llm-inference
• sglang

Official repository for MemT-1.0

• ai-agents
• deepseek
• llm
• long-context

ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.

• ansible
• ascend
• gpu
• helmfile

🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки

• ai-agents
• deepseek
• deepseek-r1
• deepseek-v4