SGLang is a high-performance serving framework for large language models and multimodal models.
Repository Index
47,133 repositories indexed
1–7 of 7 · Most stars
[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- data
- data-cleaning
- data-pipelines
- data-processing
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
Official Inference Code of EAGLE-4
- eagle
- gpu
- llm-inference
- sglang
Official repository for MemT-1.0
🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки
- ai-agents
- deepseek
- deepseek-r1
- deepseek-v4
ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.