learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
- course
- large-language-model
- llm
- python
111,085 visible repositories in the index
1–3 of 3 · Most stars
learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning