Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Repository Index
47,133 repositories indexed
1–5 of 5 · Most stars
Learn AI Engineering! Learn it. Build it. Ship it for others.
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
零基础入门大模型（LLM）的基础教程：从零手写 GPT-2，一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step