Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- gpt
- large-language-models
- llm
- python
109,091 visible repositories in the index
1–4 of 4 · Most stars
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
A sequence of Jupyter notebooks featuring the "12 Steps to Navier-Stokes" http://lorenabarba.com/
Build a modern LLM from scratch. Every line commented. Explained like we are five.
TranslatedCovers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning