Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- gpt
- large-language-models
- llm
- python
Repository Index
77,852 visible repositories in the index
1–3 of 3 · Most stars
Build a modern LLM from scratch. Every line commented. Explained like we are five.
- attention-mechanism
- deep-learning
- educational
- from-scratch
TranslatedA tiny Transformer built from scratch in PyTorch, with an English-to-Chinese translation demo | A small Transformer implemented from scratch with PyTorch, with an English-to-Chinese translation demo, to help understand how the model works
- attention-mechanism
- deep-learning
- educational
- from-scratch