rasbt /LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- Stars
- 107,712 stars
- Forks
- 16,634 forks
- Language
- Jupyter Notebook
- License
- OTHER
- Created
- Jul 23, 2023
- Last push
- Oct 30, 2026
- Updated
- Nov 3, 2026
- gpt
- large-language-models
- llm
- python
- pytorch
- ai
- artificial-intelligence
- language-model
- deep-learning
- machine-learning
- from-scratch
- generative-ai
- transformers
- attention-mechanism
- finetuning
- instruction-tuning
- natural-language-processing
- pretraining
- tokenizer
In the Repository Index from the Seed Dataset since Oct 22, 2026.
Star History
192 days recorded, Apr 26, 2026 – Nov 3, 2026 (UTC). Net change +17,363 stars.
Apr 26, 2026Nov 3, 2026
Apr 26, 2026Nov 3, 2026
Observations
What the Repository Host reported each day.
| Day (UTC) | Stars | Forks | Last push | Archived |
|---|---|---|---|---|
| Nov 3, 2026 | 107,712 | 16,634 | Oct 30, 2026 | No |
| Nov 2, 2026 | 107,650 | 16,618 | Oct 30, 2026 | No |
| Nov 1, 2026 | 107,610 | 16,607 | Oct 30, 2026 | No |
| Oct 31, 2026 | 107,569 | 16,594 | Oct 30, 2026 | No |
| Oct 30, 2026 | 107,514 | 16,578 | Oct 2, 2026 | No |
| Oct 29, 2026 | 107,455 | 16,564 | Oct 2, 2026 | No |
| Oct 28, 2026 | 107,409 | 16,553 | Oct 2, 2026 | No |
| Oct 27, 2026 | 107,361 | 16,541 | Oct 2, 2026 | No |
| Oct 26, 2026 | 107,281 | 16,524 | Oct 2, 2026 | No |
| Oct 25, 2026 | 107,222 | 16,514 | Oct 2, 2026 | No |
| Oct 24, 2026 | 107,165 | 16,500 | Oct 2, 2026 | No |
| Oct 23, 2026 | 107,110 | 16,488 | Oct 2, 2026 | No |
| Oct 22, 2026 | 107,104 | 16,487 | Oct 2, 2026 | No |