Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- gpt
- large-language-models
- llm
- python
Repository Index
82,088 visible repositories in the index
1–19 of 19 · Most stars
llama3 implementation one matrix multiplication at a time
The repository host gives no description.
A series of large language models trained from scratch by developers @01-ai
Implement a reasoning LLM in PyTorch from scratch, step by step
Translated"Deep Learning from Scratch" (O'Reilly Japan, 2016)
🔥 LeetCode for PyTorch — practice implementing softmax, attention, GPT-2 and more from scratch with instant auto-grading. Jupyter-based, self-hosted or try online.
TranslatedNeeding only a Python foundation, build large language models from scratch; build GLM4\Llama3\RWKV6 step by step from scratch, to gain a deep understanding of how large models work
Build a modern LLM from scratch. Every line commented. Explained like we are five.
- attention-mechanism
- deep-learning
- educational
- from-scratch
LLMs-from-scratch项目中文翻译
LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.
- coding-interviews
- deep-learning
- from-scratch
- interview-preparation
Build an email assistant with human-in-the-loop and memory
- agents
- memory
ML from scratch
Code and Slides
Implementing a Neural Network from Scratch
This repository helps you learn Python and Machine Learning from scratch.
- python
- jupyter-notebook
- pandas-dataframe
- numpy
Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes
- bitcoin
- cryptocurrency
- crypto
- elliptic-curves
Implementing the 4 agentic patterns from scratch
TranslatedA tiny Transformer built from scratch in PyTorch, with an English-to-Chinese translation demo | A small Transformer implemented from scratch with PyTorch, with an English-to-Chinese translation demo, to help understand how the model works
- attention-mechanism
- deep-learning
- educational
- from-scratch