Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- gpt
- large-language-models
- llm
- python
140,194 visible repositories in the index
1–7 of 7 · Most stars
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Build a modern LLM from scratch. Every line commented. Explained like we are five.
北京知识图谱学习小组
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
Classical Aerodynamics of potential flow using Python and Jupyter Notebooks
TranslatedA tiny Transformer built from scratch in PyTorch, with an English-to-Chinese translation demo | A small Transformer implemented from scratch with PyTorch, with an English-to-Chinese translation demo, to help understand how the model works
open source E-book on statistical physics