Repository Index

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

• gpt
• large-language-models
• llm
• python

TranslatedCovers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning

• gpu-programming
• llm
• nlp
• rl