Repository Index

Master programming by recreating your favorite technologies from scratch.

• programming
• tutorials
• tutorial-code
• tutorial-exercises

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

• gpt
• large-language-models
• llm
• python

Learn AI Engineering! Learn it. Build it. Ship it for others.

• agents
• ai
• ai-agents
• ai-engineering

🧠 Train a 64M-parameter LLM from scratch in just 2h!

• artificial-intelligence
• large-language-model

Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.

• machine-learning
• deep-learning
• deep-reinforcement-learning
• machine-learning-from-scratch

How to create an OS from scratch

TranslatedList of personally collected books PDF download Baidu Cloud e-book download

🛠️⚡ Step-by-step tutorial to build a modern JavaScript stack.

• tutorial
• stack
• javascript
• react

Translated7 days golang programs from scratch (web framework Gee, distributed cache GeeCache, object relational mapping ORM framework GeeORM, rpc framework GeeRPC etc) A series on writing/implementing things from scratch in 7 days with Go

• learning
• starter-project
• golang
• scratch

llama3 implementation one matrix multiplication at a time

Bootstrap yourself to write an OS from scratch. A book for self-learner.

• operating-system
• book

Writing a sqlite clone from scratch in C

• database

Implementing a Neural Network from Scratch

Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.

• infra
• llm
• sglang
• cuda

Based on my own experience, I believe this roadmap provides clear answers to all the key questions about becoming a data analyst from scratch, including which technologies and programming languages to learn, what soft skills are essential, and how to start a professional career in this field.

• blogs
• businessintelligence
• courses
• data

Implementing LLM architectures from scratch in PyTorch

• gemma3
• llama4
• llm
• moe

Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning

• cli
• deep-learning
• education
• from-scratch

A foundational and practical guide for effectively learning and progressively building a blockchain from scratch in Go with gRPC

• blockchain
• blockchain-from-scratch
• concurrent-programming
• cryptography

TranslatedA basic tutorial for getting started with AI Agents from zero background. It is not just a tutorial but also an Agent that can run locally: read and write files, execute commands, MCP, long-term memory, with a built-in web interface to see every step clearly. Starting from a minimal 100-line loop, each lesson adds one capability, and in the end it breaks down mainstream Agents such as Claude Code and Codex

• agent
• ai-agent
• chinese
• claude-code

✅ Complete beginners tutorial building a todo list from scratch in Phoenix 1.7 (latest)

• elixir
• phoenix
• tutorial
• beginner

TranslatedBuild GPT-2 from scratch in PyTorch, step by step

• attention
• chinese
• deep-learning
• from-scratch