《Build a Large Language Model (From Scratch)》是一本深入探讨大语言模型原理与实现的电子书,适合希望深入了解 GPT 等大模型架构、训练过程及应用开发的学习者。为了让更多中文读者能够接触到这本极具价值的教材,我决定将其翻译成中文,并通过 GitHub 进行开源共享。
Repository Index
106,102 visible repositories in the index
121–144 of 521 · Most stars
Build a modern LLM from scratch. Every line commented. Explained like we are five.
- attention-mechanism
- deep-learning
- educational
- from-scratch
A collection of guides and examples for the Gemma open models from Google.
- codegemma
- gemma
- paligemma
- recurrentgemma
Learn RegEx step by step, from zero to advanced.
Notes from books and other interesting things that I've read. Table of contents at the end 👇
A list of useful resources to learn Data Engineering from scratch
- distributed-systems
- data-engineering
- data-pipeline
- cloud-providers
This GitHub repo is a powerhouse collection of scraping APIs for developers that you can start using immediately to build everything from simple automations to full-scale applications.
- api-library
- api-list
- scraping-api
- developer-api
Synapsa Commons: free, hands-on AI courses that run anywhere (Colab, Kaggle, Binder, Codespaces, Jupyter). EU AI Act conformity evidence, model validation, predictive maintenance, document extraction, retrieval and RAG, AI agents and MCP, a simulated humanoid. Every lesson autograded. From the team building Synapsa.
Code samples from the "Python Cookbook, 3rd Edition", published by O'Reilly & Associates, May, 2013.
The source code from the third edition of Effective Java, with minor additions as necessary to make it runnable.
Tutorials from ioscreator.com
These are the sample Bounded Contexts from the book "Implementing Domain-Driven Design" by Vaughn Vernon: http://vaughnvernon.co/?page_id=168
How I Scaled from Zero to a Million Store on Dukaan, Without a CS Degree. .. A System Design Handbook by Subhash Choudhary
- scaling
- system-design
Implementations from the free course Deep Reinforcement Learning with Tensorflow and PyTorch
- deep-reinforcement-learning
- qlearning
- deep-learning
- tensorflow-tutorials
Example code from Learning Spark book
A comprehensive, step-by-step guide to mastering cybersecurity from beginner to expert level with curated resources, tools, and career guidance
- cybersecurity
- cybersecurity-education
- cybersecurity-projects
- cybersecurity-tools
Jupyter notebooks from the scikit-learn video series
CDN Up and Running - Building a CDN from Scratch to Learn about CDN, Nginx, Lua, Prometheus, Grafana, Load balancing, and Containers.
From Chain-of-Thought prompting to OpenAI o1 and DeepSeek-R1 🍓
- language-models
- reasoning
- prompt
- in-context-learning
🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.
从零编写游戏引擎教程 Writing a game engine tutorial from scratch
- 3d-engine
- game-development
- blender-python
- toolbag
Pearls of wisdom for programmers collected from leading practitioners.
From UI Proposal to Code :notes::arrow_forward:
Building a modern functional compiler from first principles.
- compiler
- lambda-calculus
- type-inference
- haskell