Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Repository Index
47,133 repositories indexed
1–14 of 14 · Most stars
Learn AI Engineering! Learn it. Build it. Ship it for others.
Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.
- machine-learning
- deep-learning
- deep-reinforcement-learning
- machine-learning-from-scratch
🛠️⚡ Step-by-step tutorial to build a modern JavaScript stack.
llama3 implementation one matrix multiplication at a time
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
- avx2
- c99
- cpu-inference
- deep-learning
Implementing a Neural Network from Scratch
Implementing LLM architectures from scratch in PyTorch
- gemma3
- llama4
- llm
- moe
Don't memorize ML. Understand it from first principles including Inference, Cuda, Deep Learning, Data Science and Reinforcement Learning
- cli
- deep-learning
- education
- from-scratch
A survivors roguelite running on a from-scratch World of Warcraft 1.12.1 client engine (Rust + Bevy).
A foundational and practical guide for effectively learning and progressively building a blockchain from scratch in Go with gRPC
- blockchain
- blockchain-from-scratch
- concurrent-programming
- cryptography
零基础入门大模型（LLM）的基础教程：从零手写 GPT-2，一行行看懂大模型是怎么工作的 | Build GPT-2 from scratch in PyTorch, step by step
- attention
- chinese
- deep-learning
- from-scratch
Apple Push Notifications (APNs) Server-Side library. A from-scratch Swift 6 rewrite of the original package. The public API (APNSClient) is a completely different, modern async/await surface
- swift
- ios-notifications
- ios
- server-side-swift
Machine learning compiler in Go. A from-scratch tinygrad port: graph-rewrite IR, autodiff as a compiler pass, zero-CGO WebGPU backend.
- autograd
- compiler
- deep-learning
- golang