Lecture index
Karpathy’s lecture on the state of GPT
Intro to neural networks and backpropagation
Intro to language modeling: building makemore
Building makemore Part 2: MLP
Building makemore Part 3: Activations & Gradients, BatchNorm
Building makemore Part 4: Becoming a Backprop Ninja
Building makemore Part 5: Building a WaveNet
Let’s build GPT: from scratch, in code, spelled out.