The video loads from YouTube only after you press Play.
Let's build GPT: from scratch, in code, spelled out.
A 1.9-hour lecture by Andrej Karpathy about GPT, transformers and language modeling, on the AI shelf. A commenter in r/learnmachinelearning recommended it.
Andrej Karpathy, Lecture, 1 h 56 min, 2023, on the AI shelf
A step-by-step coding tutorial constructing a generative pretrained transformer.
About this record
This is the 2023 build-GPT tutorial, not the excluded reproduce GPT-2 (124M) tutorial.
