Phase 19: Capstone Projects
AI From Scratch/Lesson 31/~90 minutes

Tokenized Dataset with Sliding Window

A pretraining run is a function from token ids to gradients. This lesson builds the conveyor that feeds the ids in.

BuildPython
Loading lesson page...