AI From Scratch/Phase 10/Lesson 01/~90 minutes

Tokenizers: BPE, WordPiece, SentencePiece

BuildPython

Your LLM does not read English. It reads integers. The tokenizer decides whether those integers carry meaning or waste it.

Loading lesson page...