AI From Scratch/Phase 04/Lesson 18/~45 minutes

Open-Vocabulary Vision — CLIP

Build + UsePythonNo prerequisites

Train an image encoder and a text encoder together so that matching (image, caption) pairs land at the same point in a shared space. That is the whole trick.

Loading lesson page...