AI From Scratch/Phase 12/Lesson 13/~180 minutes

Transfusion: Autoregressive Text + Diffusion Image in One Transformer

Build

Chameleon and Emu3 bet everything on discrete tokens. They work, but the quantization bottleneck is visible — the image quality plateaus below continuous-space diffusion models. Transfusion (Meta, Zhou et al., August 2024) takes the opposi...

Loading lesson page...