Phase 10: LLMs from Scratch
AI From Scratch/Lesson 22/~60 minutes

Async and Hogwild! Inference

Speculative decoding (Phase 10 · 15) parallelizes tokens within one sequence. Multi-agent frameworks parallelize across whole sequences but force explicit coordination (voting, sub-task splitting). Hogwild! Inference (Rodionov et al., arXi...

BuildPython (stdlib)
Loading lesson page...