Numerical Stability

Floating point is a leaky abstraction. It will bite you during training, and you will not see it coming.