Calculus for Machine Learning

Derivatives tell you which way is downhill. That is all a neural network needs to learn.