Glossary · Math & training

Backpropagation

An efficient application of the chain rule that propagates derivatives from a scalar loss backward through a computation graph. It computes gradients; an optimizer uses those gradients to update parameters.

Common confusion

Backpropagation calculates gradients. It does not choose the update rule or learning rate.

Related terms

Browse the learning paths to see this term in context — every lesson is free to read.