Glossary · Math & training

Loss Function

An objective that maps predictions and targets, sometimes with regularization terms, to a value optimization tries to reduce. The loss determines which errors training directly rewards or penalizes.

Common confusion

A low training loss does not guarantee useful, safe, or generalizable behavior on production tasks.

Related terms

Browse the learning paths to see this term in context — every lesson is free to read.