Glossary · Math & training

Gradient Descent

A family of optimization updates that move parameters using the negative gradient of an objective, usually estimated from batches rather than the entire dataset.

Related terms

Browse the learning paths to see this term in context — every lesson is free to read.