Glossary · Math & training
Gradient
A vector of partial derivatives pointing in the direction of steepest increase. In ML, you go opposite to the gradient (gradient descent) to minimize the loss.
Common confusion
Optimizers can transform, average, clip, or adapt gradients instead of taking a plain negative-gradient step.
Related terms
Browse the learning paths to see this term in context — every lesson is free to read.