Glossary · Math & training
Learning Rate
A scale factor used by an optimizer to control parameter-update magnitude. Values that are too large can destabilize training; values that are too small can make useful progress impractically slow.
Common confusion
The effective update also depends on the optimizer, schedule, gradient scale, batch, and parameter history.
Related terms
Browse the learning paths to see this term in context — every lesson is free to read.