Glossary · Math & training
Normalization
A family of transformations that rescale or recenter inputs, activations, or features using defined statistics. Batch normalization and layer normalization use different axes and behave differently across training and inference.
Common confusion
Normalization can improve optimization stability, but it does not always permit a larger learning rate or improve every architecture.
Related terms
Browse the learning paths to see this term in context — every lesson is free to read.