Glossary · Math & training
Batch Size
The number of examples whose losses contribute to one gradient estimate before an optimizer update. Larger batches can improve hardware utilization and reduce gradient noise, but they require more memory and may need different learning-rate or scheduling choices.
Common confusion
There is no universal batch-size range or rule that says every batch increase should produce the same learning-rate increase.
Related terms
Browse the learning paths to see this term in context — every lesson is free to read.