Glossary · Math & training

Mixed Precision

A numerical strategy that uses different data types for different operations, often lower precision for many matrix operations and higher precision for values that need more range or stability.

Common confusion

Speed, memory, and accuracy effects depend on hardware, data type, scaling method, kernels, and model. They are not a fixed multiplier.

Related terms

Browse the learning paths to see this term in context — every lesson is free to read.