Glossary · Math & training
NaN (Not a Number)
A floating-point value representing an undefined or unrepresentable numerical result. In training, NaNs can come from invalid operations, overflow, unstable normalization, excessive updates, or earlier corrupted values.
In practice
Find the first non-finite tensor, inspect its inputs, and add assertions or anomaly detection near that operation.
Related terms
Browse the learning paths to see this term in context — every lesson is free to read.