Glossary · Math & training

Softmax

A function defined by `softmax(x_i) = exp(x_i) / sum(exp(x_j))`, implemented with numerical stabilization. Its outputs are positive and sum to one, so they can parameterize a categorical distribution.

Common confusion

Softmax values are not automatically calibrated probabilities about real-world correctness.

Related terms

Browse the learning paths to see this term in context — every lesson is free to read.