Glossary · Models & inference
Perplexity
The exponentiated average negative log-likelihood under a stated tokenization and logarithm convention. Lower values mean the model assigned higher probability to the evaluated sequence.
Common confusion
Perplexity is not comparable across different tokenizers or evaluation setups and does not directly measure factuality or usefulness.
Related terms
Browse the learning paths to see this term in context — every lesson is free to read.