Glossary · Models & inference

Temperature

A decoding parameter that rescales logits before a probability distribution is formed. Higher positive values usually flatten the distribution; lower positive values sharpen it.

Why it matters

Temperature changes sampling behavior, not the model's knowledge or factuality.

Common confusion

A zero setting is often implemented as greedy decoding, but exact behavior and determinism depend on the provider, sampler, seed support, and serving system.

Related terms

Browse the learning paths to see this term in context — every lesson is free to read.