Glossary · Models & inference

Inductive Bias

Structural or statistical assumptions that favor some functions or representations over others. Convolution favors locality and shared filters; causal masking favors prediction from preceding positions.

Common confusion

Transformers still have inductive biases through tokenization, position handling, masking, architecture, data, and objective.

Related terms

CNN (Convolutional Neural Network)
Transformer
Feature

Browse the learning paths to see this term in context — every lesson is free to read.