Glossary · Math & training
Weight
A trainable coefficient in a model transformation. Weights are usually organized into tensors, and optimization adjusts them to reduce the training objective.
Common confusion
Not every parameter is called a weight; biases, embeddings, and normalization scales are parameters too.
Related terms
Browse the learning paths to see this term in context — every lesson is free to read.