Glossary · Models & inference
Parameter
A value learned during training, commonly a weight, bias, embedding element, or normalization parameter. Parameter count is one measure of model capacity, but it does not directly determine quality, memory, or serving cost.
Common confusion
Memory per parameter depends on numerical format, quantization metadata, sharding, optimizer state, activations, and runtime overhead.
Related terms
Browse the learning paths to see this term in context — every lesson is free to read.