Glossary · Math & training

Fine-tuning

Continuing training from pretrained parameters on a narrower dataset or objective. Depending on the method, you may update all parameters, selected parameters, or added adapter parameters.

Why it matters

Fine-tuning can adapt behavior, style, format, or task performance, but it is not a dependable replacement for retrieval when facts must stay current or traceable.

Common confusion

Fine-tuning can influence encoded knowledge, but it does not simply append records to a searchable database inside the model.

Related terms

Browse the learning paths to see this term in context — every lesson is free to read.