Concept · Building with AI
Overfitting
Also called: overfit, overfitted, underfitting, memorization
When a model learns its training examples too closely, including their quirks, and then performs poorly on new data. It is like memorizing practice test answers without understanding.
For example: A model fine-tuned on 50 support tickets repeats their exact wording and fails on questions phrased differently.
Connects to 4
- Training Concept
- Fine-tuning Concept
- Evals Concept
- Loss function Concept