Evals

Also called: eval, evaluation, evaluations, model evaluation, AI evaluation, test set

Tests that check whether the outputs of a model or an AI product meet the criteria its builders set. Teams run them to measure quality and to compare one version with the next.

For example: A team writes 50 sample customer questions with correct answers. After each change to the prompt, they run all 50 and count how many answers pass.