Concept · Building with AI

Benchmark

Also called: benchmarks, leaderboard, leaderboards, benchmark score, model comparison

A shared, public test used to score different models on the same tasks so they can be compared. A score on a benchmark may not predict how a model does on a company's own task.

For example: Two models score close together on a public coding benchmark. A team then runs its own evals on its own code to choose between them.

Connects to 7

Page last changed · Suggest a correction