Concept · Building with AI
Benchmark
Also called: benchmarks, leaderboard, leaderboards, benchmark score, model comparison
A shared, public test used to score different models on the same tasks so they can be compared. A score on a benchmark may not predict how a model does on a company's own task.
For example: Two models score close together on a public coding benchmark. A team then runs its own evals on its own code to choose between them.
Connects to 7
- Evals Concept
- Model Concept
- Frontier model Concept
- Testing Concept
- Gen AI Evaluation Service Tool
- Artificial Analysis Tool
- LMArena Tool