# Gen AI Evaluation Service

Tool · [Standard tools and platforms](https://ecosystem.samcarlton.com/tools)

Also called: Gen AI evaluation, Vertex AI evaluation, GenAI Evaluation Service

A part of [Google Cloud](https://ecosystem.samcarlton.com/gcp)'s [Gemini Enterprise Agent Platform](https://ecosystem.samcarlton.com/vertex-ai), formerly Vertex AI, that scores the outputs of [AI models](https://ecosystem.samcarlton.com/model) against criteria a team sets, so they can compare models and [prompts](https://ecosystem.samcarlton.com/prompt).

**For example:** A team runs the Gen AI Evaluation Service on 200 sample questions to see whether a new [prompt](https://ecosystem.samcarlton.com/prompt) gives better answers.

Official site: <https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/evaluation-overview>

## Connects to (5)

- [Evals](https://ecosystem.samcarlton.com/evals): Tests that check whether the outputs of a model or an AI product meet the criteria its builders set.
- [Benchmark](https://ecosystem.samcarlton.com/benchmark): A shared, public test used to score different models on the same tasks so they can be compared.
- [Vertex AI](https://ecosystem.samcarlton.com/vertex-ai): Google Cloud's platform for building, running and evaluating AI models and agents in a business setting, with access to Gemini and other…
- [promptfoo](https://ecosystem.samcarlton.com/promptfoo): An open-source tool for testing prompts and AI apps.
- [Gemini Prompt Optimizer](https://ecosystem.samcarlton.com/gemini-prompt-optimizer): A Google Cloud tool that rewrites a prompt's instructions and tests the versions against examples to find one that scores better.

Map view: https://ecosystem.samcarlton.com/gen-ai-evaluation-service