# promptfoo

Tool · [Standard tools and platforms](https://ecosystem.samcarlton.com/tools)

Also called: prompt foo, Promptfoo

An [open-source](https://ecosystem.samcarlton.com/open-source) tool for [testing](https://ecosystem.samcarlton.com/testing) [prompts](https://ecosystem.samcarlton.com/prompt) and AI apps. It runs many test cases and also probes for weaknesses such as [prompt injection](https://ecosystem.samcarlton.com/prompt-injection).

**For example:** A team runs promptfoo before each [release](https://ecosystem.samcarlton.com/deployment) to check that a [prompt](https://ecosystem.samcarlton.com/prompt) change did not break earlier answers.

Official site: <https://www.promptfoo.dev>

## Connects to (7)

- [Evals](https://ecosystem.samcarlton.com/evals): Tests that check whether the outputs of a model or an AI product meet the criteria its builders set.
- [Prompt injection](https://ecosystem.samcarlton.com/prompt-injection): A security weakness in AI products.
- [Testing](https://ecosystem.samcarlton.com/testing): Checking that software does what it should, before your users find the problems for you.
- [Open source](https://ecosystem.samcarlton.com/open-source): Software whose code is published for anyone to read, use and build on, under a license that sets the rules for doing so.
- [Braintrust](https://ecosystem.samcarlton.com/braintrust): A platform for evaluating and monitoring AI products.
- [Ground truth](https://ecosystem.samcarlton.com/ground-truth): The verified, correct answers or facts that an AI system's output is checked against.
- [Gen AI Evaluation Service](https://ecosystem.samcarlton.com/gen-ai-evaluation-service): A part of Google Cloud's Gemini Enterprise Agent Platform, formerly Vertex AI, that scores the outputs of AI models against criteria a…

Map view: https://ecosystem.samcarlton.com/promptfoo