promptfoo

Also called: prompt foo, Promptfoo

An open-source tool for testing prompts and AI apps. It runs many test cases and also probes for weaknesses such as prompt injection.

For example: A team runs promptfoo before each release to check that a prompt change did not break earlier answers.

Official site: promptfoo.dev

Connects to 7