AI safety

Also called: safe AI, responsible AI, AI risk, trustworthy AI

The work of making AI systems behave safely and of measuring how safe they are. The US standards agency NIST describes a safe AI system as one that does not endanger human life, health, property or the environment.

For example: Before launch, a team tests whether its support bot can be talked into giving medical advice. They add guardrails for the cases that fail.