RAIUC04-BP02 Identify human oversight opportunities
Place human review at points where the quality of system inputs or outputs can be harder to judge. Consider moments where human expertise adds unique value or assists with consequential decisions.
Level of risk exposed if this best practice is not established: High
Implementation considerations
-
Review the user journey to find moments where errors could have significant consequences, or where human expertise is uniquely valuable. Create user interface elements and workflows that make human oversight natural and efficient, providing the right information at the right time for effective decision-making.
-
Identify requirements to assist human reviewers, such as system output explanations and contributing factors, confidence scores, similar case examples, and other information needed for informed oversight decisions.
Resources
Related documents:
-
ISO/IEC 42001:2023
A.6.2.6 AI system operation and monitoring
