RAIER01-BP01 Validate that release criteria still align with current industry standards
At the start of a release evaluation, check that the release criteria and associated evaluation tests are still aligned with the current version of the AI system. Research and confirm that there are no new and relevant benchmarks or expectations that need to be included in the evaluation.
Level of risk exposed if this best practice is not established: Medium
Implementation considerations
-
Compare your current release criteria against the actual system features and capabilities you plan to release, looking for gaps or mismatches. If your system includes capabilities that were not considered when you last updated your criteria, consider adding appropriate evaluation tests to cover these new features. This includes revisiting your risk and benefit assessment if necessary.
-
Stay up to date with new benchmarks, evaluation methods, or industry standards to see if there are new ways to test your system against your release criteria.
-
Consider new guidelines, updated regulations, or emerging compliance-aligned frameworks that might affect what you need to test before release. Consult with your legal team to assess relevant regulatory considerations.
-
Cross-check your evaluation datasets and test cases to make sure they still match the real-world scenarios where your system will be used. If your intended use cases have changed or expanded, you may need to update your evaluation approach to reflect these new applications.
Resources
Related documents
Related videos:
Related examples:
Related tools
