Built-in evaluators
Built-in evaluators in AgentCore AgentCore Evaluations provide pre-configured evaluator for assessing your agents. These evaluators use predefined evaluator models and prompt templates that have been optimized for common evaluation scenarios.
You can use built-in evaluators with both online and on-demand evaluations. To specify a
built-in evaluator, use its ID in the following format: Builtin.EvaluatorName,
such as Builtin.Helpfulness.
Note
Built-in evaluator configurations, including their evaluator models and prompt templates, cannot be modified.
