Package software.amazon.awscdk.services.bedrockagentcore

Class BuiltinEvaluator

java.lang.Object
software.amazon.jsii.JsiiObject
software.amazon.awscdk.services.bedrockagentcore.BuiltinEvaluator
All Implemented Interfaces:
software.amazon.jsii.JsiiSerializable
@Generated(value="jsii-pacmak/1.130.0 (build 048a5ee)", date="2026-05-19T19:44:36.920Z") @Stability(Stable) public class BuiltinEvaluator extends software.amazon.jsii.JsiiObject
Built-in evaluators provided by Amazon Bedrock AgentCore.

These evaluators assess different aspects of agent performance at various levels (session, trace, or tool call).

Example: 

 Evaluator customEvaluator;
 OnlineEvaluationConfig evaluation = OnlineEvaluationConfig.Builder.create(this, "MixedEvaluation")
         .onlineEvaluationConfigName("mixed_evaluation")
         .evaluators(List.of(EvaluatorSelector.builtin(BuiltinEvaluator.HELPFULNESS), EvaluatorSelector.builtin(BuiltinEvaluator.CORRECTNESS), EvaluatorSelector.custom(customEvaluator)))
         .dataSource(DataSourceConfig.fromCloudWatchLogs(CloudWatchLogsDataSourceConfig.builder()
                 .logGroupNames(List.of("/aws/bedrock-agentcore/my-agent"))
                 .serviceNames(List.of("my-agent.default"))
                 .build()))
         .build();

  • Field Details

    • COHERENCE

      @Stability(Stable) public static final BuiltinEvaluator COHERENCE
      Evaluates whether the response is logically structured and coherent.

    • CONCISENESS

      @Stability(Stable) public static final BuiltinEvaluator CONCISENESS
      Evaluates whether the response is appropriately brief without missing key information.

    • CORRECTNESS

      @Stability(Stable) public static final BuiltinEvaluator CORRECTNESS
      Evaluates whether the information in the agent's response is factually accurate.

    • FAITHFULNESS

      @Stability(Stable) public static final BuiltinEvaluator FAITHFULNESS
      Evaluates whether information in the response is supported by provided context/sources.

    • GOAL_SUCCESS_RATE

      @Stability(Stable) public static final BuiltinEvaluator GOAL_SUCCESS_RATE
      Evaluates whether the conversation successfully meets the user's goals.

    • HARMFULNESS

      @Stability(Stable) public static final BuiltinEvaluator HARMFULNESS
      Evaluates whether the response contains harmful content.

    • HELPFULNESS

      @Stability(Stable) public static final BuiltinEvaluator HELPFULNESS
      Evaluates from user's perspective how useful and valuable the agent's response is.

    • INSTRUCTION_FOLLOWING

      @Stability(Stable) public static final BuiltinEvaluator INSTRUCTION_FOLLOWING
      Measures how well the agent follows the provided system instructions.

    • REFUSAL

      @Stability(Stable) public static final BuiltinEvaluator REFUSAL
      Detects when agent evades questions or directly refuses to answer.

    • RESPONSE_RELEVANCE

      @Stability(Stable) public static final BuiltinEvaluator RESPONSE_RELEVANCE
      Evaluates whether the response appropriately addresses the user's query.

    • STEREOTYPING

      @Stability(Stable) public static final BuiltinEvaluator STEREOTYPING
      Detects content that makes generalizations about individuals or groups.

    • TOOL_PARAMETER_ACCURACY

      @Stability(Stable) public static final BuiltinEvaluator TOOL_PARAMETER_ACCURACY
      Evaluates how accurately the agent extracts parameters from user queries.

    • TOOL_SELECTION_ACCURACY

      @Stability(Stable) public static final BuiltinEvaluator TOOL_SELECTION_ACCURACY
      Evaluates whether the agent selected the appropriate tool for the task.

  • Constructor Details

    • BuiltinEvaluator

      protected BuiltinEvaluator(software.amazon.jsii.JsiiObjectRef objRef)

    • BuiltinEvaluator

      protected BuiltinEvaluator(software.amazon.jsii.JsiiObject.InitializationMode initializationMode)

    • BuiltinEvaluator

      @Stability(Stable) public BuiltinEvaluator(@NotNull String value)
      Parameters:
      value -
      • The evaluator identifier string.
      This parameter is required.

  • Method Details

    • getValue

      @Stability(Stable) @NotNull public String getValue()
      The string value of the built-in evaluator.