This is the new CloudFormation Template Reference Guide. Please update your bookmarks and links. For help getting started with CloudFormation, see the AWS CloudFormation User Guide.
AWS::BedrockAgentCore::Evaluator
Specifies an evaluator for Amazon Bedrock AgentCore. An evaluator assesses agent quality using LLM-as-a-Judge configurations to measure and improve agent performance.
For more information, see Evaluate agent quality with Amazon Bedrock AgentCore.
See the Properties section below for descriptions of both the required and optional properties.
Syntax
To declare this entity in your CloudFormation template, use the following syntax:
JSON
{ "Type" : "AWS::BedrockAgentCore::Evaluator", "Properties" : { "Description" :String, "EvaluatorConfig" :EvaluatorConfig, "EvaluatorName" :String, "Level" :String, "Tags" :[ Tag, ... ]} }
YAML
Type: AWS::BedrockAgentCore::Evaluator Properties: Description:StringEvaluatorConfig:EvaluatorConfigEvaluatorName:StringLevel:StringTags:- Tag
Properties
Description-
The description of the evaluator.
Required: No
Type: String
Minimum:
1Maximum:
200Update requires: No interruption
EvaluatorConfig-
The configuration of the evaluator, including LLM-as-a-Judge settings for custom evaluators.
Required: Yes
Type: EvaluatorConfig
Update requires: No interruption
EvaluatorName-
The name of the evaluator.
Required: Yes
Type: String
Pattern:
^[a-zA-Z][a-zA-Z0-9_]{0,47}$Update requires: Replacement
Level-
The evaluation level (
TOOL_CALL,TRACE, orSESSION) that determines the scope of evaluation.Required: Yes
Type: String
Allowed values:
TOOL_CALL | TRACE | SESSIONUpdate requires: No interruption
-
The tags for the evaluator.
Required: No
Type: Array of Tag
Maximum:
50Update requires: No interruption
Return values
Ref
When you pass the logical ID of this resource to the intrinsic Ref function, Ref returns the ARN of the evaluator. For example:
arn:aws:bedrock-agentcore:us-east-1:123456789012:evaluator/EXAMPLE12345
For more information about using the Ref function, see Ref.
Fn::GetAtt
The Fn::GetAtt intrinsic function returns a value for a specified attribute of this type. The following are the available attributes and sample return values.
For more information about using the Fn::GetAtt intrinsic function, see Fn::GetAtt.
CreatedAt-
The timestamp when the evaluator was created.
EvaluatorArn-
The Amazon Resource Name (ARN) of the evaluator.
EvaluatorId-
The unique identifier of the evaluator.
Status-
The current status of the evaluator.
UpdatedAt-
The timestamp when the evaluator was last updated.