AWS::BedrockAgentCore::Evaluator - AWS CloudFormation

This is the new CloudFormation Template Reference Guide. Please update your bookmarks and links. For help getting started with CloudFormation, see the AWS CloudFormation User Guide.

AWS::BedrockAgentCore::Evaluator

Specifies an evaluator for Amazon Bedrock AgentCore. An evaluator assesses agent quality using LLM-as-a-Judge configurations to measure and improve agent performance.

For more information, see Evaluate agent quality with Amazon Bedrock AgentCore.

See the Properties section below for descriptions of both the required and optional properties.

Syntax

To declare this entity in your CloudFormation template, use the following syntax:

JSON

{ "Type" : "AWS::BedrockAgentCore::Evaluator", "Properties" : { "Description" : String, "EvaluatorConfig" : EvaluatorConfig, "EvaluatorName" : String, "Level" : String, "Tags" : [ Tag, ... ] } }

YAML

Type: AWS::BedrockAgentCore::Evaluator Properties: Description: String EvaluatorConfig: EvaluatorConfig EvaluatorName: String Level: String Tags: - Tag

Properties

Description

The description of the evaluator.

Required: No

Type: String

Minimum: 1

Maximum: 200

Update requires: No interruption

EvaluatorConfig

The configuration of the evaluator, including LLM-as-a-Judge settings for custom evaluators.

Required: Yes

Type: EvaluatorConfig

Update requires: No interruption

EvaluatorName

The name of the evaluator.

Required: Yes

Type: String

Pattern: ^[a-zA-Z][a-zA-Z0-9_]{0,47}$

Update requires: Replacement

Level

The evaluation level (TOOL_CALL, TRACE, or SESSION) that determines the scope of evaluation.

Required: Yes

Type: String

Allowed values: TOOL_CALL | TRACE | SESSION

Update requires: No interruption

Tags

The tags for the evaluator.

Required: No

Type: Array of Tag

Maximum: 50

Update requires: No interruption

Return values

Ref

When you pass the logical ID of this resource to the intrinsic Ref function, Ref returns the ARN of the evaluator. For example:

arn:aws:bedrock-agentcore:us-east-1:123456789012:evaluator/EXAMPLE12345

For more information about using the Ref function, see Ref.

Fn::GetAtt

The Fn::GetAtt intrinsic function returns a value for a specified attribute of this type. The following are the available attributes and sample return values.

For more information about using the Fn::GetAtt intrinsic function, see Fn::GetAtt.

CreatedAt

The timestamp when the evaluator was created.

EvaluatorArn

The Amazon Resource Name (ARN) of the evaluator.

EvaluatorId

The unique identifier of the evaluator.

Status

The current status of the evaluator.

UpdatedAt

The timestamp when the evaluator was last updated.