This is the new CloudFormation Template Reference Guide. Please update your bookmarks and links. For help getting started with CloudFormation, see the AWS CloudFormation User Guide.
AWS::BedrockAgentCore::Evaluator LlmAsAJudgeEvaluatorConfig
The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.
Syntax
To declare this entity in your CloudFormation template, use the following syntax:
JSON
{ "Instructions" :String, "ModelConfig" :EvaluatorModelConfig, "RatingScale" :RatingScale}
YAML
Instructions:StringModelConfig:EvaluatorModelConfigRatingScale:RatingScale
Properties
Instructions-
The evaluation instructions that guide the language model in assessing agent performance, including criteria and evaluation guidelines.
Required: Yes
Type: String
Update requires: No interruption
ModelConfig-
The model configuration that specifies which foundation model to use and how to configure it for evaluation.
Required: Yes
Type: EvaluatorModelConfig
Update requires: No interruption
RatingScale-
The rating scale that defines how the evaluator should score agent performance, either numerical or categorical.
Required: Yes
Type: RatingScale
Update requires: No interruption
