Skip to content

Bedrock AgentCore Control  >  Unions  >  EvaluatorConfig

EvaluatorConfig

Union Type

EvaluatorConfig module-attribute 

EvaluatorConfig = Union[EvaluatorConfigLlmAsAJudge | EvaluatorConfigCodeBased | EvaluatorConfigDerived | EvaluatorConfigUnknown]

The configuration that defines how an evaluator assesses agent performance, including the evaluation method and parameters.

Union Member Types

EvaluatorConfigLlmAsAJudge dataclass

The LLM-as-a-Judge configuration that uses a language model to evaluate agent performance based on custom instructions and rating scales.

Attributes

value instance-attribute 
value: LlmAsAJudgeEvaluatorConfig

EvaluatorConfigCodeBased dataclass

Configuration for a code-based evaluator that uses a customer-managed Lambda function to programmatically assess agent performance.

Attributes

value instance-attribute 
value: CodeBasedEvaluatorConfig

EvaluatorConfigDerived dataclass

The configuration for an evaluator derived from an existing base evaluator (a built-in or third-party evaluator), run on your own model. The base evaluator supplies the prompt and scoring.

Attributes

value instance-attribute 
value: DerivedEvaluatorConfig

EvaluatorConfigUnknown dataclass

Represents an unknown variant.

If you receive this value, you will need to update your library to receive the parsed value.

This value may not be deliberately sent.

Attributes

tag instance-attribute 
tag: str