interface InferenceConfigurationProperty
| Language | Type name |
|---|---|
 .NET | Amazon.CDK.CfnPropertyMixins.AWS.BedrockAgentCore.CfnEvaluatorPropsMixin.InferenceConfigurationProperty |
 Go | github.com/aws/aws-cdk-go/awscdkcfnpropertymixins/v2/awsbedrockagentcore#CfnEvaluatorPropsMixin_InferenceConfigurationProperty |
 Java | software.amazon.awscdk.cfnpropertymixins.services.bedrockagentcore.CfnEvaluatorPropsMixin.InferenceConfigurationProperty |
 Python | aws_cdk.cfn_property_mixins.aws_bedrockagentcore.CfnEvaluatorPropsMixin.InferenceConfigurationProperty |
 TypeScript | @aws-cdk/cfn-property-mixins » aws_bedrockagentcore » CfnEvaluatorPropsMixin » InferenceConfigurationProperty |
The inference configuration parameters that control model behavior during evaluation.
Example
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_bedrockagentcore as bedrockagentcore } from '@aws-cdk/cfn-property-mixins';
const inferenceConfigurationProperty: bedrockagentcore.CfnEvaluatorPropsMixin.InferenceConfigurationProperty = {
maxTokens: 123,
temperature: 123,
topP: 123,
};
Properties
| Name | Type | Description |
|---|---|---|
| max | number | The maximum number of tokens to generate in the model response. |
| temperature? | number | The temperature value that controls randomness in the model's responses. |
| top | number | The top-p sampling parameter that controls the diversity of the model's responses. |
maxTokens?
Type:
number
(optional)
The maximum number of tokens to generate in the model response.
temperature?
Type:
number
(optional)
The temperature value that controls randomness in the model's responses.
topP?
Type:
number
(optional)
The top-p sampling parameter that controls the diversity of the model's responses.