interface InferenceConfigurationProperty
| Language | Type name |
|---|---|
 .NET | Amazon.CDK.AWS.BedrockAgentCore.CfnEvaluator.InferenceConfigurationProperty |
 Go | github.com/aws/aws-cdk-go/awscdk/v2/awsbedrockagentcore#CfnEvaluator_InferenceConfigurationProperty |
 Java | software.amazon.awscdk.services.bedrockagentcore.CfnEvaluator.InferenceConfigurationProperty |
 Python | aws_cdk.aws_bedrockagentcore.CfnEvaluator.InferenceConfigurationProperty |
 TypeScript | aws-cdk-lib » aws_bedrockagentcore » CfnEvaluator » InferenceConfigurationProperty |
The inference configuration parameters that control model behavior during evaluation.
Example
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_bedrockagentcore as bedrockagentcore } from 'aws-cdk-lib';
const inferenceConfigurationProperty: bedrockagentcore.CfnEvaluator.InferenceConfigurationProperty = {
maxTokens: 123,
temperature: 123,
topP: 123,
};
Properties
| Name | Type | Description |
|---|---|---|
| max | number | The maximum number of tokens to generate in the model response. |
| temperature? | number | The temperature value that controls randomness in the model's responses. |
| top | number | The top-p sampling parameter that controls the diversity of the model's responses. |
maxTokens?
Type:
number
(optional)
The maximum number of tokens to generate in the model response.
temperature?
Type:
number
(optional)
The temperature value that controls randomness in the model's responses.
topP?
Type:
number
(optional)
The top-p sampling parameter that controls the diversity of the model's responses.