PromptModelInferenceConfigurationProperty Struct
Contains inference configurations related to model inference for a prompt.
For more information, see Inference parameters .
Example
ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_bedrock as bedrock } from 'aws-cdk-lib';
const promptModelInferenceConfigurationProperty: bedrock.CfnPrompt.PromptModelInferenceConfigurationProperty = {
maxTokens: 123,
stopSequences: ['stopSequences'],
temperature: 123,
topP: 123,
};
Properties
maxTokensoptionalnumbermax_tokensoptionalint | floatmaxTokensoptionalNumberMaxTokensoptionaldoubleMaxTokensoptional*float64#The maximum number of tokens to return in the response.
stopSequencesoptionalstring[]stop_sequencesoptionaltyping.List[str]stopSequencesoptionalList<String>StopSequencesoptionalstring[]StopSequencesoptional*[]*string#A list of strings that define sequences after which the model will stop generating.
temperatureoptionalnumbertemperatureoptionalint | floattemperatureoptionalNumberTemperatureoptionaldoubleTemperatureoptional*float64#Controls the randomness of the response.
Choose a lower value for more predictable outputs and a higher value for more surprising outputs.
The percentage of most-likely candidates that the model considers for the next token.