# PromptModelInferenceConfigurationProperty

Contains inference configurations related to model inference for a prompt.

For more information, see [Inference parameters](https://docs.aws.amazon.com/bedrock/latest/userguide/inference-parameters.html) .

- Source: Generated code
- Type last changed: v2.166.0 · 7 Nov 2024

## Example

```ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_bedrock as bedrock } from 'aws-cdk-lib';
const promptModelInferenceConfigurationProperty: bedrock.CfnPrompt.PromptModelInferenceConfigurationProperty = {
  maxTokens: 123,
  stopSequences: ['stopSequences'],
  temperature: 123,
  topP: 123,
};
```

## Properties

- `maxTokens`: number — The maximum number of tokens to return in the response.

- `stopSequences`: string[] — A list of strings that define sequences after which the model will stop generating.

- `temperature`: number — Controls the randomness of the response.

  Choose a lower value for more predictable outputs and a higher value for more surprising outputs.

- `topP`: number — The percentage of most-likely candidates that the model considers for the next token.