SampleResponse
The response containing generated samples and optional log-probabilities.
Contents
- sequences
-
The list of generated sequences.
Type: Array of SampledSequence objects
Required: Yes
- promptLogprobs
-
The per-token log-probabilities for the input prompt. Populated only when
includePromptLogprobsis true.Type: Array of doubles
Required: No
- topkPromptLogprobs
-
The top-k log-probabilities per prompt token, as a list of lists. Populated only when
topkPromptLogprobsis greater than 0.Type: Array of arrays of TokenLogprob objects
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following: