SampleTokenUsage
The token usage statistics for a sample generation.
Contents
- decode
-
The number of tokens generated (decode phase).
Type: Integer
Required: Yes
- prefill
-
The number of tokens in the input prompt (prefill phase).
Type: Integer
Required: Yes
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following:
