TokenUsage
The tokens used in a message API inference call.
Contents
- inputTokens
-
The number of tokens sent in the request to the model.
Type: Integer
Valid Range: Minimum value of 0.
Required: Yes
- outputTokens
-
The number of tokens that the model generated for the request.
Type: Integer
Valid Range: Minimum value of 0.
Required: Yes
- totalTokens
-
The total of input tokens and tokens generated by the model.
Type: Integer
Valid Range: Minimum value of 0.
Required: Yes
- cacheDetails
-
Detailed breakdown of cache writes by TTL. Empty if no cache creation occurred. Sorted by TTL duration (1h before 5m).
Type: Array of CacheDetail objects
Required: No
- cacheReadInputTokens
-
The number of input tokens read from the cache for the request.
Type: Integer
Valid Range: Minimum value of 0.
Required: No
- cacheWriteInputTokens
-
The number of input tokens written to the cache for the request.
Type: Integer
Valid Range: Minimum value of 0.
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following:
