InvokeModelTokensRequest
class InvokeModelTokensRequest
The body of an InvokeModel API request for token counting. This structure mirrors the input format for the InvokeModel operation, allowing you to count tokens for raw text inference requests.
Types
Properties
Link copied to clipboard
The request body to count tokens for, formatted according to the model's expected input format. To learn about the input format for different models, see Model inference parameters and responses.