CountTokensRequest Class | AWS SDK for .NET Version 4

Container for the parameters to the CountTokens operation. Returns the token count for a given inference request. This operation helps you estimate token usage before sending requests to foundation models by returning the token count that would be used if the same input were sent to the model in an inference request.

Token counting is model-specific because different models use different tokenization strategies. The token count returned by this operation will match the token count that would be charged if the same input were sent to the model in an InvokeModel or Converse request.

You can use this operation to:

Estimate costs before sending inference requests.
Optimize prompts to fit within token limits.
Plan for token usage in your applications.

This operation accepts the same input formats as InvokeModel and Converse, allowing you to count tokens for both raw text inputs and structured conversation formats.

The following operations are related to CountTokens:

InvokeModel - Sends inference requests to foundation models
Converse - Sends conversation-based inference requests to foundation models

Inheritance Hierarchy

System.Object
  Amazon.Runtime.AmazonWebServiceRequest
    Amazon.BedrockRuntime.AmazonBedrockRuntimeRequest
      Amazon.BedrockRuntime.Model.CountTokensRequest

Namespace: Amazon.BedrockRuntime.Model
Assembly: AWSSDK.BedrockRuntime.dll
Version: 3.x.y.z

Syntax

public class CountTokensRequest : AmazonBedrockRuntimeRequest
         IAmazonWebServiceRequest

The CountTokensRequest type exposes the following members

Constructors

	Name	Description
	CountTokensRequest()

Properties

Name Type Description

	Name	Type	Description
	Input	Amazon.BedrockRuntime.Model.CountTokensInput	Gets and sets the property Input. The input for which to count tokens. The structure of this parameter depends on whether you're counting tokens for an `InvokeModel` or `Converse` request: For `InvokeModel` requests, provide the request body in the `invokeModel` field For `Converse` requests, provide the messages and system content in the `converse` field The input format must be compatible with the model specified in the `modelId` parameter.
	ModelId	System.String	Gets and sets the property ModelId. The unique identifier or ARN of the foundation model to use for token counting. Each model processes tokens differently, so the token count is specific to the model you specify.

Input

Amazon.BedrockRuntime.Model.CountTokensInput

Gets and sets the property Input.

The input for which to count tokens. The structure of this parameter depends on whether you're counting tokens for an InvokeModel or Converse request:

For InvokeModel requests, provide the request body in the invokeModel field
For Converse requests, provide the messages and system content in the converse field

The input format must be compatible with the model specified in the modelId parameter.

ModelId

System.String

Gets and sets the property ModelId.

The unique identifier or ARN of the foundation model to use for token counting. Each model processes tokens differently, so the token count is specific to the model you specify.

Version Information

.NET:
Supported in: 8.0 and newer, Core 3.1

.NET Standard:
Supported in: 2.0

.NET Framework:
Supported in: 4.7.2 and newer