# Set up a model invocation resource using inference profiles Inference profiles *Inference profiles* are a resource in Amazon Bedrock that define a model and one or more Regions to which the inference profile can route model invocation requests. You can use inference profiles for the following tasks: + **Track usage metrics** – Set up CloudWatch logs and submit model invocation requests with an application inference profile to collect usage metrics for model invocation. You can examine these metrics when you view information about the inference profile and use them to inform your decisions. For more information about how to set up CloudWatch logs, see [Monitor model invocation using CloudWatch Logs and Amazon S3](model-invocation-logging.md). + **Use tags to monitor costs** – Attach tags to an application inference profile to track costs when you submit on-demand model invocation requests. For more information on how to use tags for cost allocation, see [Organizing and tracking costs using AWS cost allocation tags](https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html) in the AWS Billing user guide. + **Cross-Region inference** – Increase your throughput by using an inference profile that includes multiple AWS Regions. The inference profile will distribute model invocation requests across these Regions to increase throughput and performance. For more information about cross-Region inference, see [Increase throughput with cross-Region inference](cross-region-inference.md). Amazon Bedrock offers the following types of inference profiles: + **Cross Region (system-defined) inference profiles** – Inference profiles that are predefined in Amazon Bedrock and include multiple Regions to which requests for a model can be routed. + **Application inference profiles** – Inference profiles that a user creates to track costs and model usage. You can create an inference profile that routes model invocation requests to one Region or to multiple Regions: + To create an inference profile that tracks costs and usage for a model in one Region, specify the foundation model in the Region to which you want the inference profile to route requests. + To create an inference profile that tracks costs and usage for a model across multiple Regions, specify the cross Region (system-defined) inference profile that defines the model and Regions to which you want the inference profile to route requests. You can use inference profiles with the following features to route requests to multiple Regions and to track usage and cost for invocation requests made with these features: + Model inference – Use an inference profile when running model invocation by choosing an inference profile in a playground in the Amazon Bedrock console, or by specifying the ARN of the inference profile when calling the [InvokeModel](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModel.html), [InvokeModelWithResponseStream](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModelWithResponseStream.html), [Converse](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html), and [ConverseStream](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_ConverseStream.html) operations. For more information, see [Submit prompts and generate responses with model inference](inference.md). + Knowledge base vector embedding and response generation – Use an inference profile when generating a response after querying a knowledge base or when parsing non-textual information in a data source. For more information, see [Test your knowledge base with queries and responses](knowledge-base-test.md) and [Parsing options for your data source](kb-advanced-parsing.md). + Model evaluation – You can submit an inference profile as a model to evaluate when submitting a model evaluation job. For more information, see [Evaluate the performance of Amazon Bedrock resources](evaluation.md). + Prompt management – You can use an inference profile when generating a response for a prompt you created in Prompt management. For more information, see [Construct and store reusable prompts with Prompt management in Amazon Bedrock](prompt-management.md) + Flows – You can use an inference profile when generating a response for a prompt you define inline in a prompt node in a flow. For more information, see [Build an end-to-end generative AI workflow with Amazon Bedrock Flows](flows.md). The price for using an inference profile is calculated based on the price of the model in the Region from which you call the inference profile. For information about pricing, see [Amazon Bedrock pricing](https://aws.amazon.com/bedrock/pricing/). For more details about the throughput that a cross-Region inference profile can offer, see [Increase throughput with cross-Region inference](cross-region-inference.md). **Topics** + [ # Supported Regions and models for inference profiles ](inference-profiles-support.md) + [ # Prerequisites for inference profiles ](inference-profiles-prereq.md) + [ # Create an application inference profile ](inference-profiles-create.md) + [ # Modify the tags for an application inference profile ](inference-profiles-modify.md) + [ # View information about an inference profile ](inference-profiles-view.md) + [ # Use an inference profile in model invocation ](inference-profiles-use.md) + [ # Delete an application inference profile ](inference-profiles-delete.md) # Supported Regions and models for inference profiles Supported Regions and models For a list of Region codes and endpoints supported in Amazon Bedrock, see [Amazon Bedrock endpoints and quotas](https://docs.aws.amazon.com/general/latest/gr/bedrock.html#bedrock_region). This topic describes predefined inference profiles that you can use and the Regions and models that support application inference profiles. **Topics** + [ ## Supported cross-Region inference profiles ](#inference-profiles-support-system) + [ ## Supported Regions and models for application inference profiles ](#inference-profiles-support-user) ## Supported cross-Region inference profiles You can carry out [cross-Region inference](cross-region-inference.md) with cross-Region (system-defined) inference profiles. Cross-Region inference allows you to seamlessly manage unplanned traffic bursts by utilizing compute across different AWS Regions. With cross-Region inference, you can distribute traffic across multiple AWS Regions. Cross-region (system-defined) inference profiles are named after the model that they support and defined by the Regions that they support. To understand how a cross-region inference profile handles your requests, review the following definitions: + **Source Region** – The Region from which you make the API request that specifies the inference profile. + **Destination Region** – A Region to which the Amazon Bedrock service can route the request from your source Region. When you invoke a cross-Region inference profile in Amazon Bedrock, your request originates from a source Region and is automatically routed to one of the destination Regions defined in that profile, optimizing for performance. The destination Regions for Global cross-Region inference profiles include all commercial Regions. **Note** The destination Regions in a cross-Region inference profile can include *opt-in Regions*, which are Regions that you must explicitly enable at AWS account or Organization level. To learn more, see [Enable or disable AWS Regions in your account](https://docs.aws.amazon.com/accounts/latest/reference/manage-acct-regions.html). When using a cross-Region inference profile, your inference request can be routed to any of the destination Regions in the profile, even if you did not opt-in to such Regions in your account. Service Control Policies (SCPs) and AWS Identity and Access Management (IAM) policies work together to control where cross-Region inference is allowed. Using SCPs, you can control which Regions Amazon Bedrock can use for inference, and using IAM policies, you can define which users or roles have permission to run inference. If any destination Region in a cross-Region inference profile is blocked in your SCPs, the request will fail even if other Regions remain allowed. To ensure efficient operation with cross-region inference, you can update your SCPs and IAM policies to allow all required Amazon Bedrock inference actions (for example, `bedrock:InvokeModel*` or `bedrock:CreateModelInvocationJob`) in all destination Regions included in your chosen inference profile. To learn more, see [Enabling Amazon Bedrock cross-Region inference in multi-account environments.](https://aws.amazon.com/blogs/machine-learning/enable-amazon-bedrock-cross-region-inference-in-multi-account-environments/) **Note** Some inference profiles route to different destination Regions depending on the source Region from which you call it. For example, if you call `us.anthropic.claude-3-haiku-20240307-v1:0` from US East (Ohio), it can route requests to `us-east-1`, `us-east-2`, or `us-west-2`, but if you call it from US West (Oregon), it can route requests to only `us-east-1` and `us-west-2`. To check the source and destination Regions for an inference profile, you can do one of the following: + Expand the corresponding section in the [list of supported cross-region inference profiles](#inference-profiles-support). + Send a [GetInferenceProfile](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_GetInferenceProfile.html) request with an [Amazon Bedrock control plane endpoint](https://docs.aws.amazon.com/general/latest/gr/bedrock.html#br-cp) from a source Region and specify the Amazon Resource Name (ARN) or ID of the inference profile in the `inferenceProfileIdentifier` field. The `models` field in the response maps to a list of model ARNs, in which you can identify each destination Region. **Note** Global cross-Region inference profile for a specific model can change over time as AWS adds more commercial Regions where your requests can be processed. However, if an inference profile is tied to a geography (such as US, EU, or APAC), its destination Region list will never change. AWS might create new inference profiles that incorporate new Regions. You can update your systems to use these inference profiles by changing the IDs in your setup to the new ones. The Global cross-region inference profile is currently only supported on Anthropic Claude Sonnet 4 model for the following source Regions: US West (Oregon), US East (N. Virginia), US East (Ohio), Europe (Ireland), and Asia Pacific (Tokyo). The destination Regions for Global inference profile include all commercial AWS Regions. Expand one of the following sections to see information about a cross-Region inference profile, the source Regions from which it can be called, and the destination Regions to which it can route requests. ### GLOBAL Amazon Nova 2 Lite To call the GLOBAL Amazon Nova 2 Lite inference profile, specify the following inference profile ID in one of the source Regions: ``` global.amazon.nova-2-lite-v1:0 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-east-2 | Commercial AWS Regions ap-east-2 | | ap-northeast-1 | Commercial AWS Regions ap-northeast-1 | | ap-northeast-2 | Commercial AWS Regions ap-northeast-2 | | ap-south-1 | Commercial AWS Regions ap-south-1 | | ap-southeast-1 | Commercial AWS Regions ap-southeast-1 | | ap-southeast-2 | Commercial AWS Regions ap-southeast-2 | | ap-southeast-3 | Commercial AWS Regions ap-southeast-3 | | ap-southeast-4 | Commercial AWS Regions ap-southeast-4 | | ap-southeast-5 | Commercial AWS Regions ap-southeast-5 | | ap-southeast-7 | Commercial AWS Regions ap-southeast-7 | | ca-central-1 | Commercial AWS Regions ca-central-1 | | ca-west-1 | Commercial AWS Regions ca-west-1 | | eu-central-1 | Commercial AWS Regions eu-central-1 | | eu-north-1 | Commercial AWS Regions eu-north-1 | | eu-south-1 | Commercial AWS Regions eu-south-1 | | eu-south-2 | Commercial AWS Regions eu-south-2 | | eu-west-1 | Commercial AWS Regions eu-west-1 | | eu-west-2 | Commercial AWS Regions eu-west-2 | | eu-west-3 | Commercial AWS Regions eu-west-3 | | il-central-1 | Commercial AWS Regions il-central-1 | | me-central-1 | Commercial AWS Regions me-central-1 | | us-east-1 | Commercial AWS Regions us-east-1 | | us-east-2 | Commercial AWS Regions us-east-2 | | us-west-1 | Commercial AWS Regions us-west-1 | | us-west-2 | Commercial AWS Regions us-west-2 | ### GLOBAL Anthropic Claude Opus 4.5 To call the GLOBAL Anthropic Claude Opus 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` global.anthropic.claude-opus-4-5-20251101-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | af-south-1 | Commercial AWS Regions af-south-1 | | ap-east-2 | Commercial AWS Regions ap-east-2 | | ap-northeast-1 | Commercial AWS Regions ap-northeast-1 | | ap-northeast-2 | Commercial AWS Regions ap-northeast-2 | | ap-northeast-3 | Commercial AWS Regions ap-northeast-3 | | ap-south-1 | Commercial AWS Regions ap-south-1 | | ap-south-2 | Commercial AWS Regions ap-south-2 | | ap-southeast-1 | Commercial AWS Regions ap-southeast-1 | | ap-southeast-2 | Commercial AWS Regions ap-southeast-2 | | ap-southeast-3 | Commercial AWS Regions ap-southeast-3 | | ap-southeast-4 | Commercial AWS Regions ap-southeast-4 | | ap-southeast-5 | Commercial AWS Regions ap-southeast-5 | | ap-southeast-7 | Commercial AWS Regions ap-southeast-7 | | ca-central-1 | Commercial AWS Regions ca-central-1 | | ca-west-1 | Commercial AWS Regions ca-west-1 | | eu-central-1 | Commercial AWS Regions eu-central-1 | | eu-central-2 | Commercial AWS Regions eu-central-2 | | eu-north-1 | Commercial AWS Regions eu-north-1 | | eu-south-1 | Commercial AWS Regions eu-south-1 | | eu-south-2 | Commercial AWS Regions eu-south-2 | | eu-west-1 | Commercial AWS Regions eu-west-1 | | eu-west-2 | Commercial AWS Regions eu-west-2 | | eu-west-3 | Commercial AWS Regions eu-west-3 | | il-central-1 | Commercial AWS Regions il-central-1 | | me-central-1 | Commercial AWS Regions me-central-1 | | me-south-1 | Commercial AWS Regions me-south-1 | | mx-central-1 | Commercial AWS Regions mx-central-1 | | sa-east-1 | Commercial AWS Regions sa-east-1 | | us-east-1 | Commercial AWS Regions us-east-1 | | us-east-2 | Commercial AWS Regions us-east-2 | | us-west-1 | Commercial AWS Regions us-west-1 | | us-west-2 | Commercial AWS Regions us-west-2 | ### GLOBAL TwelveLabs Pegasus v1.2 To call the GLOBAL TwelveLabs Pegasus v1.2 inference profile, specify the following inference profile ID in one of the source Regions: ``` global.twelvelabs.pegasus-1-2-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-pegasus.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | af-south-1 | Commercial AWS Regions af-south-1 | | ap-east-2 | Commercial AWS Regions ap-east-2 | | ap-northeast-1 | Commercial AWS Regions ap-northeast-1 | | ap-northeast-2 | Commercial AWS Regions ap-northeast-2 | | ap-northeast-3 | Commercial AWS Regions ap-northeast-3 | | ap-south-1 | Commercial AWS Regions ap-south-1 | | ap-south-2 | Commercial AWS Regions ap-south-2 | | ap-southeast-1 | Commercial AWS Regions ap-southeast-1 | | ap-southeast-2 | Commercial AWS Regions ap-southeast-2 | | ap-southeast-3 | Commercial AWS Regions ap-southeast-3 | | ap-southeast-4 | Commercial AWS Regions ap-southeast-4 | | ap-southeast-5 | Commercial AWS Regions ap-southeast-5 | | ap-southeast-7 | Commercial AWS Regions ap-southeast-7 | | ca-central-1 | Commercial AWS Regions ca-central-1 | | ca-west-1 | Commercial AWS Regions ca-west-1 | | eu-central-1 | Commercial AWS Regions eu-central-1 | | eu-central-2 | Commercial AWS Regions eu-central-2 | | eu-north-1 | Commercial AWS Regions eu-north-1 | | eu-south-1 | Commercial AWS Regions eu-south-1 | | eu-south-2 | Commercial AWS Regions eu-south-2 | | eu-west-1 | Commercial AWS Regions eu-west-1 | | eu-west-2 | Commercial AWS Regions eu-west-2 | | eu-west-3 | Commercial AWS Regions eu-west-3 | | il-central-1 | Commercial AWS Regions il-central-1 | | me-central-1 | Commercial AWS Regions me-central-1 | | me-south-1 | Commercial AWS Regions me-south-1 | | mx-central-1 | Commercial AWS Regions mx-central-1 | | sa-east-1 | Commercial AWS Regions sa-east-1 | | us-east-1 | Commercial AWS Regions us-east-1 | | us-east-2 | Commercial AWS Regions us-east-2 | | us-west-1 | Commercial AWS Regions us-west-1 | | us-west-2 | Commercial AWS Regions us-west-2 | ### Global Anthropic Claude Haiku 4.5 To call the Global Anthropic Claude Haiku 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` global.anthropic.claude-haiku-4-5-20251001-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | af-south-1 | Commercial AWS Regions af-south-1 | | ap-east-2 | Commercial AWS Regions ap-east-2 | | ap-northeast-1 | Commercial AWS Regions ap-northeast-1 | | ap-northeast-2 | Commercial AWS Regions ap-northeast-2 | | ap-northeast-3 | Commercial AWS Regions ap-northeast-3 | | ap-south-1 | Commercial AWS Regions ap-south-1 | | ap-south-2 | Commercial AWS Regions ap-south-2 | | ap-southeast-1 | Commercial AWS Regions ap-southeast-1 | | ap-southeast-2 | Commercial AWS Regions ap-southeast-2 | | ap-southeast-3 | Commercial AWS Regions ap-southeast-3 | | ap-southeast-4 | Commercial AWS Regions ap-southeast-4 | | ap-southeast-5 | Commercial AWS Regions ap-southeast-5 | | ap-southeast-7 | Commercial AWS Regions ap-southeast-7 | | ca-central-1 | Commercial AWS Regions ca-central-1 | | ca-west-1 | Commercial AWS Regions ca-west-1 | | eu-central-1 | Commercial AWS Regions eu-central-1 | | eu-central-2 | Commercial AWS Regions eu-central-2 | | eu-north-1 | Commercial AWS Regions eu-north-1 | | eu-south-1 | Commercial AWS Regions eu-south-1 | | eu-south-2 | Commercial AWS Regions eu-south-2 | | eu-west-1 | Commercial AWS Regions eu-west-1 | | eu-west-2 | Commercial AWS Regions eu-west-2 | | eu-west-3 | Commercial AWS Regions eu-west-3 | | il-central-1 | Commercial AWS Regions il-central-1 | | me-central-1 | Commercial AWS Regions me-central-1 | | me-south-1 | Commercial AWS Regions me-south-1 | | mx-central-1 | Commercial AWS Regions mx-central-1 | | sa-east-1 | Commercial AWS Regions sa-east-1 | | us-east-1 | Commercial AWS Regions us-east-1 | | us-east-2 | Commercial AWS Regions us-east-2 | | us-west-1 | Commercial AWS Regions us-west-1 | | us-west-2 | Commercial AWS Regions us-west-2 | ### Global Anthropic Claude Opus 4.6 To call the Global Anthropic Claude Opus 4.6 inference profile, specify the following inference profile ID in one of the source Regions: ``` global.anthropic.claude-opus-4-6-v1 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | af-south-1 | Commercial AWS Regions af-south-1 | | ap-east-2 | Commercial AWS Regions ap-east-2 | | ap-northeast-1 | Commercial AWS Regions ap-northeast-1 | | ap-northeast-2 | Commercial AWS Regions ap-northeast-2 | | ap-northeast-3 | Commercial AWS Regions ap-northeast-3 | | ap-south-1 | Commercial AWS Regions ap-south-1 | | ap-south-2 | Commercial AWS Regions ap-south-2 | | ap-southeast-1 | Commercial AWS Regions ap-southeast-1 | | ap-southeast-2 | Commercial AWS Regions ap-southeast-2 | | ap-southeast-3 | Commercial AWS Regions ap-southeast-3 | | ap-southeast-4 | Commercial AWS Regions ap-southeast-4 | | ap-southeast-5 | Commercial AWS Regions ap-southeast-5 | | ap-southeast-7 | Commercial AWS Regions ap-southeast-7 | | ca-central-1 | Commercial AWS Regions ca-central-1 | | ca-west-1 | Commercial AWS Regions ca-west-1 | | eu-central-1 | Commercial AWS Regions eu-central-1 | | eu-central-2 | Commercial AWS Regions eu-central-2 | | eu-north-1 | Commercial AWS Regions eu-north-1 | | eu-south-1 | Commercial AWS Regions eu-south-1 | | eu-south-2 | Commercial AWS Regions eu-south-2 | | eu-west-1 | Commercial AWS Regions eu-west-1 | | eu-west-2 | Commercial AWS Regions eu-west-2 | | eu-west-3 | Commercial AWS Regions eu-west-3 | | il-central-1 | Commercial AWS Regions il-central-1 | | me-central-1 | Commercial AWS Regions me-central-1 | | me-south-1 | Commercial AWS Regions me-south-1 | | mx-central-1 | Commercial AWS Regions mx-central-1 | | sa-east-1 | Commercial AWS Regions sa-east-1 | | us-east-1 | Commercial AWS Regions us-east-1 | | us-east-2 | Commercial AWS Regions us-east-2 | | us-west-1 | Commercial AWS Regions us-west-1 | | us-west-2 | Commercial AWS Regions us-west-2 | ### Global Anthropic Claude Sonnet 4.6 To call the Global Anthropic Claude Sonnet 4.6 inference profile, specify the following inference profile ID in one of the source Regions: ``` global.anthropic.claude-sonnet-4-6 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | af-south-1 | Commercial AWS Regions af-south-1 | | ap-east-2 | Commercial AWS Regions ap-east-2 | | ap-northeast-1 | Commercial AWS Regions ap-northeast-1 | | ap-northeast-2 | Commercial AWS Regions ap-northeast-2 | | ap-northeast-3 | Commercial AWS Regions ap-northeast-3 | | ap-south-1 | Commercial AWS Regions ap-south-1 | | ap-south-2 | Commercial AWS Regions ap-south-2 | | ap-southeast-1 | Commercial AWS Regions ap-southeast-1 | | ap-southeast-2 | Commercial AWS Regions ap-southeast-2 | | ap-southeast-3 | Commercial AWS Regions ap-southeast-3 | | ap-southeast-4 | Commercial AWS Regions ap-southeast-4 | | ap-southeast-5 | Commercial AWS Regions ap-southeast-5 | | ap-southeast-7 | Commercial AWS Regions ap-southeast-7 | | ca-central-1 | Commercial AWS Regions ca-central-1 | | ca-west-1 | Commercial AWS Regions ca-west-1 | | eu-central-1 | Commercial AWS Regions eu-central-1 | | eu-central-2 | Commercial AWS Regions eu-central-2 | | eu-north-1 | Commercial AWS Regions eu-north-1 | | eu-south-1 | Commercial AWS Regions eu-south-1 | | eu-south-2 | Commercial AWS Regions eu-south-2 | | eu-west-1 | Commercial AWS Regions eu-west-1 | | eu-west-2 | Commercial AWS Regions eu-west-2 | | eu-west-3 | Commercial AWS Regions eu-west-3 | | il-central-1 | Commercial AWS Regions il-central-1 | | me-central-1 | Commercial AWS Regions me-central-1 | | me-south-1 | Commercial AWS Regions me-south-1 | | mx-central-1 | Commercial AWS Regions mx-central-1 | | sa-east-1 | Commercial AWS Regions sa-east-1 | | us-east-1 | Commercial AWS Regions us-east-1 | | us-east-2 | Commercial AWS Regions us-east-2 | | us-west-1 | Commercial AWS Regions us-west-1 | | us-west-2 | Commercial AWS Regions us-west-2 | ### Global Claude Sonnet 4 To call the Global Claude Sonnet 4 inference profile, specify the following inference profile ID in one of the source Regions: ``` global.anthropic.claude-sonnet-4-20250514-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | Commercial AWS Regions ap-northeast-1 | | eu-west-1 | Commercial AWS Regions eu-west-1 | | us-east-1 | Commercial AWS Regions us-east-1 | | us-east-2 | Commercial AWS Regions us-east-2 | | us-west-2 | Commercial AWS Regions us-west-2 | ### Global Claude Sonnet 4.5 To call the Global Claude Sonnet 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` global.anthropic.claude-sonnet-4-5-20250929-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | af-south-1 | Commercial AWS Regions af-south-1 | | ap-east-2 | Commercial AWS Regions ap-east-2 | | ap-northeast-1 | Commercial AWS Regions ap-northeast-1 | | ap-northeast-2 | Commercial AWS Regions ap-northeast-2 | | ap-northeast-3 | Commercial AWS Regions ap-northeast-3 | | ap-south-1 | Commercial AWS Regions ap-south-1 | | ap-south-2 | Commercial AWS Regions ap-south-2 | | ap-southeast-1 | Commercial AWS Regions ap-southeast-1 | | ap-southeast-2 | Commercial AWS Regions ap-southeast-2 | | ap-southeast-3 | Commercial AWS Regions ap-southeast-3 | | ap-southeast-4 | Commercial AWS Regions ap-southeast-4 | | ap-southeast-5 | Commercial AWS Regions ap-southeast-5 | | ap-southeast-7 | Commercial AWS Regions ap-southeast-7 | | ca-central-1 | Commercial AWS Regions ca-central-1 | | ca-west-1 | Commercial AWS Regions ca-west-1 | | eu-central-1 | Commercial AWS Regions eu-central-1 | | eu-central-2 | Commercial AWS Regions eu-central-2 | | eu-north-1 | Commercial AWS Regions eu-north-1 | | eu-south-1 | Commercial AWS Regions eu-south-1 | | eu-south-2 | Commercial AWS Regions eu-south-2 | | eu-west-1 | Commercial AWS Regions eu-west-1 | | eu-west-2 | Commercial AWS Regions eu-west-2 | | eu-west-3 | Commercial AWS Regions eu-west-3 | | il-central-1 | Commercial AWS Regions il-central-1 | | me-central-1 | Commercial AWS Regions me-central-1 | | me-south-1 | Commercial AWS Regions me-south-1 | | mx-central-1 | Commercial AWS Regions mx-central-1 | | sa-east-1 | Commercial AWS Regions sa-east-1 | | us-east-1 | Commercial AWS Regions us-east-1 | | us-east-2 | Commercial AWS Regions us-east-2 | | us-west-1 | Commercial AWS Regions us-west-1 | | us-west-2 | Commercial AWS Regions us-west-2 | ### Global Cohere Embed v4 To call the Global Cohere Embed v4 inference profile, specify the following inference profile ID in one of the source Regions: ``` global.cohere.embed-v4:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-embed.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | Commercial AWS Regions ap-northeast-1 | | ap-northeast-2 | Commercial AWS Regions ap-northeast-2 | | ap-northeast-3 | Commercial AWS Regions ap-northeast-3 | | ap-south-1 | Commercial AWS Regions ap-south-1 | | ap-south-2 | Commercial AWS Regions ap-south-2 | | ap-southeast-1 | Commercial AWS Regions ap-southeast-1 | | ap-southeast-2 | Commercial AWS Regions ap-southeast-2 | | ap-southeast-3 | Commercial AWS Regions ap-southeast-3 | | ap-southeast-4 | Commercial AWS Regions ap-southeast-4 | | ca-central-1 | Commercial AWS Regions ca-central-1 | | eu-central-1 | Commercial AWS Regions eu-central-1 | | eu-central-2 | Commercial AWS Regions eu-central-2 | | eu-north-1 | Commercial AWS Regions eu-north-1 | | eu-south-1 | Commercial AWS Regions eu-south-1 | | eu-south-2 | Commercial AWS Regions eu-south-2 | | eu-west-1 | Commercial AWS Regions eu-west-1 | | eu-west-2 | Commercial AWS Regions eu-west-2 | | eu-west-3 | Commercial AWS Regions eu-west-3 | | sa-east-1 | Commercial AWS Regions sa-east-1 | | us-east-1 | Commercial AWS Regions us-east-1 | | us-east-2 | Commercial AWS Regions us-east-2 | | us-west-1 | Commercial AWS Regions us-west-1 | | us-west-2 | Commercial AWS Regions us-west-2 | ### US Amazon Nova 2 Lite To call the US Amazon Nova 2 Lite inference profile, specify the following inference profile ID in one of the source Regions: ``` us.amazon.nova-2-lite-v1:0 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ca-central-1 | ca-central-1 us-east-1 us-east-2 us-west-2 | | ca-west-1 | ca-west-1 us-east-1 us-east-2 us-west-2 | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Anthropic Claude 3 Haiku To call the US Anthropic Claude 3 Haiku inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-3-haiku-20240307-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-west-2 | ### US Anthropic Claude 3 Opus To call the US Anthropic Claude 3 Opus inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-3-opus-20240229-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-west-2 | | us-west-2 | us-east-1 us-west-2 | ### US Anthropic Claude 3 Sonnet To call the US Anthropic Claude 3 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-3-sonnet-20240229-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-west-2 | | us-west-2 | us-east-1 us-west-2 | ### US Anthropic Claude 3.5 Haiku To call the US Anthropic Claude 3.5 Haiku inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-3-5-haiku-20241022-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Anthropic Claude 3.5 Sonnet To call the US Anthropic Claude 3.5 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-3-5-sonnet-20240620-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-west-2 | | us-east-2 | us-east-1 us-west-2 | | us-west-2 | us-east-1 us-west-2 | ### US Anthropic Claude 3.5 Sonnet v2 To call the US Anthropic Claude 3.5 Sonnet v2 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-3-5-sonnet-20241022-v2:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Anthropic Claude 3.7 Sonnet To call the US Anthropic Claude 3.7 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-3-7-sonnet-20250219-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Anthropic Claude Haiku 4.5 To call the US Anthropic Claude Haiku 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-haiku-4-5-20251001-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ca-central-1 | ca-central-1 us-east-1 us-east-2 us-west-2 | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Anthropic Claude Opus 4.5 To call the US Anthropic Claude Opus 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-opus-4-5-20251101-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ca-central-1 | ca-central-1 us-east-1 us-east-2 us-west-2 | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Anthropic Claude Opus 4.6 To call the US Anthropic Claude Opus 4.6 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-opus-4-6-v1 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ca-central-1 | ca-central-1 us-east-1 us-east-2 us-west-2 | | ca-west-1 | ca-west-1 us-east-1 us-east-2 us-west-2 | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Anthropic Claude Sonnet 4.5 To call the US Anthropic Claude Sonnet 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-sonnet-4-5-20250929-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ca-central-1 | ca-central-1 us-east-1 us-east-2 us-west-2 | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Anthropic Claude Sonnet 4.6 To call the US Anthropic Claude Sonnet 4.6 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-sonnet-4-6 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ca-central-1 | ca-central-1 us-east-1 us-east-2 us-west-2 | | ca-west-1 | ca-west-1 us-east-1 us-east-2 us-west-2 | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Claude Opus 4 To call the US Claude Opus 4 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-opus-4-20250514-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Claude Opus 4.1 To call the US Claude Opus 4.1 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-opus-4-1-20250805-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Claude Sonnet 4 To call the US Claude Sonnet 4 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.anthropic.claude-sonnet-4-20250514-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Cohere Embed v4 To call the US Cohere Embed v4 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.cohere.embed-v4:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-embed.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US DeepSeek-R1 To call the US DeepSeek-R1 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.deepseek.r1-v1:0 ``` For more information about inference parameters for this model, see [Link](https://www.deepseek.com/). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Llama 4 Maverick 17B Instruct To call the US Llama 4 Maverick 17B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama4-maverick-17b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Llama 4 Scout 17B Instruct To call the US Llama 4 Scout 17B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama4-scout-17b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Meta Llama 3.1 70B Instruct To call the US Meta Llama 3.1 70B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama3-1-70b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Meta Llama 3.1 8B Instruct To call the US Meta Llama 3.1 8B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama3-1-8b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Meta Llama 3.1 Instruct 405B To call the US Meta Llama 3.1 Instruct 405B inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama3-1-405b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-2 | us-east-1 us-east-2 us-west-2 | ### US Meta Llama 3.2 11B Instruct To call the US Meta Llama 3.2 11B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama3-2-11b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-west-2 | ### US Meta Llama 3.2 1B Instruct To call the US Meta Llama 3.2 1B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama3-2-1b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-west-2 | ### US Meta Llama 3.2 3B Instruct To call the US Meta Llama 3.2 3B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama3-2-3b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-west-2 | ### US Meta Llama 3.2 90B Instruct To call the US Meta Llama 3.2 90B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama3-2-90b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-west-2 | ### US Meta Llama 3.3 70B Instruct To call the US Meta Llama 3.3 70B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` us.meta.llama3-3-70b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Mistral Pixtral Large 25.02 To call the US Mistral Pixtral Large 25.02 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.mistral.pixtral-large-2502-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-mistral.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Nova Lite To call the US Nova Lite inference profile, specify the following inference profile ID in one of the source Regions: ``` us.amazon.nova-lite-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Nova Micro To call the US Nova Micro inference profile, specify the following inference profile ID in one of the source Regions: ``` us.amazon.nova-micro-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Nova Premier To call the US Nova Premier inference profile, specify the following inference profile ID in one of the source Regions: ``` us.amazon.nova-premier-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Nova Pro To call the US Nova Pro inference profile, specify the following inference profile ID in one of the source Regions: ``` us.amazon.nova-pro-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Pegasus v1.2 To call the US Pegasus v1.2 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.twelvelabs.pegasus-1-2-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-pegasus.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Conservative Upscale To call the US Stable Image Conservative Upscale inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-conservative-upscale-v1:0 ``` For more information about inference parameters for this model, see [Link](stable-image-services.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Control Sketch To call the US Stable Image Control Sketch inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-image-control-sketch-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-stability-diffusion.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Control Structure To call the US Stable Image Control Structure inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-image-control-structure-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-stability-diffusion.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Creative Upscale To call the US Stable Image Creative Upscale inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-creative-upscale-v1:0 ``` For more information about inference parameters for this model, see [Link](stable-image-services.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Erase Object To call the US Stable Image Erase Object inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-image-erase-object-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-stability-diffusion.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Fast Upscale To call the US Stable Image Fast Upscale inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-fast-upscale-v1:0 ``` For more information about inference parameters for this model, see [Link](stable-image-services.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Inpaint To call the US Stable Image Inpaint inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-image-inpaint-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-stability-diffusion.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Outpaint To call the US Stable Image Outpaint inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-outpaint-v1:0 ``` For more information about inference parameters for this model, see [Link](stable-image-services.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Remove Background To call the US Stable Image Remove Background inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-image-remove-background-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-stability-diffusion.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Search and Recolor To call the US Stable Image Search and Recolor inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-image-search-recolor-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-stability-diffusion.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Search and Replace To call the US Stable Image Search and Replace inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-image-search-replace-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-stability-diffusion.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Style Guide To call the US Stable Image Style Guide inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-image-style-guide-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-stability-diffusion.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Stable Image Style Transfer To call the US Stable Image Style Transfer inference profile, specify the following inference profile ID in one of the source Regions: ``` us.stability.stable-style-transfer-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-stability-diffusion.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US TwelveLabs Marengo Embed 3.0 To call the US TwelveLabs Marengo Embed 3.0 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.twelvelabs.marengo-embed-3-0-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-marengo.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | ### US TwelveLabs Marengo Embed v2.7 To call the US TwelveLabs Marengo Embed v2.7 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.twelvelabs.marengo-embed-2-7-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-marengo.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-1 us-west-2 | ### US Writer Palmyra X4 To call the US Writer Palmyra X4 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.writer.palmyra-x4-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-writer-palmyra.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US Writer Palmyra X5 To call the US Writer Palmyra X5 inference profile, specify the following inference profile ID in one of the source Regions: ``` us.writer.palmyra-x5-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-writer-palmyra.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-east-1 | us-east-1 us-east-2 us-west-2 | | us-east-2 | us-east-1 us-east-2 us-west-2 | | us-west-1 | us-east-1 us-east-2 us-west-1 us-west-2 | | us-west-2 | us-east-1 us-east-2 us-west-2 | ### US-GOV Claude 3 Haiku To call the US-GOV Claude 3 Haiku inference profile, specify the following inference profile ID in one of the source Regions: ``` us-gov.anthropic.claude-3-haiku-20240307-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-gov-east-1 | us-gov-east-1 us-gov-west-1 | ### US-GOV Claude 3.5 Sonnet To call the US-GOV Claude 3.5 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` us-gov.anthropic.claude-3-5-sonnet-20240620-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-gov-east-1 | us-gov-east-1 us-gov-west-1 | ### US-GOV Claude 3.7 Sonnet To call the US-GOV Claude 3.7 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` us-gov.anthropic.claude-3-7-sonnet-20250219-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-gov-east-1 | us-gov-east-1 us-gov-west-1 | ### US-GOV Claude Sonnet 4.5 To call the US-GOV Claude Sonnet 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` us-gov.anthropic.claude-sonnet-4-5-20250929-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | us-gov-east-1 | us-gov-west-1 | | us-gov-west-1 | us-gov-west-1 | ### APAC Anthropic Claude 3 Haiku To call the APAC Anthropic Claude 3 Haiku inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.anthropic.claude-3-haiku-20240307-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-south-1 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-1 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-2 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | ### APAC Anthropic Claude 3 Sonnet To call the APAC Anthropic Claude 3 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.anthropic.claude-3-sonnet-20240229-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-south-1 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-1 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-2 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | ### APAC Anthropic Claude 3.5 Sonnet To call the APAC Anthropic Claude 3.5 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.anthropic.claude-3-5-sonnet-20240620-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-south-1 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-1 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-2 | ap-northeast-1 ap-northeast-2 ap-south-1 ap-southeast-1 ap-southeast-2 | ### APAC Anthropic Claude 3.5 Sonnet v2 To call the APAC Anthropic Claude 3.5 Sonnet v2 inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.anthropic.claude-3-5-sonnet-20241022-v2:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-northeast-3 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-south-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-south-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 | | ap-southeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | ### APAC Anthropic Claude 3.7 Sonnet To call the APAC Anthropic Claude 3.7 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.anthropic.claude-3-7-sonnet-20250219-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 | | ap-northeast-3 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 | | ap-south-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 | | ap-south-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 | | ap-southeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 | | ap-southeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 | ### APAC Claude Sonnet 4 To call the APAC Claude Sonnet 4 inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.anthropic.claude-sonnet-4-20250514-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-east-2 | ap-east-2 ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 | | ap-northeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-northeast-3 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-south-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-south-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-southeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-southeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-southeast-3 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 | | ap-southeast-4 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-southeast-5 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 ap-southeast-5 | | ap-southeast-7 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 ap-southeast-7 | | me-central-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 me-central-1 | ### APAC Nova Lite To call the APAC Nova Lite inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.amazon.nova-lite-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-east-2 | ap-east-2 ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 | | ap-northeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-south-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-3 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 | | ap-southeast-4 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-southeast-5 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 ap-southeast-5 | | ap-southeast-7 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 ap-southeast-7 | | me-central-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 me-central-1 | ### APAC Nova Micro To call the APAC Nova Micro inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.amazon.nova-micro-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-east-2 | ap-east-2 ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 | | ap-northeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-south-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-3 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 | | ap-southeast-5 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 ap-southeast-5 | | ap-southeast-7 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 ap-southeast-7 | | me-central-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 me-central-1 | ### APAC Nova Pro To call the APAC Nova Pro inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.amazon.nova-pro-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-east-2 | ap-east-2 ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 | | ap-northeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-south-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-southeast-1 ap-southeast-2 | | ap-southeast-3 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 | | ap-southeast-4 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | | ap-southeast-5 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 ap-southeast-5 | | ap-southeast-7 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 ap-southeast-7 | | me-central-1 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 me-central-1 | ### APAC Pegasus v1.2 To call the APAC Pegasus v1.2 inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.twelvelabs.pegasus-1-2-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-pegasus.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-4 | ### APAC TwelveLabs Marengo Embed v2.7 To call the APAC TwelveLabs Marengo Embed v2.7 inference profile, specify the following inference profile ID in one of the source Regions: ``` apac.twelvelabs.marengo-embed-2-7-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-marengo.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-2 | ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-south-1 ap-south-2 ap-southeast-1 ap-southeast-2 ap-southeast-3 ap-southeast-4 | ### AU AU Anthropic Claude Sonnet 4.5 To call the AU AU Anthropic Claude Sonnet 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` au.anthropic.claude-sonnet-4-5-20250929-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-southeast-2 | ap-southeast-2 ap-southeast-4 | | ap-southeast-4 | ap-southeast-2 ap-southeast-4 | ### AU Anthropic Claude Haiku 4.5 To call the AU Anthropic Claude Haiku 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` au.anthropic.claude-haiku-4-5-20251001-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-southeast-2 | ap-southeast-2 ap-southeast-4 | | ap-southeast-4 | ap-southeast-2 ap-southeast-4 | ### AU Anthropic Claude Opus 4.6 To call the AU Anthropic Claude Opus 4.6 inference profile, specify the following inference profile ID in one of the source Regions: ``` au.anthropic.claude-opus-4-6-v1 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-southeast-2 | ap-southeast-2 ap-southeast-4 | | ap-southeast-4 | ap-southeast-2 ap-southeast-4 | ### AU Anthropic Claude Sonnet 4.6 To call the AU Anthropic Claude Sonnet 4.6 inference profile, specify the following inference profile ID in one of the source Regions: ``` au.anthropic.claude-sonnet-4-6 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-southeast-2 | ap-southeast-2 ap-southeast-4 | | ap-southeast-4 | ap-southeast-2 ap-southeast-4 | ### CA Nova Lite To call the CA Nova Lite inference profile, specify the following inference profile ID in one of the source Regions: ``` ca.amazon.nova-lite-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ca-central-1 | ca-central-1 ca-west-1 | | ca-west-1 | ca-central-1 ca-west-1 | ### EU Amazon Nova 2 Lite To call the EU Amazon Nova 2 Lite inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.amazon.nova-2-lite-v1:0 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### EU Anthropic Claude 3 Haiku To call the EU Anthropic Claude 3 Haiku inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-3-haiku-20240307-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-west-1 eu-west-3 | ### EU Anthropic Claude 3 Sonnet To call the EU Anthropic Claude 3 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-3-sonnet-20240229-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-west-1 eu-west-3 | ### EU Anthropic Claude 3.5 Sonnet To call the EU Anthropic Claude 3.5 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-3-5-sonnet-20240620-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-west-1 eu-west-3 | ### EU Anthropic Claude 3.7 Sonnet To call the EU Anthropic Claude 3.7 Sonnet inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-3-7-sonnet-20250219-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | ### EU Anthropic Claude Haiku 4.5 To call the EU Anthropic Claude Haiku 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-haiku-4-5-20251001-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-central-2 | eu-central-1 eu-central-2 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-2 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### EU Anthropic Claude Opus 4.5 To call the EU Anthropic Claude Opus 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-opus-4-5-20251101-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-central-2 | eu-central-1 eu-central-2 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-2 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### EU Anthropic Claude Opus 4.6 To call the EU Anthropic Claude Opus 4.6 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-opus-4-6-v1 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-central-2 | eu-central-1 eu-central-2 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-2 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### EU Anthropic Claude Sonnet 4.5 To call the EU Anthropic Claude Sonnet 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-sonnet-4-5-20250929-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-central-2 | eu-central-1 eu-central-2 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-2 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### EU Anthropic Claude Sonnet 4.6 To call the EU Anthropic Claude Sonnet 4.6 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-sonnet-4-6 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-central-2 | eu-central-1 eu-central-2 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-2 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### EU Claude Sonnet 4 To call the EU Claude Sonnet 4 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.anthropic.claude-sonnet-4-20250514-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | il-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 il-central-1 | ### EU Cohere Embed v4 To call the EU Cohere Embed v4 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.cohere.embed-v4:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-embed.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### EU Meta Llama 3.2 1B Instruct To call the EU Meta Llama 3.2 1B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.meta.llama3-2-1b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-west-1 eu-west-3 | ### EU Meta Llama 3.2 3B Instruct To call the EU Meta Llama 3.2 3B Instruct inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.meta.llama3-2-3b-instruct-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-meta.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-west-1 eu-west-3 | ### EU Mistral Pixtral Large 25.02 To call the EU Mistral Pixtral Large 25.02 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.mistral.pixtral-large-2502-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-mistral.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | ### EU Nova Lite To call the EU Nova Lite inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.amazon.nova-lite-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | il-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-west-1 eu-west-3 il-central-1 | ### EU Nova Micro To call the EU Nova Micro inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.amazon.nova-micro-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | il-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-west-1 eu-west-3 il-central-1 | ### EU Nova Pro To call the EU Nova Pro inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.amazon.nova-pro-v1:0 ``` For more information about inference parameters for this model, see [Link](https://docs.aws.amazon.com/nova/latest/userguide/getting-started-schema.html). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-west-1 eu-west-3 | | il-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-west-1 eu-west-3 il-central-1 | ### EU TwelveLabs Marengo Embed 3.0 To call the EU TwelveLabs Marengo Embed 3.0 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.twelvelabs.marengo-embed-3-0-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-marengo.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### EU TwelveLabs Marengo Embed v2.7 To call the EU TwelveLabs Marengo Embed v2.7 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.twelvelabs.marengo-embed-2-7-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-marengo.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### EU TwelveLabs Pegasus v1.2 To call the EU TwelveLabs Pegasus v1.2 inference profile, specify the following inference profile ID in one of the source Regions: ``` eu.twelvelabs.pegasus-1-2-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-pegasus.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | eu-central-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-central-2 | eu-central-1 eu-central-2 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-north-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-south-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-1 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | | eu-west-2 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-2 eu-west-3 | | eu-west-3 | eu-central-1 eu-north-1 eu-south-1 eu-south-2 eu-west-1 eu-west-3 | ### JP Amazon Nova 2 Lite To call the JP Amazon Nova 2 Lite inference profile, specify the following inference profile ID in one of the source Regions: ``` jp.amazon.nova-2-lite-v1:0 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | ap-northeast-1 ap-northeast-3 | ### JP Anthropic Claude Haiku 4.5 To call the JP Anthropic Claude Haiku 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` jp.anthropic.claude-haiku-4-5-20251001-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | ap-northeast-1 ap-northeast-3 | | ap-northeast-3 | ap-northeast-1 ap-northeast-3 | ### JP Anthropic Claude Sonnet 4.5 To call the JP Anthropic Claude Sonnet 4.5 inference profile, specify the following inference profile ID in one of the source Regions: ``` jp.anthropic.claude-sonnet-4-5-20250929-v1:0 ``` For more information about inference parameters for this model, see [Link](model-parameters-claude.md). The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | ap-northeast-1 ap-northeast-3 | | ap-northeast-3 | ap-northeast-1 ap-northeast-3 | ### JP Anthropic Claude Sonnet 4.6 To call the JP Anthropic Claude Sonnet 4.6 inference profile, specify the following inference profile ID in one of the source Regions: ``` jp.anthropic.claude-sonnet-4-6 ``` The following table shows the source Regions from which you can call the inference profile and the destination Regions to which the requests can be routed: | Source Regions | Destination Regions | | --- | --- | | ap-northeast-1 | ap-northeast-1 ap-northeast-3 | | ap-northeast-3 | ap-northeast-1 ap-northeast-3 | ## Supported Regions and models for application inference profiles Application inference profiles can be created for all models in the following AWS Regions: + ap-northeast-1 + ap-northeast-2 + ap-south-1 + ap-southeast-1 + ap-southeast-2 + ca-central-1 + eu-central-1 + eu-west-1 + eu-west-2 + eu-west-3 + sa-east-1 + us-east-1 + us-east-2 + us-gov-east-1 + us-west-2 Application inference profiles can be created from all models and inference profiles supported in Amazon Bedrock. For more information about models supported in Amazon Bedrock, see [Supported foundation models in Amazon Bedrock](models-supported.md). # Prerequisites for inference profiles Prerequisites Before you can use an inference profile, check that you've fulfilled the following prerequisites: + Your role has access to the inference profile API actions. If your role has the [AmazonBedrockFullAccess](security-iam-awsmanpol.md#security-iam-awsmanpol-AmazonBedrockFullAccess) AWS-managed policy attached, you can skip this step. Otherwise, do the following: 1. Follow the steps at [Creating IAM policies](https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies_create.html) and create the following policy, which allows a role to do inference profile-related actions and run model inference using all foundation models and inference profiles. ------ #### [ JSON ] **** ``` { "Version":"2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "bedrock:InvokeModel*", "bedrock:CreateInferenceProfile" ], "Resource": [ "arn:aws:bedrock:*::foundation-model/*", "arn:aws:bedrock:*:*:inference-profile/*", "arn:aws:bedrock:*:*:application-inference-profile/*" ] }, { "Effect": "Allow", "Action": [ "bedrock:GetInferenceProfile", "bedrock:ListInferenceProfiles", "bedrock:DeleteInferenceProfile", "bedrock:TagResource", "bedrock:UntagResource", "bedrock:ListTagsForResource" ], "Resource": [ "arn:aws:bedrock:*:*:inference-profile/*", "arn:aws:bedrock:*:*:application-inference-profile/*" ] } ] } ``` ------ (Optional) You can restrict the role's access in the following ways: + To restrict the API actions that the role can make, modify the list in the `Action` field to contain only the [API operations](https://docs.aws.amazon.com/service-authorization/latest/reference/list_amazonbedrock.html#amazonbedrock-actions-as-permissions) that you want to allow access to. + To restrict the role's access to specific inference profiles, modify the `Resource` list to contain only the [inference profiles](https://docs.aws.amazon.com/service-authorization/latest/reference/list_amazonbedrock.html#amazonbedrock-resources-for-iam-policies) and foundation models that you want to allow access to. System-defined inference profiles begin with `inference-profile` and application inference profiles begin with `application-inference-profile`. **Important** When you specify an inference profile in the `Resource` field in the first statement, you must also specify the foundation model in each Region associated with it. + To restrict user access such that they can invoke a foundation model only through an inference profile, add a `Condition` field and use the `aws:InferenceProfileArn` [condition key](https://docs.aws.amazon.com/service-authorization/latest/reference/list_amazonbedrock.html#amazonbedrock-policy-keys). Specify the inference profile that you want to filter access on. This condition can be included in a statement that scopes to the `foundation-model` resources. + For example, you can attach the following policy to a role to allow it to invoke the Anthropic Claude 3 Haiku model only through the US Anthropic Claude 3 Haiku inference profile in the account *111122223333* in us-west-2: ------ #### [ JSON ] **** ``` { "Version":"2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "bedrock:InvokeModel*" ], "Resource": [ "arn:aws:bedrock:us-west-2:111122223333:inference-profile/us.anthropic.claude-3-haiku-20240307-v1:0" ] }, { "Effect": "Allow", "Action": [ "bedrock:InvokeModel*" ], "Resource": [ "arn:aws:bedrock:us-east-1::foundation-model/anthropic.claude-3-haiku-20240307-v1:0", "arn:aws:bedrock:us-west-2::foundation-model/anthropic.claude-3-haiku-20240307-v1:0" ], "Condition": { "StringLike": { "bedrock:InferenceProfileArn": "arn:aws:bedrock:us-west-2:111122223333:inference-profile/us.anthropic.claude-3-haiku-20240307-v1:0" } } } ] } ``` ------ + For example, you can attach the following policy to a role to allow it to invoke the Anthropic Claude Sonnet 4 model only through the Global Claude Sonnet 4 inference profile in the account 111122223333 in us-east-2 (US East (Ohio)). ------ #### [ JSON ] **** ``` { "Version":"2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "bedrock:InvokeModel*" ], "Resource": [ "arn:aws:bedrock:us-east-2:111122223333:inference-profile/global.anthropic.claude-sonnet-4-20250514-v1:0" ] }, { "Effect": "Allow", "Action": [ "bedrock:InvokeModel*" ], "Resource": [ "arn:aws:bedrock:us-east-2::foundation-model/anthropic.claude-sonnet-4-20250514-v1:0", "arn:aws:bedrock:::foundation-model/anthropic.claude-sonnet-4-20250514-v1:0" ], "Condition": { "StringLike": { "bedrock:InferenceProfileArn": "arn:aws:bedrock:us-east-2:111122223333:inference-profile/global.anthropic.claude-sonnet-4-20250514-v1:0" } } } ] } ``` ------ + You can also restrict the use of the Global Claude Sonnet 4 inference profile by adding an explicit Deny with a `StringEquals` condition that checks the request context key `aws:RequestedRegion` equals unspecified. Because it matches `StringEquals`, the Deny overrides any Allow and blocks Global routing of inference requests. ``` { "Effect": "Deny", "Action": [ "bedrock:InvokeModel*" ], "Resource": "*", "Condition": { "StringEquals": { "aws:RequestedRegion": "unspecified" } } }, ``` 1. Follow the steps at [Adding and removing IAM identity permissions](https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies_manage-attach-detach.html) to attach the policy to a role to grant the role permissions to view and use all the inference profiles. + You've requested access to the model defined in the inference profile that you want to use, in the Region from which you want to call the inference profile. # Create an application inference profile You can create an application inference profile with one or more Regions to track usage and costs when invoking a model. + To create an application inference profile for one Region, specify a foundation model. Usage and costs for requests made to that Region with that model will be tracked. + To create an application inference profile for multiple Regions, specify a cross Region (system-defined) inference profile. The inference profile will route requests to the Regions defined in the cross Region (system-defined) inference profile that you choose. Usage and costs for requests made to the Regions in the inference profile will be tracked. Currently, you can only create an inference profile using the Amazon Bedrock API. To create an inference profile, send a [CreateInferenceProfile](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_CreateInferenceProfile.html) request with an [Amazon Bedrock control plane endpoint](https://docs.aws.amazon.com/general/latest/gr/bedrock.html#br-cp). The following fields are required: **** | Field | Use case | | --- | --- | | inferenceProfileName | To specify a name for the inference profile. | | modelSource | To specify the foundation model or cross Region (system-defined) inference profile that defines the model and Regions for which you want to track costs and usage. | The following fields are optional: **** | Field | Use case | | --- | --- | | description | To provide a description for the inference profile. | | tags | To attach tags to the inference profile. For more information, see [Tagging Amazon Bedrock resources](tagging.md) and [Organizing and tracking costs using AWS cost allocation tags](https://docs.aws.amazon.com//awsaccountbilling/latest/aboutv2/cost-alloc-tags.html). | | clientRequestToken | To ensure the API request completes only once. For more information, see [Ensuring idempotency](https://docs.aws.amazon.com/ec2/latest/devguide/ec2-api-idempotency.html). | The response returns an `inferenceProfileArn` that can be used in other inference profile-related actions and that can be used with model invocation and Amazon Bedrock resources. # Modify the tags for an application inference profile After you create an application inference profile, you can still manage tags through the Amazon Bedrock API by submitting a [TagResource](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_TagResource.html) or [UntagResource](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_UntagResource.html) request with an [Amazon Bedrock control plane endpoint](https://docs.aws.amazon.com/general/latest/gr/bedrock.html#br-cp) and specifying the ARN of the application inference profile in the `resourceArn` field. To learn more about tagging, see [Tagging Amazon Bedrock resources](tagging.md). # View information about an inference profile You can view information about cross Region inference profiles or application inference profiles that you've created. To learn how to view information about an inference profile, choose the tab for your preferred method, and then follow the steps: ------ #### [ Console ] **To view information about a cross Region (system-defined) inference profile** 1. Sign in to the AWS Management Console with an IAM identity that has permissions to use the Amazon Bedrock console. Then, open the Amazon Bedrock console at [https://console.aws.amazon.com/bedrock](https://console.aws.amazon.com/bedrock). 1. Select **Cross-Region inference** from the left navigation pane. Then, in the **Cross-Region inference** section, choose an inference profile. 1. View the details of the inference profile in the **Inference profile details** section and the Regions that it encompasses in the **Models** section. **Note** You can't view application inference profiles in the Amazon Bedrock console. ------ #### [ API ] To get information about an inference profile, send a [GetInferenceProfile](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_GetInferenceProfile.html) request with an [Amazon Bedrock control plane endpoint](https://docs.aws.amazon.com/general/latest/gr/bedrock.html#br-cp) and specify the Amazon Resource Name (ARN) or ID of the inference profile in the `inferenceProfileIdentifier` field. To list information about the inference profiles that you can use, send a [ListInferenceProfiles](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_ListInferenceProfiles.html) request with an [Amazon Bedrock control plane endpoint](https://docs.aws.amazon.com/general/latest/gr/bedrock.html#br-cp). You can specify the following optional parameters: **** | Field | Short description | | --- | --- | | maxResults | The maximum number of results to return in a response. | | nextToken | If there are more results than the number you specified in the maxResults field, the response returns a nextToken value. To see the next batch of results, send the nextToken value in another request. | ------ # Use an inference profile in model invocation You can use a cross Region inference profile in place of a foundation model to route requests to multiple Regions. To track costs and usage for a model, in one or multiple Regions, you can use an application inference profile. To learn how to use an inference profile when running model inference, choose the tab for your preferred method, and then follow the steps: ------ #### [ Console ] To use an inference profile with a feature that supports it, do the following: 1. Sign in to the AWS Management Console with an IAM identity that has permissions to use the Amazon Bedrock console. Then, open the Amazon Bedrock console at [https://console.aws.amazon.com/bedrock](https://console.aws.amazon.com/bedrock). 1. Navigate to the page for the feature that you want to use an inference profile for. For example, select **Chat / Text playground** from the left navigation pane. 1. Choose **Select model** and then choose the model. For example, choose **Amazon** and then **Nova Premier**. 1. Under **Inference**, select **Inference profiles** from the dropdown menu. 1. Select the inference profile to use (for example, **US Nova Premier**) and then choose **Apply**. ------ #### [ API ] You can use an inference profile when running inference from any Region that is included in it with the following API operations: + [InvokeModel](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModel.html) or [InvokeModelWithResponseStream](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModelWithResponseStream.html) – To use an inference profile in model invocation, follow the steps at [Submit a single prompt with InvokeModel](inference-invoke.md) and specify the Amazon Resource Name (ARN) of the inference profile in the `modelId` field. For an example, see [Use an inference profile in model invocation](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModel.html#API_runtime_InvokeModel_Example_5). + [Converse](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html) or [ConverseStream](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_ConverseStream.html) – To use an inference profile in model invocation with the Converse API, follow the steps at [Carry out a conversation with the Converse API operations](conversation-inference.md) and specify the ARN of the inference profile in the `modelId` field. For an example, see [Use an inference profile in a conversation](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html#API_runtime_Converse_Example_5). + [https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent-runtime_RetrieveAndGenerate.html](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent-runtime_RetrieveAndGenerate.html) – To use an inference profile when generating responses from the results of querying a knowledge base, follow the steps in the API tab in [Test your knowledge base with queries and responses](knowledge-base-test.md) and specify the ARN of the inference profile in the `modelArn` field. For more information, see [Use an inference proflie to generate a response](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent-runtime_RetrieveAndGenerate.html#API_agent-runtime_RetrieveAndGenerate_Example_3). + [CreateEvaluationJob](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_CreateEvaluationJob.html) – To submit an inference profile for model evaluation, follow the steps in the API tab in [Starting an automatic model evaluation job in Amazon Bedrock](model-evaluation-jobs-management-create.md) and specify the ARN of the inference profile in the `modelIdentifier` field. + [CreatePrompt](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent_CreatePrompt.html) – To use an inference profile when generating a response for a prompt you create in Prompt management, follow the steps in the API tab in [Create a prompt using Prompt management](prompt-management-create.md) and specify the ARN of the inference profile in the `modelId` field. + [CreateFlow](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent_CreateFlow.html) – To use an inference profile when generating a response for an inline prompt that you define within a prompt node in a flow, follow the steps in the API tab in [Create and design a flow in Amazon Bedrock](flows-create.md). In defining the [prompt node](flows-nodes.md#flows-nodes-prompt), specify the ARN of the inference profile in the `modelId` field. + [CreateDataSource](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent_CreateDataSource.html) – To use an inference profile when parsing non-textual information in a data source, follow the steps in the API section in [Parsing options for your data source](kb-advanced-parsing.md) and specify the ARN of the inference profile in the `modelArn` field. **Note** If you're using a cross-Region (system-defined) inference profile, you can use either the ARN or the ID of the inference profile. ------ # Delete an application inference profile If you no longer need an application inference profile, you can delete it. You can only delete inference profiles through the Amazon Bedrock API. To delete an inference profile, send a [DeleteInferenceProfile](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_DeleteInferenceProfiles.html) request with an [Amazon Bedrock control plane endpoint](https://docs.aws.amazon.com/general/latest/gr/bedrock.html#br-cp) and specify the Amazon Resource Name (ARN) or ID of the inference profile to delete in the `inferenceProflieIdentifier` field.