支持批量推理的区域和模型 - Amazon Bedrock

本文属于机器翻译版本。若本译文内容与英语原文存在差异,则一律以英文原文为准。

支持批量推理的区域和模型

以下列表提供了关于 Amazon Bedrock 中区域和模型支持的一般信息的链接:

Batch 推理可用于不同类型的模型。以下列表描述了对不同类型的 Amazon Bedrock 型号的支持:

  • 单区域模型支持-列出支持向一个区域中的基础模型发送推理请求的区域。 AWS 有关 Amazon Bedrock 上可用型号的完整列表,请参阅Amazon Bedrock 中支持的根基模型

  • 跨区域推理配置文件支持-列出支持使用跨区域推理配置文件的区域,跨区域推理配置文件支持向地理区域内多个 AWS 区域的基础模型发送推理请求。推理配置文件在模型 ID 前有一个前缀,表示其地理区域(例如us.apac)。有关 Amazon Bedrock 中可用推理配置文件的更多信息,请参阅。支持推理配置文件的区域和模型

  • 自定义模型支持-列出支持向自定义模型发送推理请求的区域。有关模型自定义的更多信息,请参阅针对使用案例自定义模型以提高其性能

下表汇总了对批量推理的支持:

Provider 模型 模型 ID 支持单区域模型 跨区域推理配置文件支持 自定义模型支持
Amazon Amazon Nova 多模式嵌入式 amazon.nova-2-1:0 multimodal-embeddings-v

us-east-1

不适用
Amazon 新星 2 精简版 amazon.nova-2-lite-v 1:0 不适用

ap-east-2

ap-northeast-1

ap-northeast-2

ap-south-1

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-4

ap-southeast-5

ap-southeast-7

ca-central-1

ca-west-1

eu-central-1

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-2

eu-west-3

il-central-1

me-central-1

us-east-1

us-east-2

us-west-1

us-west-2

不适用
Amazon Nova Lite 亚马逊。 nova-lite-v1:0

me-central-1

us-east-1

us-gov-west-1

ap-east-2

ap-northeast-1

ap-northeast-2

ap-south-1

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-4

ap-southeast-5

ap-southeast-7

ca-central-1

ca-west-1

eu-central-1

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-3

il-central-1

me-central-1

us-east-1

us-east-2

us-west-1

us-west-2

不适用
Amazon Nova Micro 亚马逊。 nova-micro-v1:0

us-east-1

us-gov-west-1

ap-east-2

ap-northeast-1

ap-northeast-2

ap-south-1

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-5

ap-southeast-7

eu-central-1

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-3

il-central-1

me-central-1

us-east-1

us-east-2

us-west-2

不适用
Amazon Nova Premier 亚马逊。 nova-premier-v1:0 不适用

us-east-1

us-east-2

us-west-2

不适用
Amazon Nova Pro 亚马逊。 nova-pro-v1:0

ap-southeast-3

me-central-1

us-east-1

us-gov-west-1

ap-east-2

ap-northeast-1

ap-northeast-2

ap-south-1

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-4

ap-southeast-5

ap-southeast-7

eu-central-1

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-3

il-central-1

me-central-1

us-east-1

us-east-2

us-west-1

us-west-2

不适用
Amazon Titan Multimodal Embeddings G1 亚马逊。 titan-embed-image-v1

ap-south-1

ap-southeast-2

ca-central-1

eu-central-1

eu-west-1

eu-west-2

eu-west-3

sa-east-1

us-east-1

us-west-2

us-east-1

us-west-2

Amazon Titan Text Embeddings V2 亚马逊。 titan-embed-text-v2:0

ap-northeast-1

ap-northeast-2

ca-central-1

eu-central-1

eu-central-2

eu-north-1

eu-south-1

eu-south-2

eu-west-2

sa-east-1

us-east-1

us-west-2

不适用
Anthropic Claude 3 Haiku anthropic.claude-3-haiku-20240307-v1:0

ap-northeast-1

ap-northeast-2

ap-south-1

ap-southeast-1

ap-southeast-2

ca-central-1

eu-central-1

eu-central-2

eu-west-1

eu-west-2

eu-west-3

sa-east-1

us-east-1

us-west-2

不适用 不适用
Anthropic Claude 3 Opus anthropic.claude-3-opus-20240229-v 1:0

us-west-2

us-east-1

不适用
Anthropic Claude 3 Sonnet anthropic.claude-3-sonnet-20240229-v1:0

ap-northeast-2

ap-south-1

ap-southeast-2

ca-central-1

eu-central-1

eu-west-1

eu-west-2

eu-west-3

sa-east-1

us-east-1

us-west-2

ap-northeast-1

ap-northeast-2

ap-south-1

ap-southeast-1

ap-southeast-2

eu-central-1

eu-west-1

eu-west-3

us-east-1

us-west-2

不适用
Anthropic Claude 3.5 Haiku anthropic.claude-3-5-haiku-20241022-v1:0

us-west-2

us-east-1

不适用
Anthropic Claude 3.5 Sonnet anthropic.claude-3-5-sonnet-20240620-v1:0

ap-northeast-1

ap-northeast-2

ap-southeast-1

eu-central-1

us-east-1

us-east-2

us-west-2

ap-northeast-1

ap-northeast-2

ap-south-1

ap-southeast-1

ap-southeast-2

eu-central-1

eu-west-1

eu-west-3

us-east-1

us-west-2

不适用
Anthropic Claude 3.5 Sonnet v2 anthropic.claude-3-5-sonnet-20241022-v2:0

us-west-2

ap-northeast-1

ap-northeast-2

ap-northeast-3

ap-south-1

ap-south-2

ap-southeast-1

ap-southeast-2

us-east-1

us-east-2

us-west-2

不适用
Anthropic Claude 3.7 Sonnet anthropic.claude-3-7-sonnet-20250219-v1:0 不适用

ap-northeast-1

ap-northeast-2

ap-south-1

ap-south-2

ap-southeast-1

ap-southeast-2

eu-central-1

eu-north-1

eu-west-1

eu-west-3

us-east-1

us-east-2

us-west-2

不适用
Anthropic Claude Haiku 4.5 anthropic.claude-haiku-4-5-20251001-v1:0 不适用

ap-northeast-1

ap-northeast-2

ap-northeast-3

ap-south-1

ap-south-2

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-4

ca-central-1

eu-central-1

eu-central-2

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-2

eu-west-3

sa-east-1

us-east-1

us-east-2

us-west-1

us-west-2

不适用
Anthropic 克劳德作品 4.5 anthropic.claude-opus-4-5-20251101-v 1:0 不适用

ap-northeast-1

ap-northeast-2

ap-northeast-3

ap-south-1

ap-south-2

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-4

ca-central-1

eu-central-1

eu-central-2

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-2

eu-west-3

sa-east-1

us-east-1

us-east-2

us-west-1

us-west-2

不适用
Anthropic 克劳德作品 4.6 anthropic.claude-opus-4-6-v1 不适用

af-south-1

ap-east-2

ap-northeast-1

ap-northeast-2

ap-northeast-3

ap-south-1

ap-south-2

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-4

ap-southeast-5

ap-southeast-7

ca-central-1

ca-west-1

eu-central-1

eu-central-2

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-2

eu-west-3

il-central-1

me-central-1

me-south-1

mx-central-1

sa-east-1

us-east-1

us-east-2

us-west-1

us-west-2

不适用
Anthropic Claude Sonnet 4 anthropic.claude-sonnet-4-20250514-v1:0 不适用

ap-east-2

ap-northeast-1

ap-northeast-2

ap-northeast-3

ap-south-1

ap-south-2

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-4

ap-southeast-5

ap-southeast-7

eu-central-1

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-3

il-central-1

me-central-1

us-east-1

us-east-2

us-west-1

us-west-2

不适用
Anthropic 克劳德·十四行诗 4.5 anthropic.claude-sonnet-4-5-20250929-v1:0 不适用

af-south-1

ap-northeast-1

ap-northeast-2

ap-northeast-3

ap-south-1

ap-south-2

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-4

ca-central-1

ca-west-1

eu-central-1

eu-central-2

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-2

eu-west-3

me-south-1

mx-central-1

sa-east-1

us-east-1

us-east-2

us-gov-east-1

us-gov-west-1

us-west-1

us-west-2

不适用
Anthropic 克劳德·十四行诗 4.6 anthropic.claude-sonnet-4-6

eu-west-2

af-south-1

ap-east-2

ap-northeast-1

ap-northeast-2

ap-northeast-3

ap-south-1

ap-south-2

ap-southeast-1

ap-southeast-2

ap-southeast-3

ap-southeast-4

ap-southeast-5

ap-southeast-7

ca-central-1

ca-west-1

eu-central-1

eu-central-2

eu-north-1

eu-south-1

eu-south-2

eu-west-1

eu-west-2

eu-west-3

il-central-1

me-central-1

me-south-1

mx-central-1

sa-east-1

us-east-1

us-east-2

us-west-1

us-west-2

不适用
DeepSeek DeepSeek V3.2 deepseek.v3.2

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-north-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
DeepSeek DeepSeek-V3.1 deepseek.v3-v 1:0

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-north-1

eu-west-2

us-east-2

us-west-2

不适用
Google Gemma 3 12B IT google.gemma-3-12b-it

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Google Gemma 3 27B PT google.gemma-3-27b-it

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Google Gemma 3 4B IT google.gemma-3-4b-it

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Meta Llama 3.1 405B Instruct meta.llama3-1-405 1:0 b-instruct-v

us-west-2

不适用
Meta Llama 3.1 70B Instruct meta.llama3-1-70 1:0 b-instruct-v

us-west-2

us-east-1

us-west-2

不适用
Meta Llama 3.1 8B Instruct meta.llama3-1-8 1:0 b-instruct-v

us-west-2

us-east-1

us-west-2

不适用
Meta Llama 3.2 11B Instruct meta.llama3-2-11 1:0 b-instruct-v

us-east-1

us-west-2

不适用
Meta Llama 3.2 1B Instruct meta.llama3-2-1 1:0 b-instruct-v

eu-central-1

eu-west-1

eu-west-3

us-east-1

us-west-2

不适用
Meta Llama 3.2 3B Instruct meta.llama3-2-3 1:0 b-instruct-v

eu-central-1

eu-west-1

eu-west-3

us-east-1

us-west-2

不适用
Meta Llama 3.2 90B Instruct meta.llama3-2-90 1:0 b-instruct-v

us-east-1

us-west-2

不适用
Meta Llama 3.3 70B Instruct meta.llama3-3-70 1:0 b-instruct-v

us-east-2

us-east-1

us-east-2

us-west-2

不适用
Meta Llama 4 Maverick 17B Instruct meta.llama4-maverick b-instruct-v -17 1:0

us-east-1

us-east-2

us-west-1

us-west-2

不适用
Meta Llama 4 Scout 17B Instruct meta.llama4-scout b-instruct-v -17 1:0

us-east-1

us-east-2

us-west-1

us-west-2

不适用
MiniMax MiniMax M2 minimax.minimax-M2

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
MiniMax MiniMax M2.1 minimax.minimax-M2.1

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-central-1

eu-north-1

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Mistral AI Devstral 2 123B mistral.devstral-2-123b

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-central-1

eu-north-1

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Mistral AI Magistral 小号 2509 mistral.magistral-small-2509

ap-northeast-1

ap-south-1

ap-southeast-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Mistral AI Ministral 14B 3.0 mistral.ministral-3-14b-instruct

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Mistral AI Ministral 3 8B mistral.ministral-3-8b-instruct

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Mistral AI Ministral 3B mistral.ministral-3-3b-instruct

ap-northeast-1

ap-south-1

ap-southeast-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Mistral AI Mistral Large(24.07) mistral.mistral-large-2407-v1:0

us-west-2

不适用 不适用
Mistral AI Mistral 大号 3 mistral.mistral-large-3-675b-instruct

ap-northeast-1

ap-south-1

ap-southeast-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Mistral AI Mistral Small(24.02) mistral.mistral-small-2402-v1:0

us-east-1

不适用 不适用
Mistral AI Voxtral Mini 3B 2507 mistral.voxtral-mini-3b-2507

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Mistral AI Voxtral Small 24B 2507 mistral.voxtral-small-24b-2507

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
月球射击人工智能 Kimi K2 Thinking moonshot.kimi-k2 思考

ap-northeast-1

ap-south-1

ap-southeast-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
月球射击人工智能 Kimi K2.5 moonshotai.kimi-k2.5

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-north-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
NVIDIA NVIDIA Nemotron Nano 12B v2 VL BF16 nvidia.nemotron-nano-12b-v2

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
NVIDIA NVIDIA Nemotron Nano 9B v2 nvidia.nemotron-nano-9b-v2

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
NVIDIA Nemotron Nano 3 30B nvidia.nemotron-nano-3-30b

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
OpenAI GPT OSS Safeguard openai。 gpt-oss-safeguard-120b

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
OpenAI GPT OSS Safeguard openai。 gpt-oss-safeguard-20b

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
OpenAI gpt-oss-120b openai.gpt-oss-120b-1:0

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-central-1

eu-north-1

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-gov-west-1

us-west-2

不适用 不适用
OpenAI gpt-oss-20b openai.gpt-oss-20b-1:0

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-central-1

eu-north-1

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-gov-west-1

us-west-2

不适用 不适用
Qwen Qwen3 235B A22B 2507 qwen.qwen3-235b-a22b-2507-v 1:0

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-central-1

eu-north-1

eu-south-1

eu-west-2

us-east-2

us-west-2

不适用 不适用
Qwen Qwen3 32B(密集) qwen.qwen3-32b-v 1:0

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-central-1

eu-north-1

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Qwen Qwen3 Coder 480B A35B Instruct qwen.qwen3-coder-480b-a35b-v 1:0

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-north-1

eu-west-2

us-east-2

us-west-2

不适用 不适用
Qwen Qwen3 Coder 下一篇 qwen.qwen3-coder-next

ap-southeast-2

eu-west-2

us-east-1

不适用 不适用
Qwen Qwen3 Next 80B A3B qwen.qwen3-next-80b-a3b

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Qwen Qwen3 VL 235B A2B qwen.qwen3-vl-235b-a22b

ap-northeast-1

ap-south-1

ap-southeast-2

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Qwen Qwen3-Coder-30B-A3B-Instruct qwen.qwen3-coder-30b-a3b-v 1:0

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-central-1

eu-north-1

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Z.AI GLM 4.7 zai.glm-4.7

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-north-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用
Z.AI GLM 4.7 Flash zai.glm-4.7-Flash

ap-northeast-1

ap-south-1

ap-southeast-2

ap-southeast-3

eu-central-1

eu-north-1

eu-south-1

eu-west-1

eu-west-2

sa-east-1

us-east-1

us-east-2

us-west-2

不适用 不适用