@aws-cdk/aws-bedrock-alpha.CrossRegionInferenceProfileProps

Experimental

@aws-cdk/aws-bedrock-alpha is an experimental (alpha) package: its API may change in any release, without a major version bump.

CrossRegionInferenceProfileProps Struct

Properties for creating a Cross-Region Inference Profile.

Stability

Experimental

Source

bedrock/inference-profiles/cross-region-inference-profile.ts

Example

// Create a cross-region inference profile
const crossRegionProfile = bedrock.CrossRegionInferenceProfile.fromConfig({
  geoRegion: bedrock.CrossRegionInferenceProfileRegion.US,
  model: bedrock.BedrockFoundationModel.ANTHROPIC_CLAUDE_3_5_SONNET_V2_0,
});

// Create an application inference profile across regions
const appProfile = new bedrock.ApplicationInferenceProfile(this, 'MyMultiRegionProfile', {
  applicationInferenceProfileName: 'claude-35-sonnet-v2-multi-region',
  modelSource: crossRegionProfile,
  description: 'Multi-region application profile for cost tracking',
});

Properties

geoRegionCrossRegionInferenceProfileRegiongeo_regionCrossRegionInferenceProfileRegiongeoRegionCrossRegionInferenceProfileRegionGeoRegionCrossRegionInferenceProfileRegionGeoRegionCrossRegionInferenceProfileRegionrequired#

The geographic region where the traffic is going to be distributed.

Routing factors in user traffic, demand and utilization of resources.

modelBedrockFoundationModelmodelBedrockFoundationModelmodelBedrockFoundationModelModelBedrockFoundationModelModelBedrockFoundationModelrequired#

A foundation model supporting cross-region inference.

The model must have cross-region support enabled.