Class: Aws::SageMaker::Types::CrossRegionTrafficConfig

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb

Overview

The cross-Region traffic cap for an endpoint. The cap limits the requests per second that the endpoint accepts from inference routers in other Amazon Web Services Regions. The cap is MaxCrossRegionPercentPerEndpoint percent of MaxInvocationsPerSecondPerInstance multiplied by the number of InService instances, rounded up. All production variants and inference components of the endpoint share it. Requests that you send to the endpoint directly aren't counted. A request over the cap fails with a ThrottlingException.

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#max_cross_region_percent_per_endpoint ⇒ Integer

The percentage of the endpoint's capacity that requests from inference routers in other Amazon Web Services Regions can use.

Returns:

  • (Integer)


16482
16483
16484
16485
16486
16487
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 16482

class CrossRegionTrafficConfig < Struct.new(
  :max_invocations_per_second_per_instance,
  :max_cross_region_percent_per_endpoint)
  SENSITIVE = []
  include Aws::Structure
end

#max_invocations_per_second_per_instance ⇒ Integer

The number of invocations per second that you expect one InService instance to serve. One value applies to every production variant, whatever its instance type.

Returns:

  • (Integer)


16482
16483
16484
16485
16486
16487
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 16482

class CrossRegionTrafficConfig < Struct.new(
  :max_invocations_per_second_per_instance,
  :max_cross_region_percent_per_endpoint)
  SENSITIVE = []
  include Aws::Structure
end