Package software.amazon.awscdk.services.sagemaker

Interface CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty

All Superinterfaces:

software.amazon.jsii.JsiiSerializable

All Known Implementing Classes:

CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty.Jsii$Proxy

Enclosing class:

CfnInferenceComponent

@Stability(Stable)
public static interface CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty
extends software.amazon.jsii.JsiiSerializable

Defines the compute resources to allocate to run a model, plus any adapter models, that you assign to an inference component.

These resources include CPU cores, accelerators, and memory.

Example:

 // The code below shows an example of how to instantiate this type.
 // The values are placeholders you should change.
 import software.amazon.awscdk.services.sagemaker.*;
 InferenceComponentComputeResourceRequirementsProperty inferenceComponentComputeResourceRequirementsProperty = InferenceComponentComputeResourceRequirementsProperty.builder()
         .maxMemoryRequiredInMb(123)
         .minMemoryRequiredInMb(123)
         .numberOfAcceleratorDevicesRequired(123)
         .numberOfCpuCoresRequired(123)
         .build();
 

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-inferencecomponent-inferencecomponentcomputeresourcerequirements.html

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static final class	CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty.Builder	A builder for CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty
static final class	CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty.Jsii$Proxy	An implementation for CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty

Method Summary

Modifier and Type	Method	Description
static CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty.Builder	builder()
default Number	getMaxMemoryRequiredInMb()	The maximum MB of memory to allocate to run a model that you assign to an inference component.
default Number	getMinMemoryRequiredInMb()	The minimum MB of memory to allocate to run a model that you assign to an inference component.
default Number	getNumberOfAcceleratorDevicesRequired()	The number of accelerators to allocate to run a model that you assign to an inference component.
default Number	getNumberOfCpuCoresRequired()	The number of CPU cores to allocate to run a model that you assign to an inference component.

Methods inherited from interface software.amazon.jsii.JsiiSerializable

$jsii$toJson

Method Details

getMaxMemoryRequiredInMb

@Stability(Stable)
@Nullable
default Number getMaxMemoryRequiredInMb()

The maximum MB of memory to allocate to run a model that you assign to an inference component.

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-inferencecomponent-inferencecomponentcomputeresourcerequirements.html#cfn-sagemaker-inferencecomponent-inferencecomponentcomputeresourcerequirements-maxmemoryrequiredinmb

getMinMemoryRequiredInMb

@Stability(Stable)
@Nullable
default Number getMinMemoryRequiredInMb()

The minimum MB of memory to allocate to run a model that you assign to an inference component.

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-inferencecomponent-inferencecomponentcomputeresourcerequirements.html#cfn-sagemaker-inferencecomponent-inferencecomponentcomputeresourcerequirements-minmemoryrequiredinmb

getNumberOfAcceleratorDevicesRequired

@Stability(Stable)
@Nullable
default Number getNumberOfAcceleratorDevicesRequired()

The number of accelerators to allocate to run a model that you assign to an inference component.

Accelerators include GPUs and AWS Inferentia.

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-inferencecomponent-inferencecomponentcomputeresourcerequirements.html#cfn-sagemaker-inferencecomponent-inferencecomponentcomputeresourcerequirements-numberofacceleratordevicesrequired

getNumberOfCpuCoresRequired

@Stability(Stable)
@Nullable
default Number getNumberOfCpuCoresRequired()

The number of CPU cores to allocate to run a model that you assign to an inference component.

See Also:

• http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-sagemaker-inferencecomponent-inferencecomponentcomputeresourcerequirements.html#cfn-sagemaker-inferencecomponent-inferencecomponentcomputeresourcerequirements-numberofcpucoresrequired

builder

@Stability(Stable)
static CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty.Builder builder()

Returns:

a CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty.Builder of CfnInferenceComponent.InferenceComponentComputeResourceRequirementsProperty