ServerlessConfigProperty Struct
Specifies the serverless configuration for an endpoint variant.
Example
ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const serverlessConfigProperty: sagemaker.CfnEndpointConfig.ServerlessConfigProperty = {
maxConcurrency: 123,
memorySizeInMb: 123,
// the properties below are optional
provisionedConcurrency: 123,
};
Properties
maxConcurrencynumbermax_concurrencyint | floatmaxConcurrencyNumberMaxConcurrencydoubleMaxConcurrency*float64required#The maximum number of concurrent invocations your serverless endpoint can process.
memorySizeInMbnumbermemory_size_in_mbint | floatmemorySizeInMbNumberMemorySizeInMbdoubleMemorySizeInMb*float64required#The memory size of your serverless endpoint.
Valid values are in 1 GB increments: 1024 MB, 2048 MB, 3072 MB, 4096 MB, 5120 MB, or 6144 MB.
provisionedConcurrencynumberprovisioned_concurrencyint | floatprovisionedConcurrencyNumberProvisionedConcurrencydoubleProvisionedConcurrency*float64#The amount of provisioned concurrency to allocate for the serverless endpoint.
notes
Should be less than or equal to MaxConcurrency .
This field is not supported for serverless endpoint recommendations for Inference Recommender jobs. For more information about creating an Inference Recommender job, see CreateInferenceRecommendationsJobs .