ServerlessProductionVariantProps Struct
Construction properties for a serverless production variant.
Example
ts
import * as sagemaker from '@aws-cdk/aws-sagemaker-alpha';
declare const model: sagemaker.Model;
const endpointConfig = new sagemaker.EndpointConfig(this, 'ServerlessEndpointConfig', {
serverlessProductionVariant: {
model: model,
variantName: 'serverlessVariant',
maxConcurrency: 10,
memorySizeInMB: 2048,
provisionedConcurrency: 5, // optional
},
});
Properties
initialVariantWeightnumberinitial_variant_weightint | floatinitialVariantWeightNumberInitialVariantWeightdoubleInitialVariantWeight*float64= 1.0#Determines initial traffic distribution among all of the models that you specify in the endpoint configuration.
The traffic to a production variant is determined by the ratio of the variant weight to the sum of all variant weight values across all production variants.
maxConcurrencynumbermax_concurrencyint | floatmaxConcurrencyNumberMaxConcurrencydoubleMaxConcurrency*float64required#The maximum number of concurrent invocations your serverless endpoint can process.
Valid range: 1-200
memorySizeInMBnumbermemory_size_in_mbint | floatmemorySizeInMBNumberMemorySizeInMBdoubleMemorySizeInMB*float64required#The memory size of your serverless endpoint.
Valid values are in 1 GB increments: 1024 MB, 2048 MB, 3072 MB, 4096 MB, 5120 MB, or 6144 MB.
provisionedConcurrencynumberprovisioned_concurrencyint | floatprovisionedConcurrencyNumberProvisionedConcurrencydoubleProvisionedConcurrency*float64= none#The number of concurrent invocations that are provisioned and ready to respond to your endpoint.
Valid range: 1-200, must be less than or equal to maxConcurrency.
Name of the production variant.