sagemaker/aws.sdk.kotlin.services.sagemaker.model/OptimizationConfig/ModelSpeculativeDecodingConfig

ModelSpeculativeDecodingConfig

data class ModelSpeculativeDecodingConfig(val value: ModelSpeculativeDecodingConfig) : OptimizationConfig

Settings for the model speculative decoding technique that's applied by a model optimization job.

Constructors

ModelSpeculativeDecodingConfig

constructor(value: ModelSpeculativeDecodingConfig)

Properties

val value: ModelSpeculativeDecodingConfig

Inherited functions

asModelCompilationConfig

fun asModelCompilationConfig(): ModelCompilationConfig

Casts this OptimizationConfig as a ModelCompilationConfig and retrieves its aws.sdk.kotlin.services.sagemaker.model.ModelCompilationConfig value. Throws an exception if the OptimizationConfig is not a ModelCompilationConfig.

asModelCompilationConfigOrNull

fun asModelCompilationConfigOrNull(): ModelCompilationConfig?

Casts this OptimizationConfig as a ModelCompilationConfig and retrieves its aws.sdk.kotlin.services.sagemaker.model.ModelCompilationConfig value. Returns null if the OptimizationConfig is not a ModelCompilationConfig.

asModelQuantizationConfig

fun asModelQuantizationConfig(): ModelQuantizationConfig

Casts this OptimizationConfig as a ModelQuantizationConfig and retrieves its aws.sdk.kotlin.services.sagemaker.model.ModelQuantizationConfig value. Throws an exception if the OptimizationConfig is not a ModelQuantizationConfig.

asModelQuantizationConfigOrNull

fun asModelQuantizationConfigOrNull(): ModelQuantizationConfig?

Casts this OptimizationConfig as a ModelQuantizationConfig and retrieves its aws.sdk.kotlin.services.sagemaker.model.ModelQuantizationConfig value. Returns null if the OptimizationConfig is not a ModelQuantizationConfig.

asModelShardingConfig

fun asModelShardingConfig(): ModelShardingConfig

Casts this OptimizationConfig as a ModelShardingConfig and retrieves its aws.sdk.kotlin.services.sagemaker.model.ModelShardingConfig value. Throws an exception if the OptimizationConfig is not a ModelShardingConfig.

asModelShardingConfigOrNull

fun asModelShardingConfigOrNull(): ModelShardingConfig?

Casts this OptimizationConfig as a ModelShardingConfig and retrieves its aws.sdk.kotlin.services.sagemaker.model.ModelShardingConfig value. Returns null if the OptimizationConfig is not a ModelShardingConfig.

asModelSpeculativeDecodingConfig

fun asModelSpeculativeDecodingConfig(): ModelSpeculativeDecodingConfig

Casts this OptimizationConfig as a ModelSpeculativeDecodingConfig and retrieves its aws.sdk.kotlin.services.sagemaker.model.ModelSpeculativeDecodingConfig value. Throws an exception if the OptimizationConfig is not a ModelSpeculativeDecodingConfig.

asModelSpeculativeDecodingConfigOrNull

fun asModelSpeculativeDecodingConfigOrNull(): ModelSpeculativeDecodingConfig?

Casts this OptimizationConfig as a ModelSpeculativeDecodingConfig and retrieves its aws.sdk.kotlin.services.sagemaker.model.ModelSpeculativeDecodingConfig value. Returns null if the OptimizationConfig is not a ModelSpeculativeDecodingConfig.