sagemaker/aws.sdk.kotlin.services.sagemaker.model/ModelSpeculativeDecodingConfig

ModelSpeculativeDecodingConfig

class ModelSpeculativeDecodingConfig

Settings for the model speculative decoding technique that's applied by a model optimization job.

Types

Builder

class Builder

Companion

object Companion

Properties

technique

val technique: ModelSpeculativeDecodingTechnique?

The speculative decoding technique to apply during model optimization.

trainingDataSource

val trainingDataSource: ModelSpeculativeDecodingTrainingDataSource?

The location of the training data to use for speculative decoding. The data must be formatted as ShareGPT, OpenAI Completions or OpenAI Chat Completions. The input can also be unencrypted captured data from a SageMaker endpoint as long as the endpoint uses one of the above formats.

Functions

copy

inline fun copy(block: ModelSpeculativeDecodingConfig.Builder.() -> Unit = {}): ModelSpeculativeDecodingConfig

equals

open operator override fun equals(other: Any?): Boolean

hashCode

open override fun hashCode(): Int

toString

open override fun toString(): String