sagemaker/aws.sdk.kotlin.services.sagemaker.model/PrefixAwareRoutingConfig

PrefixAwareRoutingConfig

The configuration for prefix-aware routing on a SageMaker real-time inference endpoint. Specify PrefixLength and ConcurrencyThreshold to control routing behavior.

Types

Builder

class Builder

Companion

object Companion

Properties

concurrencyThreshold

val concurrencyThreshold: Int?

The maximum number of in-flight requests on the target instance before the endpoint routes to another instance. Required when RoutingStrategy is PREFIX_AWARE. When in-flight requests on the prefix-selected instance reach this threshold, the endpoint routes the request to an instance with more available capacity.

prefixLength

val prefixLength: Int?

The maximum length of the prefix used for routing decisions. Required when RoutingStrategy is PREFIX_AWARE.

Functions

copy

inline fun copy(block: PrefixAwareRoutingConfig.Builder.() -> Unit = {}): PrefixAwareRoutingConfig

equals

open operator override fun equals(other: Any?): Boolean

hashCode

open override fun hashCode(): Int

toString

open override fun toString(): String