Interface GlobalInferenceGatewayRoutingWeights.Builder
- All Superinterfaces:
Buildable,CopyableBuilder<GlobalInferenceGatewayRoutingWeights.Builder,,GlobalInferenceGatewayRoutingWeights> SdkBuilder<GlobalInferenceGatewayRoutingWeights.Builder,,GlobalInferenceGatewayRoutingWeights> SdkPojo
- Enclosing class:
GlobalInferenceGatewayRoutingWeights
@Mutable
@NotThreadSafe
public static interface GlobalInferenceGatewayRoutingWeights.Builder
extends SdkPojo, CopyableBuilder<GlobalInferenceGatewayRoutingWeights.Builder,GlobalInferenceGatewayRoutingWeights>
-
Method Summary
Modifier and TypeMethodDescriptionThe weight of the recent error rate of the cluster.kvHeadroom(Float kvHeadroom) The weight of the free key-value (KV) cache capacity on the cluster.queueDepth(Float queueDepth) The weight of the number of requests that are waiting on the cluster.regionProximity(Float regionProximity) The weight of how close the cluster is to the caller.Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder
copyMethods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder
applyMutation, buildMethods inherited from interface software.amazon.awssdk.core.SdkPojo
equalsBySdkFields, sdkFieldNameToField, sdkFields
-
Method Details
-
kvHeadroom
The weight of the free key-value (KV) cache capacity on the cluster.
- Parameters:
kvHeadroom- The weight of the free key-value (KV) cache capacity on the cluster.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
queueDepth
The weight of the number of requests that are waiting on the cluster.
- Parameters:
queueDepth- The weight of the number of requests that are waiting on the cluster.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
regionProximity
The weight of how close the cluster is to the caller.
- Parameters:
regionProximity- The weight of how close the cluster is to the caller.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
errorRate
The weight of the recent error rate of the cluster.
- Parameters:
errorRate- The weight of the recent error rate of the cluster.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-