Class ThrottlingException

All Implemented Interfaces:
Serializable, SdkPojo, ToCopyableBuilder<ThrottlingException.Builder,ThrottlingException>

@Generated("software.amazon.awssdk:codegen") public final class ThrottlingException extends SageMakerGatewayRuntimeException implements ToCopyableBuilder<ThrottlingException.Builder,ThrottlingException>

The request was throttled before it was dispatched for inference. Retry the request with backoff, after the Retry-After seconds when the response carries one. A message starting inference gateway means the last inference gateway tried for the model returned a 429. The gateway may have tried others first, and they may have failed for other reasons. Up to 256 bytes of its error message are quoted.

See Also: