Skip to content

/AWS1/CL_SGMPRODUCTIONVARIAN06

Settings that control how the endpoint routes incoming traffic to the instances that the endpoint hosts.

CONSTRUCTOR

IMPORTING

Required arguments:

iv_routingstrategy TYPE /AWS1/SGMROUTINGSTRATEGY /AWS1/SGMROUTINGSTRATEGY

Sets how the endpoint routes incoming traffic:

  • LEAST_OUTSTANDING_REQUESTS: The endpoint routes requests to the specific instances that have more capacity to process them.

  • RANDOM: The endpoint routes each request to a randomly chosen instance.

  • PREFIX_AWARE: The endpoint routes requests that share the same prompt prefix to the same instance. When the number of in-flight requests on the selected instance reaches the configured threshold, the endpoint routes the request to an instance with more available capacity.

Optional arguments:

io_prefixawareroutingconfig TYPE REF TO /AWS1/CL_SGMPREFAWAREROUTNGCFG /AWS1/CL_SGMPREFAWAREROUTNGCFG

The configuration for prefix-aware routing. Specify this parameter only when you set RoutingStrategy to PREFIX_AWARE.

Queryable Attributes

RoutingStrategy

Sets how the endpoint routes incoming traffic:

  • LEAST_OUTSTANDING_REQUESTS: The endpoint routes requests to the specific instances that have more capacity to process them.

  • RANDOM: The endpoint routes each request to a randomly chosen instance.

  • PREFIX_AWARE: The endpoint routes requests that share the same prompt prefix to the same instance. When the number of in-flight requests on the selected instance reaches the configured threshold, the endpoint routes the request to an instance with more available capacity.

Accessible with the following methods

Method Description
GET_ROUTINGSTRATEGY() Getter for ROUTINGSTRATEGY, with configurable default
ASK_ROUTINGSTRATEGY() Getter for ROUTINGSTRATEGY w/ exceptions if field has no val
HAS_ROUTINGSTRATEGY() Determine if ROUTINGSTRATEGY has a value

PrefixAwareRoutingConfig

The configuration for prefix-aware routing. Specify this parameter only when you set RoutingStrategy to PREFIX_AWARE.

Accessible with the following methods

Method Description
GET_PREFIXAWAREROUTINGCONFIG() Getter for PREFIXAWAREROUTINGCONFIG