Builder

The maximum number of in-flight requests on the target instance before the endpoint routes to another instance. Required when RoutingStrategy is PREFIX_AWARE. When in-flight requests on the prefix-selected instance reach this threshold, the endpoint routes the request to an instance with more available capacity.

The maximum length of the prefix used for routing decisions. Required when RoutingStrategy is PREFIX_AWARE.