Interface AIRecommendationConstraint.Builder

  • Method Details

    • metric

      The performance metric. Valid values are ttft-ms (time to first token in milliseconds), throughput, and cost.

      Parameters:
      metric - The performance metric. Valid values are ttft-ms (time to first token in milliseconds), throughput, and cost.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • metric

      The performance metric. Valid values are ttft-ms (time to first token in milliseconds), throughput, and cost.

      Parameters:
      metric - The performance metric. Valid values are ttft-ms (time to first token in milliseconds), throughput, and cost.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also: