Interface InferenceOperationConfiguration.Builder

All Superinterfaces:
Buildable, CopyableBuilder<InferenceOperationConfiguration.Builder,InferenceOperationConfiguration>, SdkBuilder<InferenceOperationConfiguration.Builder,InferenceOperationConfiguration>, SdkPojo
Enclosing class:
InferenceOperationConfiguration
@Mutable @NotThreadSafe public static interface InferenceOperationConfiguration.Builder extends SdkPojo, CopyableBuilder<InferenceOperationConfiguration.Builder,InferenceOperationConfiguration>

  • Method Details

    • path

      InferenceOperationConfiguration.Builder path(String path)

      The request path for this operation (for example, /v1/messages or /v1/responses).

      Parameters:
      path - The request path for this operation (for example, /v1/messages or /v1/responses).
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • providerPath

      InferenceOperationConfiguration.Builder providerPath(String providerPath)

      The provider path to forward requests to, if it differs from the request path. For example, /anthropic/v1/messages when the provider expects a different path than the client-facing /v1/messages.

      Parameters:
      providerPath - The provider path to forward requests to, if it differs from the request path. For example, /anthropic/v1/messages when the provider expects a different path than the client-facing /v1/messages.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • models

      InferenceOperationConfiguration.Builder models(Collection<ModelEntry> models)

      The list of models supported for this operation.

      Parameters:
      models - The list of models supported for this operation.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • models

      InferenceOperationConfiguration.Builder models(ModelEntry... models)

      The list of models supported for this operation.

      Parameters:
      models - The list of models supported for this operation.
      Returns:
      Returns a reference to this object so that method calls can be chained together.

    • models

      InferenceOperationConfiguration.Builder models(Consumer<ModelEntry.Builder>... models)

      The list of models supported for this operation.

      This is a convenience method that creates an instance of the ModelEntry.Builder avoiding the need to create one manually via ModelEntry.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to models(List<ModelEntry>).

      Parameters:
      models - a consumer that will call methods on ModelEntry.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also: