Interface InferenceProviderTargetConfiguration.Builder

All Superinterfaces:

Buildable, CopyableBuilder<InferenceProviderTargetConfiguration.Builder,InferenceProviderTargetConfiguration>, SdkBuilder<InferenceProviderTargetConfiguration.Builder,InferenceProviderTargetConfiguration>, SdkPojo

Enclosing class:

InferenceProviderTargetConfiguration

@Mutable
@NotThreadSafe
public static interface InferenceProviderTargetConfiguration.Builder
extends SdkPojo, CopyableBuilder<InferenceProviderTargetConfiguration.Builder,InferenceProviderTargetConfiguration>

Method Summary

Modifier and Type	Method	Description
InferenceProviderTargetConfiguration.Builder	endpoint(String endpoint)	The HTTPS endpoint of the inference provider that the gateway forwards requests to.
default InferenceProviderTargetConfiguration.Builder	modelMapping(Consumer<ModelMapping.Builder> modelMapping)	The configuration that translates client-facing model IDs to the model IDs expected by the provider.
InferenceProviderTargetConfiguration.Builder	modelMapping(ModelMapping modelMapping)	The configuration that translates client-facing model IDs to the model IDs expected by the provider.
InferenceProviderTargetConfiguration.Builder	operations(Collection<InferenceOperationConfiguration> operations)	A list of per-operation configurations that map request paths to the models supported for each operation.
InferenceProviderTargetConfiguration.Builder	operations(Consumer<InferenceOperationConfiguration.Builder>... operations)	A list of per-operation configurations that map request paths to the models supported for each operation.
InferenceProviderTargetConfiguration.Builder	operations(InferenceOperationConfiguration... operations)	A list of per-operation configurations that map request paths to the models supported for each operation.

Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder

copy

Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder

applyMutation, build

Methods inherited from interface software.amazon.awssdk.core.SdkPojo

equalsBySdkFields, sdkFieldNameToField, sdkFields

Method Details

endpoint

InferenceProviderTargetConfiguration.Builder endpoint(String endpoint)

The HTTPS endpoint of the inference provider that the gateway forwards requests to.

Parameters:

endpoint - The HTTPS endpoint of the inference provider that the gateway forwards requests to.

Returns:

Returns a reference to this object so that method calls can be chained together.

modelMapping

InferenceProviderTargetConfiguration.Builder modelMapping(ModelMapping modelMapping)

The configuration that translates client-facing model IDs to the model IDs expected by the provider.

Parameters:

modelMapping - The configuration that translates client-facing model IDs to the model IDs expected by the provider.

Returns:

Returns a reference to this object so that method calls can be chained together.

modelMapping

default InferenceProviderTargetConfiguration.Builder modelMapping(Consumer<ModelMapping.Builder> modelMapping)

The configuration that translates client-facing model IDs to the model IDs expected by the provider.

This is a convenience method that creates an instance of the ModelMapping.Builder avoiding the need to create one manually via ModelMapping.builder().

When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to modelMapping(ModelMapping).

Parameters:

modelMapping - a consumer that will call methods on ModelMapping.Builder

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• modelMapping(ModelMapping)

operations

InferenceProviderTargetConfiguration.Builder operations(Collection<InferenceOperationConfiguration> operations)

A list of per-operation configurations that map request paths to the models supported for each operation.

Parameters:

operations - A list of per-operation configurations that map request paths to the models supported for each operation.

Returns:

Returns a reference to this object so that method calls can be chained together.

operations

InferenceProviderTargetConfiguration.Builder operations(InferenceOperationConfiguration... operations)

A list of per-operation configurations that map request paths to the models supported for each operation.

Parameters:

operations - A list of per-operation configurations that map request paths to the models supported for each operation.

Returns:

Returns a reference to this object so that method calls can be chained together.

operations

InferenceProviderTargetConfiguration.Builder operations(Consumer<InferenceOperationConfiguration.Builder>... operations)

A list of per-operation configurations that map request paths to the models supported for each operation.

This is a convenience method that creates an instance of the InferenceOperationConfiguration.Builder avoiding the need to create one manually via InferenceOperationConfiguration.builder() .

When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to operations(List<InferenceOperationConfiguration>).

Parameters:

operations - a consumer that will call methods on InferenceOperationConfiguration.Builder

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• operations(java.util.Collection<InferenceOperationConfiguration>)