Interface InferenceTargetConfiguration.Builder

All Superinterfaces:

Buildable, CopyableBuilder<InferenceTargetConfiguration.Builder,InferenceTargetConfiguration>, SdkBuilder<InferenceTargetConfiguration.Builder,InferenceTargetConfiguration>, SdkPojo

Enclosing class:

InferenceTargetConfiguration

@Mutable
@NotThreadSafe
public static interface InferenceTargetConfiguration.Builder
extends SdkPojo, CopyableBuilder<InferenceTargetConfiguration.Builder,InferenceTargetConfiguration>

Method Summary

Modifier and Type	Method	Description
default InferenceTargetConfiguration.Builder	connector(Consumer<InferenceConnectorTargetConfiguration.Builder> connector)	The connector-based inference configuration.
InferenceTargetConfiguration.Builder	connector(InferenceConnectorTargetConfiguration connector)	The connector-based inference configuration.
default InferenceTargetConfiguration.Builder	provider(Consumer<InferenceProviderTargetConfiguration.Builder> provider)	The provider-based inference configuration.
InferenceTargetConfiguration.Builder	provider(InferenceProviderTargetConfiguration provider)	The provider-based inference configuration.

Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder

copy

Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder

applyMutation, build

Methods inherited from interface software.amazon.awssdk.core.SdkPojo

equalsBySdkFields, sdkFieldNameToField, sdkFields

Method Details

connector

InferenceTargetConfiguration.Builder connector(InferenceConnectorTargetConfiguration connector)

The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.

Parameters:

connector - The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.

Returns:

Returns a reference to this object so that method calls can be chained together.

connector

default InferenceTargetConfiguration.Builder connector(Consumer<InferenceConnectorTargetConfiguration.Builder> connector)

The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.

This is a convenience method that creates an instance of the InferenceConnectorTargetConfiguration.Builder avoiding the need to create one manually via InferenceConnectorTargetConfiguration.builder().

When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to connector(InferenceConnectorTargetConfiguration).

Parameters:

connector - a consumer that will call methods on InferenceConnectorTargetConfiguration.Builder

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• connector(InferenceConnectorTargetConfiguration)

provider

InferenceTargetConfiguration.Builder provider(InferenceProviderTargetConfiguration provider)

The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.

Parameters:

provider - The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.

Returns:

Returns a reference to this object so that method calls can be chained together.

provider

default InferenceTargetConfiguration.Builder provider(Consumer<InferenceProviderTargetConfiguration.Builder> provider)

The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.

This is a convenience method that creates an instance of the InferenceProviderTargetConfiguration.Builder avoiding the need to create one manually via InferenceProviderTargetConfiguration.builder().

When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to provider(InferenceProviderTargetConfiguration).

Parameters:

provider - a consumer that will call methods on InferenceProviderTargetConfiguration.Builder

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• provider(InferenceProviderTargetConfiguration)