Interface InferenceConfiguration.Builder

All Superinterfaces:

Buildable, CopyableBuilder<InferenceConfiguration.Builder,InferenceConfiguration>, SdkBuilder<InferenceConfiguration.Builder,InferenceConfiguration>, SdkPojo

Enclosing class:

InferenceConfiguration

@Mutable
@NotThreadSafe
public static interface InferenceConfiguration.Builder
extends SdkPojo, CopyableBuilder<InferenceConfiguration.Builder,InferenceConfiguration>

Method Summary

Modifier and Type	Method	Description
InferenceConfiguration.Builder	maxTokens(Integer maxTokens)	The maximum number of tokens to generate.
InferenceConfiguration.Builder	stopSequences(String... stopSequences)	Stop sequences that end generation.
InferenceConfiguration.Builder	stopSequences(Collection<String> stopSequences)	Stop sequences that end generation.
InferenceConfiguration.Builder	temperature(Float temperature)	The temperature for sampling.
InferenceConfiguration.Builder	topP(Float topP)	The top-p value for nucleus sampling.

Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder

copy

Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder

applyMutation, build

Methods inherited from interface software.amazon.awssdk.core.SdkPojo

equalsBySdkFields, sdkFieldNameToField, sdkFields

Method Details

maxTokens

InferenceConfiguration.Builder maxTokens(Integer maxTokens)

The maximum number of tokens to generate.

Parameters:

maxTokens - The maximum number of tokens to generate.

Returns:

Returns a reference to this object so that method calls can be chained together.

temperature

InferenceConfiguration.Builder temperature(Float temperature)

The temperature for sampling.

Parameters:

temperature - The temperature for sampling.

Returns:

Returns a reference to this object so that method calls can be chained together.

topP

InferenceConfiguration.Builder topP(Float topP)

The top-p value for nucleus sampling.

Parameters:

topP - The top-p value for nucleus sampling.

Returns:

Returns a reference to this object so that method calls can be chained together.

stopSequences

InferenceConfiguration.Builder stopSequences(Collection<String> stopSequences)

Stop sequences that end generation.

Parameters:

stopSequences - Stop sequences that end generation.

Returns:

Returns a reference to this object so that method calls can be chained together.

stopSequences

InferenceConfiguration.Builder stopSequences(String... stopSequences)

Stop sequences that end generation.

Parameters:

stopSequences - Stop sequences that end generation.

Returns:

Returns a reference to this object so that method calls can be chained together.