Interface SampleOperationConfig.Builder

All Superinterfaces:

Buildable, CopyableBuilder<SampleOperationConfig.Builder,SampleOperationConfig>, SdkBuilder<SampleOperationConfig.Builder,SampleOperationConfig>, SdkPojo

Enclosing class:

SampleOperationConfig

@Mutable
@NotThreadSafe
public static interface SampleOperationConfig.Builder
extends SdkPojo, CopyableBuilder<SampleOperationConfig.Builder,SampleOperationConfig>

Method Summary

Modifier and Type	Method	Description
default SampleOperationConfig.Builder	computeLogprobs(Consumer<ComputeLogprobsConfig.Builder> computeLogprobs)	The configuration for computing log-probabilities of prompt tokens without generating new text.
SampleOperationConfig.Builder	computeLogprobs(ComputeLogprobsConfig computeLogprobs)	The configuration for computing log-probabilities of prompt tokens without generating new text.
default SampleOperationConfig.Builder	loadWeightsForSampling(Consumer<LoadWeightsForSamplingConfig.Builder> loadWeightsForSampling)	The configuration for loading model weights for inference and sampling without restoring optimizer state.
SampleOperationConfig.Builder	loadWeightsForSampling(LoadWeightsForSamplingConfig loadWeightsForSampling)	The configuration for loading model weights for inference and sampling without restoring optimizer state.
default SampleOperationConfig.Builder	sample(Consumer<SampleConfig.Builder> sample)	The configuration for generating text samples from the model.
SampleOperationConfig.Builder	sample(SampleConfig sample)	The configuration for generating text samples from the model.

Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder

copy

Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder

applyMutation, build

Methods inherited from interface software.amazon.awssdk.core.SdkPojo

equalsBySdkFields, sdkFieldNameToField, sdkFields

Method Details

sample

SampleOperationConfig.Builder sample(SampleConfig sample)

The configuration for generating text samples from the model.

Parameters:

sample - The configuration for generating text samples from the model.

Returns:

Returns a reference to this object so that method calls can be chained together.

sample

default SampleOperationConfig.Builder sample(Consumer<SampleConfig.Builder> sample)

The configuration for generating text samples from the model.

This is a convenience method that creates an instance of the SampleConfig.Builder avoiding the need to create one manually via SampleConfig.builder().

When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to sample(SampleConfig).

Parameters:

sample - a consumer that will call methods on SampleConfig.Builder

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• sample(SampleConfig)

computeLogprobs

SampleOperationConfig.Builder computeLogprobs(ComputeLogprobsConfig computeLogprobs)

The configuration for computing log-probabilities of prompt tokens without generating new text.

Parameters:

computeLogprobs - The configuration for computing log-probabilities of prompt tokens without generating new text.

Returns:

Returns a reference to this object so that method calls can be chained together.

computeLogprobs

default SampleOperationConfig.Builder computeLogprobs(Consumer<ComputeLogprobsConfig.Builder> computeLogprobs)

The configuration for computing log-probabilities of prompt tokens without generating new text.

This is a convenience method that creates an instance of the ComputeLogprobsConfig.Builder avoiding the need to create one manually via ComputeLogprobsConfig.builder().

When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to computeLogprobs(ComputeLogprobsConfig).

Parameters:

computeLogprobs - a consumer that will call methods on ComputeLogprobsConfig.Builder

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• computeLogprobs(ComputeLogprobsConfig)

loadWeightsForSampling

SampleOperationConfig.Builder loadWeightsForSampling(LoadWeightsForSamplingConfig loadWeightsForSampling)

The configuration for loading model weights for inference and sampling without restoring optimizer state.

Parameters:

loadWeightsForSampling - The configuration for loading model weights for inference and sampling without restoring optimizer state.

Returns:

Returns a reference to this object so that method calls can be chained together.

loadWeightsForSampling

default SampleOperationConfig.Builder loadWeightsForSampling(Consumer<LoadWeightsForSamplingConfig.Builder> loadWeightsForSampling)

The configuration for loading model weights for inference and sampling without restoring optimizer state.

This is a convenience method that creates an instance of the LoadWeightsForSamplingConfig.Builder avoiding the need to create one manually via LoadWeightsForSamplingConfig.builder().

When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to loadWeightsForSampling(LoadWeightsForSamplingConfig).

Parameters:

loadWeightsForSampling - a consumer that will call methods on LoadWeightsForSamplingConfig.Builder

Returns:

Returns a reference to this object so that method calls can be chained together.

See Also:

• loadWeightsForSampling(LoadWeightsForSamplingConfig)