Class SamplingParams
- All Implemented Interfaces:
Serializable,SdkPojo,ToCopyableBuilder<SamplingParams.Builder,SamplingParams>
The parameters controlling the text generation sampling strategy.
- See Also:
-
Nested Class Summary
Nested Classes -
Method Summary
Modifier and TypeMethodDescriptionstatic SamplingParams.Builderbuilder()final booleanfinal booleanequalsBySdkFields(Object obj) Indicates whether some other object is "equal to" this one by SDK fields.final <T> Optional<T> getValueForField(String fieldName, Class<T> clazz) final inthashCode()final booleanhasStop()For responses, this returns true if the service returned a value for the Stop property.final IntegerThe maximum number of tokens to generate per sample.final Integerseed()The random seed for reproducible sampling.static Class<? extends SamplingParams.Builder> stop()The list of stop sequences that terminate generation when encountered in the output.final DoubleThe sampling temperature controlling randomness.Take this object and create a builder that contains all of the current property values of this object.final IntegertopK()The number of highest-probability vocabulary tokens to keep for top-k filtering.final DoubletopP()The cumulative probability threshold for nucleus (top-p) sampling.final StringtoString()Returns a string representation of this object.Methods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder
copy
-
Method Details
-
maxTokens
The maximum number of tokens to generate per sample.
- Returns:
- The maximum number of tokens to generate per sample.
-
temperature
The sampling temperature controlling randomness. Higher values produce more diverse outputs.
- Returns:
- The sampling temperature controlling randomness. Higher values produce more diverse outputs.
-
topK
The number of highest-probability vocabulary tokens to keep for top-k filtering. Set to -1 to disable.
- Returns:
- The number of highest-probability vocabulary tokens to keep for top-k filtering. Set to -1 to disable.
-
topP
The cumulative probability threshold for nucleus (top-p) sampling. Only tokens with cumulative probability below this threshold are considered.
- Returns:
- The cumulative probability threshold for nucleus (top-p) sampling. Only tokens with cumulative probability below this threshold are considered.
-
seed
The random seed for reproducible sampling. When set, the same seed with the same input produces deterministic outputs.
- Returns:
- The random seed for reproducible sampling. When set, the same seed with the same input produces deterministic outputs.
-
hasStop
public final boolean hasStop()For responses, this returns true if the service returned a value for the Stop property. This DOES NOT check that the value is non-empty (for which, you should check theisEmpty()method on the property). This is useful because the SDK will never return a null collection or map, but you may need to differentiate between the service returning nothing (or null) and the service returning an empty collection or map. For requests, this returns true if a value for the property was specified in the request builder, and false if a value was not specified. -
stop
The list of stop sequences that terminate generation when encountered in the output.
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
This method will never return null. If you would like to know whether the service returned this field (so that you can differentiate between null and empty), you can use the
hasStop()method.- Returns:
- The list of stop sequences that terminate generation when encountered in the output.
-
toBuilder
Description copied from interface:ToCopyableBuilderTake this object and create a builder that contains all of the current property values of this object.- Specified by:
toBuilderin interfaceToCopyableBuilder<SamplingParams.Builder,SamplingParams> - Returns:
- a builder for type T
-
builder
-
serializableBuilderClass
-
hashCode
-
equals
-
equalsBySdkFields
Description copied from interface:SdkPojoIndicates whether some other object is "equal to" this one by SDK fields. An SDK field is a modeled, non-inherited field in anSdkPojoclass, and is generated based on a service model.If an
SdkPojoclass does not have any inherited fields,equalsBySdkFieldsandequalsare essentially the same.- Specified by:
equalsBySdkFieldsin interfaceSdkPojo- Parameters:
obj- the object to be compared with- Returns:
- true if the other object equals to this object by sdk fields, false otherwise.
-
toString
-
getValueForField
-
sdkFields
-
sdkFieldNameToField
- Specified by:
sdkFieldNameToFieldin interfaceSdkPojo- Returns:
- The mapping between the field name and its corresponding field.
-