/AWS1/CL_BDOINFERENCECONF¶
The configuration parameters that control how the foundation model behaves during evaluation, including response generation settings.
CONSTRUCTOR¶
IMPORTING¶
Optional arguments:¶
iv_maxtokens TYPE /AWS1/BDOINTEGER /AWS1/BDOINTEGER¶
The maximum number of tokens to generate in the model response during evaluation.
iv_temperature TYPE /AWS1/RT_FLOAT_AS_STRING /AWS1/RT_FLOAT_AS_STRING¶
The temperature value that controls randomness in the model's responses. Lower values produce more deterministic outputs.
iv_topp TYPE /AWS1/RT_FLOAT_AS_STRING /AWS1/RT_FLOAT_AS_STRING¶
The top-p sampling parameter that controls the diversity of the model's responses by limiting the cumulative probability of token choices.
it_stopsequences TYPE /AWS1/CL_BDONONEMPTYSTRLIST_W=>TT_NONEMPTYSTRINGLIST TT_NONEMPTYSTRINGLIST¶
The list of sequences that will cause the model to stop generating tokens when encountered.
Queryable Attributes¶
maxTokens¶
The maximum number of tokens to generate in the model response during evaluation.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_MAXTOKENS() |
Getter for MAXTOKENS, with configurable default |
ASK_MAXTOKENS() |
Getter for MAXTOKENS w/ exceptions if field has no value |
HAS_MAXTOKENS() |
Determine if MAXTOKENS has a value |
temperature¶
The temperature value that controls randomness in the model's responses. Lower values produce more deterministic outputs.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_TEMPERATURE() |
Getter for TEMPERATURE, with configurable default |
ASK_TEMPERATURE() |
Getter for TEMPERATURE w/ exceptions if field has no value |
STR_TEMPERATURE() |
String format for TEMPERATURE, with configurable default |
HAS_TEMPERATURE() |
Determine if TEMPERATURE has a value |
topP¶
The top-p sampling parameter that controls the diversity of the model's responses by limiting the cumulative probability of token choices.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_TOPP() |
Getter for TOPP, with configurable default |
ASK_TOPP() |
Getter for TOPP w/ exceptions if field has no value |
STR_TOPP() |
String format for TOPP, with configurable default |
HAS_TOPP() |
Determine if TOPP has a value |
stopSequences¶
The list of sequences that will cause the model to stop generating tokens when encountered.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_STOPSEQUENCES() |
Getter for STOPSEQUENCES, with configurable default |
ASK_STOPSEQUENCES() |
Getter for STOPSEQUENCES w/ exceptions if field has no value |
HAS_STOPSEQUENCES() |
Determine if STOPSEQUENCES has a value |