/AWS1/CL_BDAPROMPTMDELINFERE00¶
Contains inference configurations related to model inference for a prompt. For more information, see Inference parameters.
CONSTRUCTOR¶
IMPORTING¶
Optional arguments:¶
iv_temperature TYPE /AWS1/RT_FLOAT_AS_STRING /AWS1/RT_FLOAT_AS_STRING¶
Controls the randomness of the response. Choose a lower value for more predictable outputs and a higher value for more surprising outputs.
iv_topp TYPE /AWS1/RT_FLOAT_AS_STRING /AWS1/RT_FLOAT_AS_STRING¶
The percentage of most-likely candidates that the model considers for the next token.
iv_maxtokens TYPE /AWS1/BDAMAXIMUMLENGTH /AWS1/BDAMAXIMUMLENGTH¶
The maximum number of tokens to return in the response.
it_stopsequences TYPE /AWS1/CL_BDASTOPSEQUENCES_W=>TT_STOPSEQUENCES TT_STOPSEQUENCES¶
A list of strings that define sequences after which the model will stop generating.
Queryable Attributes¶
temperature¶
Controls the randomness of the response. Choose a lower value for more predictable outputs and a higher value for more surprising outputs.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_TEMPERATURE() |
Getter for TEMPERATURE, with configurable default |
ASK_TEMPERATURE() |
Getter for TEMPERATURE w/ exceptions if field has no value |
STR_TEMPERATURE() |
String format for TEMPERATURE, with configurable default |
HAS_TEMPERATURE() |
Determine if TEMPERATURE has a value |
topP¶
The percentage of most-likely candidates that the model considers for the next token.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_TOPP() |
Getter for TOPP, with configurable default |
ASK_TOPP() |
Getter for TOPP w/ exceptions if field has no value |
STR_TOPP() |
String format for TOPP, with configurable default |
HAS_TOPP() |
Determine if TOPP has a value |
maxTokens¶
The maximum number of tokens to return in the response.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_MAXTOKENS() |
Getter for MAXTOKENS, with configurable default |
ASK_MAXTOKENS() |
Getter for MAXTOKENS w/ exceptions if field has no value |
HAS_MAXTOKENS() |
Determine if MAXTOKENS has a value |
stopSequences¶
A list of strings that define sequences after which the model will stop generating.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_STOPSEQUENCES() |
Getter for STOPSEQUENCES, with configurable default |
ASK_STOPSEQUENCES() |
Getter for STOPSEQUENCES w/ exceptions if field has no value |
HAS_STOPSEQUENCES() |
Determine if STOPSEQUENCES has a value |