/AWS1/CL_SGMOPTIMIZATIONCONFIG¶
Settings for an optimization technique that you apply with a model optimization job.
CONSTRUCTOR¶
IMPORTING¶
Optional arguments:¶
io_modelquantizationconfig TYPE REF TO /AWS1/CL_SGMMDELQUANTIZATION00 /AWS1/CL_SGMMDELQUANTIZATION00¶
Settings for the model quantization technique that's applied by a model optimization job.
io_modelcompilationconfig TYPE REF TO /AWS1/CL_SGMMDELCOMPILATIONCFG /AWS1/CL_SGMMDELCOMPILATIONCFG¶
Settings for the model compilation technique that's applied by a model optimization job.
io_modelshardingconfig TYPE REF TO /AWS1/CL_SGMMODELSHARDINGCFG /AWS1/CL_SGMMODELSHARDINGCFG¶
Settings for the model sharding technique that's applied by a model optimization job.
io_mdelspeculativedecoding00 TYPE REF TO /AWS1/CL_SGMMDELSPECULATIVED00 /AWS1/CL_SGMMDELSPECULATIVED00¶
Settings for the model speculative decoding technique that's applied by a model optimization job.
Queryable Attributes¶
ModelQuantizationConfig¶
Settings for the model quantization technique that's applied by a model optimization job.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_MODELQUANTIZATIONCONFIG() |
Getter for MODELQUANTIZATIONCONFIG |
ModelCompilationConfig¶
Settings for the model compilation technique that's applied by a model optimization job.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_MODELCOMPILATIONCONFIG() |
Getter for MODELCOMPILATIONCONFIG |
ModelShardingConfig¶
Settings for the model sharding technique that's applied by a model optimization job.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_MODELSHARDINGCONFIG() |
Getter for MODELSHARDINGCONFIG |
ModelSpeculativeDecodingConfig¶
Settings for the model speculative decoding technique that's applied by a model optimization job.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_MDELSPECULATIVEDECODIN00() |
Getter for MODELSPECULATIVEDECODINGCFG |
Public Local Types In This Class¶
Internal table types, representing arrays and maps of this class, are defined as local types:
TT_OPTIMIZATIONCONFIGS¶
TYPES TT_OPTIMIZATIONCONFIGS TYPE STANDARD TABLE OF REF TO /AWS1/CL_SGMOPTIMIZATIONCONFIG WITH DEFAULT KEY
.