/AWS1/IF_SGJ=>SAMPLE()¶
About Sample¶
Sends an inference request to the model during a job execution. The request and response bodies are forwarded to and from the model without modification. Each turn (prompt and response) is captured for later use.
Method Signature¶
METHODS /AWS1/IF_SGJ~SAMPLE
IMPORTING
!IV_JOBARN TYPE /AWS1/SGJJOBARN OPTIONAL
!IV_TRAJECTORYID TYPE /AWS1/SGJTRAJECTORYID OPTIONAL
!IV_BODY TYPE /AWS1/SGJINFERENCEREQUESTBODY OPTIONAL
RETURNING
VALUE(OO_OUTPUT) TYPE REF TO /aws1/cl_sgjsampleresponse
RAISING
/AWS1/CX_SGJACCESSDENIEDEX
/AWS1/CX_SGJINTSERVICEERROR
/AWS1/CX_SGJRESOURCENOTFOUNDEX
/AWS1/CX_SGJSERVICEQUOTAEXCDEX
/AWS1/CX_SGJTHROTTLINGEX
/AWS1/CX_SGJVLDTNEXCEPTION
/AWS1/CX_SGJCLIENTEXC
/AWS1/CX_SGJSERVEREXC
/AWS1/CX_RT_TECHNICAL_GENERIC
/AWS1/CX_RT_SERVICE_GENERIC.
IMPORTING¶
Required arguments:¶
iv_jobarn TYPE /AWS1/SGJJOBARN /AWS1/SGJJOBARN¶
The job ARN that identifies which model session to route the inference request to.
iv_trajectoryid TYPE /AWS1/SGJTRAJECTORYID /AWS1/SGJTRAJECTORYID¶
The trajectory ID for grouping turns into a single rollout. Each turn (prompt and response) is captured for later use.
iv_body TYPE /AWS1/SGJINFERENCEREQUESTBODY /AWS1/SGJINFERENCEREQUESTBODY¶
The raw inference request body in OpenAI-compatible JSON format.
RETURNING¶
oo_output TYPE REF TO /aws1/cl_sgjsampleresponse /AWS1/CL_SGJSAMPLERESPONSE¶
Examples¶
Syntax Example¶
This is an example of the syntax for calling the method. It includes every possible argument and initializes every possible value. The data provided is not necessarily semantically accurate (for example the value "string" may be provided for something that is intended to be an instance ID, or in some cases two arguments may be mutually exclusive). The syntax shows the ABAP syntax for creating the various data structures.
DATA(lo_result) = lo_client->sample(
iv_body = '5347567362473873563239796247513D'
iv_jobarn = |string|
iv_trajectoryid = |string|
).
This is an example of reading all possible response values
lo_result = lo_result.
IF lo_result IS NOT INITIAL.
lv_string = lo_result->get_contenttype( ).
lv_inferenceresponsebody = lo_result->get_body( ).
ENDIF.
Invoke Sample¶
Sends an inference request to the model and receives the response.
DATA(lo_result) = lo_client->sample(
iv_body = '65794A746232526C62434936496D31354C5731765A475673496977696257567A6332466E5A584D694F6C7437496E4A76624755694F694A316332567949697769593239756447567564434936496B686C62477876496E316466513D3D'
iv_jobarn = |arn:aws:sagemaker:us-east-1:123456789012:job/AgentRFT/my-training-job|
iv_trajectoryid = |trajectory-001|
).