Class: Aws::SageMakerGatewayRuntime::Types::InvokeGlobalInferenceGatewayInput
- Inherits:
-
Struct
- Object
- Struct
- Aws::SageMakerGatewayRuntime::Types::InvokeGlobalInferenceGatewayInput
- Defined in:
- gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb
Overview
The request for InvokeGlobalInferenceGateway.
Constant Summary collapse
- SENSITIVE =
[:customer_identity_token, :body]
Instance Attribute Summary collapse
-
#accept ⇒ String
The MIME type you want for the response.
-
#body ⇒ String
The inference request body: one OpenAI JSON object, at most 10 MiB.
-
#content_type ⇒ String
The MIME type of the request body.
-
#customer_identity_token ⇒ String
Per-caller customer identity token (a JWT), forwarded unchanged to the inference gateway, which validates it.
-
#gateway_id ⇒ String
The ID of the Global Inference Gateway to invoke.
Instance Attribute Details
#accept ⇒ String
The MIME type you want for the response. It is passed to the model server.
204 205 206 207 208 209 210 211 212 |
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204 class InvokeGlobalInferenceGatewayInput < Struct.new( :gateway_id, :accept, :content_type, :customer_identity_token, :body) SENSITIVE = [:customer_identity_token, :body] include Aws::Structure end |
#body ⇒ String
The inference request body: one OpenAI JSON object, at most 10 MiB.
Its content is passed to the model server unchanged, except that the
request is always sent with "stream": false: this operation
returns one JSON document, so a "stream": true in the body is
overridden (use InvokeGlobalInferenceGatewayWithResponseStream to
stream). A body that is not one JSON object, or that repeats the
top-level model key with different values, is rejected with a 400
validation error. A body larger than 10 MiB is rejected with
PayloadTooLargeException (413). The gateway reads only model and
stream, and does not store the body.
204 205 206 207 208 209 210 211 212 |
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204 class InvokeGlobalInferenceGatewayInput < Struct.new( :gateway_id, :accept, :content_type, :customer_identity_token, :body) SENSITIVE = [:customer_identity_token, :body] include Aws::Structure end |
#content_type ⇒ String
The MIME type of the request body. Pass application/json
(parameters such as charset=utf-8 are allowed): the body is one
OpenAI JSON object. The Global Inference Gateway rejects other
content types with a 415 error.
204 205 206 207 208 209 210 211 212 |
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204 class InvokeGlobalInferenceGatewayInput < Struct.new( :gateway_id, :accept, :content_type, :customer_identity_token, :body) SENSITIVE = [:customer_identity_token, :body] include Aws::Structure end |
#customer_identity_token ⇒ String
Per-caller customer identity token (a JWT), forwarded unchanged to the inference gateway, which validates it. The gateway does not use it to authorize the request. Include it in the SigV4 signed headers so it cannot be altered in transit. Redacted from logs, metrics and traces.
204 205 206 207 208 209 210 211 212 |
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204 class InvokeGlobalInferenceGatewayInput < Struct.new( :gateway_id, :accept, :content_type, :customer_identity_token, :body) SENSITIVE = [:customer_identity_token, :body] include Aws::Structure end |
#gateway_id ⇒ String
The ID of the Global Inference Gateway to invoke. IAM policies refer
to the gateway by its ARN,
arn:<partition>:sagemaker:<region>:<account>:global-inference-gateway/<id>.
204 205 206 207 208 209 210 211 212 |
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204 class InvokeGlobalInferenceGatewayInput < Struct.new( :gateway_id, :accept, :content_type, :customer_identity_token, :body) SENSITIVE = [:customer_identity_token, :body] include Aws::Structure end |