Class: Aws::SageMakerGatewayRuntime::Types::InvokeGlobalInferenceGatewayInput

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb

Overview

The request for InvokeGlobalInferenceGateway.

Constant Summary collapse

SENSITIVE =
[:customer_identity_token, :body]

Instance Attribute Summary collapse

Instance Attribute Details

#accept ⇒ String

The MIME type you want for the response. It is passed to the model server.

Returns:

  • (String)


204
205
206
207
208
209
210
211
212
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204

class InvokeGlobalInferenceGatewayInput < Struct.new(
  :gateway_id,
  :accept,
  :content_type,
  :customer_identity_token,
  :body)
  SENSITIVE = [:customer_identity_token, :body]
  include Aws::Structure
end

#body ⇒ String

The inference request body: one OpenAI JSON object, at most 10 MiB. Its content is passed to the model server unchanged, except that the request is always sent with "stream": false: this operation returns one JSON document, so a "stream": true in the body is overridden (use InvokeGlobalInferenceGatewayWithResponseStream to stream). A body that is not one JSON object, or that repeats the top-level model key with different values, is rejected with a 400 validation error. A body larger than 10 MiB is rejected with PayloadTooLargeException (413). The gateway reads only model and stream, and does not store the body.

Returns:

  • (String)


204
205
206
207
208
209
210
211
212
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204

class InvokeGlobalInferenceGatewayInput < Struct.new(
  :gateway_id,
  :accept,
  :content_type,
  :customer_identity_token,
  :body)
  SENSITIVE = [:customer_identity_token, :body]
  include Aws::Structure
end

#content_type ⇒ String

The MIME type of the request body. Pass application/json (parameters such as charset=utf-8 are allowed): the body is one OpenAI JSON object. The Global Inference Gateway rejects other content types with a 415 error.

Returns:

  • (String)


204
205
206
207
208
209
210
211
212
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204

class InvokeGlobalInferenceGatewayInput < Struct.new(
  :gateway_id,
  :accept,
  :content_type,
  :customer_identity_token,
  :body)
  SENSITIVE = [:customer_identity_token, :body]
  include Aws::Structure
end

#customer_identity_token ⇒ String

Per-caller customer identity token (a JWT), forwarded unchanged to the inference gateway, which validates it. The gateway does not use it to authorize the request. Include it in the SigV4 signed headers so it cannot be altered in transit. Redacted from logs, metrics and traces.

Returns:

  • (String)


204
205
206
207
208
209
210
211
212
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204

class InvokeGlobalInferenceGatewayInput < Struct.new(
  :gateway_id,
  :accept,
  :content_type,
  :customer_identity_token,
  :body)
  SENSITIVE = [:customer_identity_token, :body]
  include Aws::Structure
end

#gateway_id ⇒ String

The ID of the Global Inference Gateway to invoke. IAM policies refer to the gateway by its ARN, arn:<partition>:sagemaker:<region>:<account>:global-inference-gateway/<id>.

Returns:

  • (String)


204
205
206
207
208
209
210
211
212
# File 'gems/aws-sdk-sagemakergatewayruntime/lib/aws-sdk-sagemakergatewayruntime/types.rb', line 204

class InvokeGlobalInferenceGatewayInput < Struct.new(
  :gateway_id,
  :accept,
  :content_type,
  :customer_identity_token,
  :body)
  SENSITIVE = [:customer_identity_token, :body]
  include Aws::Structure
end