InferenceTargetConfiguration
The configuration for an inference target. An inference target routes requests to a large language model (LLM) provider, either through a built-in connector or an explicitly configured provider.
Inheritors
Types
The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.
The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.
Functions
Casts this InferenceTargetConfiguration as a Connector and retrieves its aws.sdk.kotlin.services.bedrockagentcorecontrol.model.InferenceConnectorTargetConfiguration value. Throws an exception if the InferenceTargetConfiguration is not a Connector.
Casts this InferenceTargetConfiguration as a Connector and retrieves its aws.sdk.kotlin.services.bedrockagentcorecontrol.model.InferenceConnectorTargetConfiguration value. Returns null if the InferenceTargetConfiguration is not a Connector.
Casts this InferenceTargetConfiguration as a Provider and retrieves its aws.sdk.kotlin.services.bedrockagentcorecontrol.model.InferenceProviderTargetConfiguration value. Throws an exception if the InferenceTargetConfiguration is not a Provider.
Casts this InferenceTargetConfiguration as a Provider and retrieves its aws.sdk.kotlin.services.bedrockagentcorecontrol.model.InferenceProviderTargetConfiguration value. Returns null if the InferenceTargetConfiguration is not a Provider.