Class InferenceTargetConfiguration
- All Implemented Interfaces:
Serializable,SdkPojo,ToCopyableBuilder<InferenceTargetConfiguration.Builder,InferenceTargetConfiguration>
The configuration for an inference target. An inference target routes requests to a large language model (LLM) provider, either through a built-in connector or an explicitly configured provider.
- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic interfacestatic enum -
Method Summary
Modifier and TypeMethodDescriptionbuilder()The connector-based inference configuration.final booleanfinal booleanequalsBySdkFields(Object obj) Indicates whether some other object is "equal to" this one by SDK fields.static InferenceTargetConfigurationCreate an instance of this class withconnector()initialized to the given value.static InferenceTargetConfigurationCreate an instance of this class withconnector()initialized to the given value.static InferenceTargetConfigurationCreate an instance of this class withprovider()initialized to the given value.static InferenceTargetConfigurationCreate an instance of this class withprovider()initialized to the given value.final <T> Optional<T> getValueForField(String fieldName, Class<T> clazz) final inthashCode()provider()The provider-based inference configuration.static Class<? extends InferenceTargetConfiguration.Builder> Take this object and create a builder that contains all of the current property values of this object.final StringtoString()Returns a string representation of this object.type()Retrieve an enum value representing which member of this object is populated.Methods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder
copy
-
Method Details
-
connector
The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.
- Returns:
- The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.
-
provider
The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.
- Returns:
- The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.
-
toBuilder
Description copied from interface:ToCopyableBuilderTake this object and create a builder that contains all of the current property values of this object.- Specified by:
toBuilderin interfaceToCopyableBuilder<InferenceTargetConfiguration.Builder,InferenceTargetConfiguration> - Returns:
- a builder for type T
-
builder
-
serializableBuilderClass
-
hashCode
-
equals
-
equalsBySdkFields
Description copied from interface:SdkPojoIndicates whether some other object is "equal to" this one by SDK fields. An SDK field is a modeled, non-inherited field in anSdkPojoclass, and is generated based on a service model.If an
SdkPojoclass does not have any inherited fields,equalsBySdkFieldsandequalsare essentially the same.- Specified by:
equalsBySdkFieldsin interfaceSdkPojo- Parameters:
obj- the object to be compared with- Returns:
- true if the other object equals to this object by sdk fields, false otherwise.
-
toString
-
getValueForField
-
fromConnector
public static InferenceTargetConfiguration fromConnector(InferenceConnectorTargetConfiguration connector) Create an instance of this class withconnector()initialized to the given value.The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.
- Parameters:
connector- The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.
-
fromConnector
public static InferenceTargetConfiguration fromConnector(Consumer<InferenceConnectorTargetConfiguration.Builder> connector) Create an instance of this class withconnector()initialized to the given value.The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.
- Parameters:
connector- The connector-based inference configuration. Use this option to route requests to an LLM provider through a built-in connector that includes predefined provider rules.
-
fromProvider
public static InferenceTargetConfiguration fromProvider(InferenceProviderTargetConfiguration provider) Create an instance of this class withprovider()initialized to the given value.The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.
- Parameters:
provider- The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.
-
fromProvider
public static InferenceTargetConfiguration fromProvider(Consumer<InferenceProviderTargetConfiguration.Builder> provider) Create an instance of this class withprovider()initialized to the given value.The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.
- Parameters:
provider- The provider-based inference configuration. Use this option to explicitly configure the endpoint, model mapping, and operations for an LLM provider.
-
type
Retrieve an enum value representing which member of this object is populated. When this class is returned in a service response, this will beInferenceTargetConfiguration.Type.UNKNOWN_TO_SDK_VERSIONif the service returned a member that is only known to a newer SDK version. When this class is created directly in your code, this will beInferenceTargetConfiguration.Type.UNKNOWN_TO_SDK_VERSIONif zero members are set, andnullif more than one member is set. -
sdkFields
-
sdkFieldNameToField
- Specified by:
sdkFieldNameToFieldin interfaceSdkPojo- Returns:
- The mapping between the field name and its corresponding field.
-