Builder

class Builder

Properties

Link copied to clipboard

The deployment configuration for the inference component. The configuration contains the desired deployment strategy and rollback settings.

Link copied to clipboard

The name of the inference component.

Link copied to clipboard

Runtime settings for a model that is deployed with an inference component.

Link copied to clipboard

Details about the resources to deploy with this inference component, including the model, container, and compute resources.

Link copied to clipboard

A list of specification objects for the inference component, one per instance type. Use this parameter when you want to specify different model or resource configurations for the inference component on each instance type. You can use either this parameter or the singular Specification parameter, but not both.