PerformanceConfiguration¶
Structure Class¶
dataclass
¶
Performance settings for a model.
Attributes¶
class-attribute
instance-attribute
¶
latency: str = PerformanceConfigLatency('standard')
To use a latency-optimized version of the model, set to optimized.