View a markdown version of this page

Optimize consumption of high-performance compute - Generative AI Lens

Optimize consumption of high-performance compute

GENPERF03: How do you optimize computational resources required for high-performance distributed computation tasks?

Foundation models require high processing power to customize and deliver inference at scale. This is true whether you are training a foundation model, customizing it, or using one for inference. Optimize consumption of high-performance compute used for foundation models in order to meet performance requirements.