Amazon Bedrock inference

Once you've trained and tested your Amazon Nova model, you can deploy it to Amazon Bedrock for production-scale inference. The deployment process involves creating an Amazon Bedrock model with the CreateCustomModel API, exporting your model artifacts to it from a managed Amazon S3 bucket, and then once the model is ACTIVE configuring an endpoint with on-demand or provisioned-throughput inference.

You can also use the SageMaker Python SDK to deploy customized Amazon Nova models to Amazon Bedrock On-Demand or SageMaker AI Real-time Inference endpoints. For more information, see Customizing with SageMaker Python SDK.

For detailed steps to set up Amazon Bedrock inference for a custom model, see the following section.