Amazon Nova recipes
You can get an Amazon Nova recipe from the SageMaker HyperPod recipes
You can also access Nova recipes through Amazon SageMaker Studio and Amazon SageMaker Unified Studio by navigating to the JumpStart model hub, selecting AWS, and browsing Amazon Nova models to find their associated recipes. Both Amazon SageMaker Studio and Amazon SageMaker Unified Studio provide sample notebooks for each recipe, which include all the necessary steps to modify the recipes and run customization jobs using SageMaker AI training jobs or Amazon SageMaker HyperPod environments.
To access the recipes pages in Amazon SageMaker Studio, the execution role must have the following permissions.
{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:GetObject" ], "Resource": [ "arn:aws:s3:::*model-customization-recipes*" ] } ] }
To execute the sample notebooks on SageMaker training jobs and SageMaker HyperPod, use one of the
following SageMaker distribution image versions: 2.7.1+
, 2.8.0+
, 3.2.1+
, 3.3.0+
. This applies
to both Amazon SageMaker Studio and Amazon SageMaker Unified Studio.
Getting Amazon Nova recipes
To get a base Amazon Nova recipe, clone the SageMaker HyperPod recipes
git clone https://github.com/aws/sagemaker-hyperpod-recipes.git
The base recipes are available at recipes_collection/recipes/
cd recipes_collection/recipes/
The Amazon Nova customization recipes are in the following folders.
Recipe type | Folder |
---|---|
SFT (Full-rank and PEFT), PPO, DPO (Full-rank and PEFT) | fine-tuning/nova |
Evaluation | evaluation/nova |
CPT | training/nova |
Available models and algorithms
The following table summarizes the availability of customization for Amazon Nova models and supported algorithms using SageMaker AI.
Model name |
Model ID |
Fine-tuning |
Notes |
---|---|---|---|
Amazon Nova Micro |
amazon.nova-micro-v1:0:128k |
Yes |
For both SFT and DPO, this model accepts text as input and produces text as output only. |
Amazon Nova Lite |
amazon.nova-lite-v1:0:300k |
Yes |
|
Amazon Nova Pro |
amazon.nova-pro-v1:0:300k |
Yes |
|
Amazon Nova recipes reference
The table below lists detailed information of the Amazon Nova recipes reference.
Model | Category/Sub-category | Technique | Recipe name | Image URI (SageMaker training jobs) | Image URI (SageMaker HyperPod) | Compute instance |
---|---|---|---|---|---|---|
Nova Lite | Training/Fine-tuning |
Supervised Fine-Tuning (LoRA) |
nova_lite_p5_gpu_lora_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest
|
ml.p5.48xlarge
|
Nova Lite | Training/Fine-tuning |
Supervised Fine-Tuning (Full) |
nova_lite_p5_gpu_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest
|
ml.p5.48xlarge
|
Nova Lite | Training/Fine-tuning |
Direct Preference Optimization (Full) |
nova_lite_p5_gpu_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge
|
Nova Lite | Training/Fine-tuning |
Direct Preference Optimization (LoRA) |
nova_lite_p5_gpu_lora_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge
|
Nova Lite | Training/Reinforcement learning |
Rewards Based Reinforcement Learning (PPO) |
nova_lite_p5_gpu_ppo.yaml
|
n/a |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest
|
ml.p5.48xlarge
|
Nova Lite | Training/Continued Pre-Training | Continued Pre-Training (base model) |
nova_lite_gpu_p5x16_pretrain.yaml
|
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest
|
ml.p5.48xlarge
|
Nova Lite | Evaluation/Evaluate | Standard text benchmarks |
nova_lite_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge
|
Nova Lite | Evaluation/Evaluate |
Custom dataset evaluation |
nova_lite_p5_48xl_bring_your_own_dataset_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge
|
Nova Lite | Evaluation/Evaluate |
Multi-modal benchmarks |
nova_lite_p5_48_general_multi_modal_benchmark_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge
|
Nova Lite | Evaluation/Evaluate |
LLM as a Judge |
nova_lite_p5_48xl_llm_judge_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge
|
Nova Micro | Training/Fine-tuning |
Supervised Fine-Tuning (LoRA) |
nova_micro_p5_gpu_lora_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest
|
ml.p5.48xlarge
|
Nova Micro | Training/Fine-tuning |
Supervised Fine-Tuning (Full) |
nova_micro_p5_gpu_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest
|
ml.p5.48xlarge
|
Nova Micro | Training/Fine-tuning |
Direct Preference Optimization (Full) |
nova_micro_p5_gpu_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge
|
Nova Micro | Training/Fine-tuning |
Direct Preference Optimization (LoRA) |
nova_micro_p5_gpu_lora_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge
|
Nova Micro | Training/Reinforcement learning |
Rewards Based Reinforcement Learning (PPO) |
nova_micro_p5_gpu_ppo.yaml
|
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest
|
ml.p5.48xlarge |
Nova Micro | Training/Continued Pre-Training | Continued Pre-Training (Base Model) |
nova_micro_gpu_p5x8_pretrain.yaml
|
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest
|
ml.p5.48xlarge |
Nova Micro | Evaluation/Evaluate | General text benchmark |
nova_micro_p5_48xl_general_text_benchmark_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Micro | Evaluation/Evaluate |
Bring your own dataset (gen_qa) benchmark |
nova_micro_p5_48xl_bring_your_own_dataset_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Micro | Evaluation/Evaluate |
LLM as a Judge |
nova_micro_p5_48xl_llm_judge_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Pro | Training/Fine-tuning |
Supervised Fine-Tuning (LoRA) |
nova_pro_p5_gpu_lora_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge
|
Nova Pro | Training/Fine-tuning |
Supervised Fine-Tuning (Full) |
nova_pro_p5_gpu_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge |
Nova Pro | Training/Fine-tuning |
Direct Preference Optimization (Full) |
nova_pro_p5_gpu_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge |
Nova Pro | Training/Fine-tuning |
Direct Preference Optimization (LoRA) |
nova_pro_p5_gpu_lora_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge |
Nova Pro | Training/Reinforcement learning |
Rewards Based Reinforcement Learning (PPO) |
nova_pro_p5_gpu_ppo.yaml
|
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest
|
ml.p5.48xlarge |
Nova Pro | Training/Continued Pre-Training | Continued Pre-Training (Base Model) |
nova_pro_gpu_p5x24_pretrain.yaml
|
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest
|
ml.p5.48xlarge |
Nova Pro | Training/Data augmentation | Model distillation for post-training |
nova_pro_r5_cpu_distill.yaml
|
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-distillation-repo:SM-TJ-DISTILL-LATEST
|
ml.r5.24xlarge
|
Nova Pro | Evaluation/Evaluate | Standard text benchmarks |
nova_pro_p5_48xl_general_text_benchmark_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Pro | Evaluation/Evaluate | Custom dataset evaluation |
nova_pro_p5_48xl_bring_your_own_dataset_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Pro | Evaluation/Evaluate | Multi-modal benchmarks |
nova_pro_p5_48xl_general_multi_modal_benchmark_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Pro | Evaluation/Evaluate | LLM as a Judge |
nova_pro_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Premier | Training | Model distillation for post-training |
|
|
n/a |
|