Amazon Nova 配方
您可以从配方
您还可以通过 Amazon SageMaker Studio 访问 Amazon Nova 配方:进入模型中心,选择 AWS,浏览 Amazon Nova 模型,即可找到其关联的配方。Amazon SageMaker Studio 为每个配方都提供了示例笔记本,其中包括修改配方以及使用 SageMaker 训练作业或 SageMaker HyperPod 环境运行自定义作业的所有必要步骤。
要访问 Amazon SageMaker Studio 中的配方页面,执行角色必须具有以下权限。
要在 SageMaker 训练作业上执行示例笔记本,请使用以下 SageMaker 分发映像版本之一:2.7.1+、2.8.0+、3.2.1+、3.3.0+。这适用于 Amazon SageMaker Studio。
获取 Amazon Nova 配方
要获取基本 Amazon Nova 配方,请运行以下命令克隆配方
git clone https://github.com/aws/sagemaker-hyperpod-recipes.git
可通过 recipes_collection/recipes/
cd recipes_collection/recipes/
Amazon Nova 自定义配方位于以下文件夹中。
| 食谱类型 | Folder |
|---|---|
| SFT(全秩和 PEFT)、PPO、DPO(全秩和 PEFT) | fine-tuning/nova |
| 评估 | evaluation/nova |
| CPT | training/nova |
获取 Amazon Nova Forge 配方
如需访问作业专用的 Amazon Nova Forge 配方,请先完成 Amazon Nova Forge 访问权限设置,然后按照本讲习会
可用的模型和算法
下表汇总了 Amazon Nova 模型自定义功能的可用情况,以及使用 SageMaker 的支持算法。
模型名称 |
模型 ID |
微调 |
备注 |
|---|---|---|---|
Amazon Nova Lite 2.0 |
amazon.nova-2-lite-v1:0:256k |
是 |
|
Amazon Nova Lite
下表列出了 Amazon Nova Lite 配方参考的详细信息。
| 模型 | 类别/子类别 | 方法 | 配方名称 | 映像 URI(训练作业) | 映像 URI(SageMaker HyperPod) | 计算实例 |
|---|---|---|---|---|---|---|
| Nova Lite | 训练/微调 | 监督式微调(LoRA) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
|
| Nova Lite | 训练/微调 | 监督式微调(全秩) | nova_lite_1_0_p5_p4d_gpu_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Lite | 训练/微调 | 直接偏好优化(全秩) | nova_lite_1_0_p5_p4d_gpu_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Lite | 训练/微调 | 直接偏好优化(LoRA) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
|
| Nova Lite | 训练/强化学习 | 强化微调(RFT) | nova_lite_1_0_p5_gpu_ppo.yaml |
不适用 | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Lite | 训练/持续预训练 | 持续预训练(基本模型) | nova_lite_gpu_p5x16_pretrain.yaml |
不适用 | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest |
ml.p5.48xlarge |
| Nova Lite | 评估/评估 | 标准文本基准测试 | nova_lite_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Lite | 评估/评估 | 自定义数据集评估 | nova_lite_p5_48xl_bring_your_own_dataset_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Lite | 评估/评估 | 多模态基准测试 | nova_lite_p5_48_general_multi_modal_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Lite | 评估/评估 | LLM-as-a-Judge | nova_lite_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
Amazon Nova Micro
下表列出了 Amazon Nova Micro 配方参考的详细信息。
| 模型 | 类别/子类别 | 方法 | 配方名称 | 映像 URI(训练作业) | 映像 URI(SageMaker HyperPod) | 计算实例 |
|---|---|---|---|---|---|---|
| Nova Micro | 训练/微调 | 监督式微调(LoRA) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
|
| Nova Micro | 训练/微调 | 监督式微调(全秩) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
|
| Nova Micro | 训练/微调 | 直接偏好优化(LoRA) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
|
| Nova Micro | 训练/微调 | 直接偏好优化(全秩) | nova_micro_1_0_p5_p4d_gpu_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge, ml.p4d.24xlarge |
| Nova Micro | 训练/强化学习 | 强化微调(RFT) | nova_micro_1_0_p5_gpu_ppo.yaml |
不适用 | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Micro | 训练/持续预训练 | 持续预训练(基本模型) | nova_micro_gpu_p5x8_pretrain.yaml |
不适用 | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest |
ml.p5.48xlarge |
| Nova Micro | 评估/评估 | 一般文本基准测试 | nova_micro_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Micro | 评估/评估 | 自带数据集(gen_qa)基准测试 | nova_micro_p5_48xl_bring_your_own_dataset_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Micro | 评估/评估 | LLM-as-a-Judge | nova_micro_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
Amazon Nova Pro
下表列出了 Amazon Nova Pro 配方参考的详细信息。
| 模型 | 类别/子类别 | 方法 | 配方名称 | 映像 URI(训练作业) | 映像 URI(SageMaker HyperPod) | 计算实例 |
|---|---|---|---|---|---|---|
| Nova Pro | 训练/微调 | 监督式微调(LoRA) | nova_pro_1_0_p5_p4d_gpu_lora_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge, ml.p5en.48xlarge, ml.p4d.24xlarge |
| Nova Pro | 训练/微调 | 监督式微调(全秩) | nova_pro_1_0_p5_p4d_gpu_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Pro | 训练/微调 | 直接偏好优化(全秩) | nova_pro_1_0_p5_gpu_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Pro | 训练/微调 | 直接偏好优化(LoRA) | nova_pro_1_0_p5_p4d_gpu_lora_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge, ml.p4d.24xlarge |
| Nova Pro | 训练/强化学习 | 强化微调(RFT) | nova_pro_1_0_p5_gpu_ppo.yaml |
不适用 | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Pro | 训练/持续预训练 | 持续预训练(基本模型) | nova_pro_gpu_p5x24_pretrain.yaml |
不适用 | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest |
ml.p5.48xlarge |
| Nova Pro | 训练/数据增强 | 针对后训练的模型蒸馏 | nova_pro_r5_cpu_distill.yaml |
不适用 | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-distillation-repo:SM-TJ-DISTILL-LATEST |
ml.r5.24xlarge |
| Nova Pro | 评估/评估 | 标准文本基准测试 | nova_pro_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Pro | 评估/评估 | 自定义数据集评估 | nova_pro_p5_48xl_bring_your_own_dataset_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Pro | 评估/评估 | 多模态基准测试 | nova_pro_p5_48xl_general_multi_modal_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Pro | 评估/评估 | LLM-as-a-Judge | nova_pro_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |