本文為英文版的機器翻譯版本,如內容有任何歧義或不一致之處,概以英文版為準。
Amazon Nova 配方
您可以從配方儲存庫取得 Amazon Nova 配方
您也可以透過 Amazon SageMaker Studio 和導覽至模型中樞 AWS、選取和瀏覽 Amazon Nova 模型以尋找其相關聯的配方,來存取 Amazon Nova 配方。Amazon SageMaker Studio 和 都會為每個配方提供範例筆記本,其中包括修改配方並使用 SageMaker 訓練任務或 SageMaker HyperPod 環境執行自訂任務的所有必要步驟。
若要存取 Amazon SageMaker Studio 中的配方頁面,執行角色必須具有下列許可。
若要在 SageMaker 訓練任務 和 上執行範例筆記本,請使用下列其中一個 SageMaker 分佈映像版本:2.7.1+、2.8.0+、3.2.1+、3.3.0+。這同時適用於 Amazon SageMaker Studio 和 。
取得 Amazon Nova 配方
若要取得基本 Amazon Nova 配方,請執行下列命令來複製配方
git clone https://github.com/aws/sagemaker-hyperpod-recipes.git
基本配方可在 recipes_collection/recipes/
cd recipes_collection/recipes/
Amazon Nova 自訂配方位於下列資料夾中。
| 配方類型 | 資料夾 |
|---|---|
| SFT (全秩和 PEFT)、PPO、DPO (全秩和 PEFT) | fine-tuning/nova |
| 評估 | evaluation/nova |
| CPT | training/nova |
取得 Amazon Nova Forge 配方
若要存取任務專用的 Amazon Nova Forge 配方,請設定您對 Amazon Nova Forge 的存取權,然後遵循此研討會
可用的模型和演算法
下表摘要說明使用 SageMaker 自訂 Amazon Nova 模型和支援演算法的可用性。
模型名稱 |
模型 ID |
微調 |
備註 |
|---|---|---|---|
Amazon Nova Lite 2.0 |
amazon.nova-2-lite-v1:0:256k |
是 |
|
Amazon Nova Lite
下表列出 Amazon Nova Lite 配方參考的詳細資訊。
| 模型 | 類別/子類別 | 技術 | 配方名稱 | 映像 URI (訓練任務) | 映像 URI (SageMaker HyperPod) | 運算執行個體 |
|---|---|---|---|---|---|---|
| Nova Lite | 訓練/微調 | 監督式微調 (LoRA) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
|
| Nova Lite | 訓練/微調 | 監督式微調 (完整) | nova_lite_1_0_p5_p4d_gpu_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Lite | 訓練/微調 | 直接偏好最佳化 (完整) | nova_lite_1_0_p5_p4d_gpu_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Lite | 訓練/微調 | 直接偏好最佳化 (LoRA) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
|
| Nova Lite | 訓練/強化學習 | 強化微調 (RFT) | nova_lite_1_0_p5_gpu_ppo.yaml |
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Lite | 訓練/持續預先訓練 | 持續預先訓練 (基本模型) | nova_lite_gpu_p5x16_pretrain.yaml |
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest |
ml.p5.48xlarge |
| Nova Lite | 評估/評估 | 標準文字基準 | nova_lite_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Lite | 評估/評估 | 自訂資料集評估 | nova_lite_p5_48xl_bring_your_own_dataset_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Lite | 評估/評估 | 多模態基準 | nova_lite_p5_48_general_multi_modal_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Lite | 評估/評估 | LLM 即評審 | nova_lite_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
Amazon Nova Micro
下表列出 Amazon Nova Micro 配方參考的詳細資訊。
| 模型 | 類別/子類別 | 技術 | 配方名稱 | 映像 URI (訓練任務) | 映像 URI (SageMaker HyperPod) | 運算執行個體 |
|---|---|---|---|---|---|---|
| Nova Micro | 訓練/微調 | 監督式微調 (LoRA) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
|
| Nova Micro | 訓練/微調 | 監督式微調 (完整) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
|
| Nova Micro | 訓練/微調 | 直接偏好最佳化 (LoRA) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
|
| Nova Micro | 訓練/微調 | 直接偏好最佳化 (完整) | nova_micro_1_0_p5_p4d_gpu_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge, ml.p4d.24xlarge |
| Nova Micro | 訓練/強化學習 | 強化微調 (RFT) | nova_micro_1_0_p5_gpu_ppo.yaml |
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Micro | 訓練/持續預先訓練 | 持續預先訓練 (基本模型) | nova_micro_gpu_p5x8_pretrain.yaml |
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest |
ml.p5.48xlarge |
| Nova Micro | 評估/評估 | 一般文字基準 | nova_micro_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Micro | 評估/評估 | 使用自有資料集 (gen_qa) 基準 | nova_micro_p5_48xl_bring_your_own_dataset_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Micro | 評估/評估 | LLM 即評審 | nova_micro_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
Amazon Nova Pro
下表列出 Amazon Nova Pro 配方參考的詳細資訊。
| 模型 | 類別/子類別 | 技術 | 配方名稱 | 映像 URI (訓練任務) | 映像 URI (SageMaker HyperPod) | 運算執行個體 |
|---|---|---|---|---|---|---|
| Nova Pro | 訓練/微調 | 監督式微調 (LoRA) | nova_pro_1_0_p5_p4d_gpu_lora_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge, ml.p5en.48xlarge, ml.p4d.24xlarge |
| Nova Pro | 訓練/微調 | 監督式微調 (完整) | nova_pro_1_0_p5_p4d_gpu_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Pro | 訓練/微調 | 直接偏好最佳化 (完整) | nova_pro_1_0_p5_gpu_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Pro | 訓練/微調 | 直接偏好最佳化 (LoRA) | nova_pro_1_0_p5_p4d_gpu_lora_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge, ml.p4d.24xlarge |
| Nova Pro | 訓練/強化學習 | 強化微調 (RFT) | nova_pro_1_0_p5_gpu_ppo.yaml |
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Pro | 訓練/持續預先訓練 | 持續預先訓練 (基本模型) | nova_pro_gpu_p5x24_pretrain.yaml |
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest |
ml.p5.48xlarge |
| Nova Pro | 訓練/資料增強 | 用於訓練後模型蒸餾 | nova_pro_r5_cpu_distill.yaml |
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-distillation-repo:SM-TJ-DISTILL-LATEST |
ml.r5.24xlarge |
| Nova Pro | 評估/評估 | 標準文字基準 | nova_pro_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Pro | 評估/評估 | 自訂資料集評估 | nova_pro_p5_48xl_bring_your_own_dataset_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Pro | 評估/評估 | 多模態基準 | nova_pro_p5_48xl_general_multi_modal_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Pro | 評估/評估 | LLM 即評審 | nova_pro_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |