Amazon Nova 配方 - Amazon SageMaker AI

本文為英文版的機器翻譯版本,如內容有任何歧義或不一致之處,概以英文版為準。

Amazon Nova 配方

您可以從 SageMaker HyperPod 配方儲存庫取得 Amazon Nova 配方。Nova 配方是一種 YAML 組態檔案,可提供有關如何執行模型自訂任務的詳細資訊給 SageMaker AI。它提供基本模型名稱、設定訓練超參數、定義最佳化設定,並包含成功微調或訓練模型所需的任何其他選項。

您也可以透過 Amazon SageMaker Studio 和 Amazon SageMaker Unified Studio 存取 Nova 配方,方法是導覽至 JumpStart 模型中樞 AWS、選取和瀏覽 Amazon Nova 模型,以尋找其相關聯的配方。Amazon SageMaker Studio 和 Amazon SageMaker Unified Studio 都會為每個配方提供範例筆記本,其中包括使用 SageMaker AI 訓練任務或 Amazon SageMaker HyperPod 環境修改配方和執行自訂任務的所有必要步驟。

若要存取 Amazon SageMaker Studio 中的配方頁面,執行角色必須具有下列許可。

{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:GetObject" ], "Resource": [ "arn:aws:s3:::*model-customization-recipes*" ] } ] }

若要在 SageMaker 訓練任務和 SageMaker HyperPod 上執行範例筆記本,請使用下列其中一個 SageMaker 分佈映像版本:2.7.1+2.8.0+3.2.1+3.3.0+。這同時適用於 Amazon SageMaker Studio 和 Amazon SageMaker Unified Studio。

取得 Amazon Nova 配方

若要取得基本 Amazon Nova 配方,請執行下列命令來複製 SageMaker HyperPod 配方儲存庫。

git clone https://github.com/aws/sagemaker-hyperpod-recipes.git

基本配方可在 取得recipes_collection/recipes/

cd recipes_collection/recipes/

Amazon Nova 自訂配方位於下列資料夾中。

配方類型 資料夾
SFT (全排名和 PEFT)、PPO、DPO (全排名和 PEFT) 微調/創新
評估 評估/創新
CPT 訓練/創新

可用的模型和演算法

下表摘要說明使用 SageMaker AI 的 Amazon Nova 模型和支援演算法自訂的可用性。

模型名稱

模型 ID

微調

備註

Amazon Nova Micro

amazon.nova-micro-v1:0:128k

For both SFT and DPO, this model accepts text as input and produces text as output only.

Amazon Nova Lite

amazon.nova-lite-v1:0:300k

  • SFT - 接受文字和/或影像或文字和/或影片做為輸入,並產生文字做為輸出。單一任務無法在相同的執行中結合文字、影像和影片。

  • DPO - 接受文字和影像做為輸入,並產生文字做為輸出。

Amazon Nova Pro

amazon.nova-pro-v1:0:300k

  • SFT - 接受文字和/或影像或文字和/或影片做為輸入,並產生文字做為輸出。單一任務無法在相同的執行中結合文字、影像和影片。

  • DPO - 接受文字和影像做為輸入,並產生文字做為輸出。

Amazon Nova 配方參考

下表列出 Amazon Nova 配方參考的詳細資訊。

模型 類別/子類別 技術 配方名稱 映像 URI (SageMaker 訓練任務) 映像 URI (SageMaker HyperPod) 運算執行個體
Nova Lite 訓練/微調

受管微調 (LoRA)

nova_lite_p5_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest ml.p5.48xlarge
Nova Lite 訓練/微調

受管微調 (完整)

nova_lite_p5_gpu_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest ml.p5.48xlarge
Nova Lite 訓練/微調

直接偏好設定最佳化 (完整)

nova_lite_p5_gpu_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest ml.p5.48xlarge
Nova Lite 訓練/微調

直接偏好設定最佳化 (LoRA)

nova_lite_p5_gpu_lora_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest ml.p5.48xlarge
Nova Lite 訓練/強化學習

以獎勵為基礎的強化學習 (PPO)

nova_lite_p5_gpu_ppo.yaml N/A 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest ml.p5.48xlarge
Nova Lite 訓練/持續預先訓練 持續訓練前 (基礎模型) nova_lite_gpu_p5x16_pretrain.yaml N/A 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest ml.p5.48xlarge
Nova Lite 評估/評估 標準文字基準 nova_lite_p5_48xl_general_text_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Lite 評估/評估

自訂資料集評估

nova_lite_p5_48xl_bring_your_own_dataset_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Lite 評估/評估

多模態基準

nova_lite_p5_48_general_multi_modal_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Lite 評估/評估

LLM 作為判斷

nova_lite_p5_48xl_llm_judge_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Micro 訓練/微調

受管微調 (LoRA)

nova_micro_p5_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest ml.p5.48xlarge
Nova Micro 訓練/微調

受管微調 (完整)

nova_micro_p5_gpu_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest ml.p5.48xlarge
Nova Micro 訓練/微調

直接偏好設定最佳化 (完整)

nova_micro_p5_gpu_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest ml.p5.48xlarge
Nova Micro 訓練/微調

直接偏好設定最佳化 (LoRA)

nova_micro_p5_gpu_lora_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest ml.p5.48xlarge
Nova Micro 訓練/強化學習

以獎勵為基礎的強化學習 (PPO)

nova_micro_p5_gpu_ppo.yaml N/A 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest ml.p5.48xlarge
Nova Micro 訓練/持續預先訓練 持續預先訓練 (基本模型) nova_micro_gpu_p5x8_pretrain.yaml N/A 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest ml.p5.48xlarge
Nova Micro 評估/評估 一般文字基準 nova_micro_p5_48xl_general_text_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Micro 評估/評估

使用您自己的資料集 (gen_qa) 基準

nova_micro_p5_48xl_bring_your_own_dataset_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Micro 評估/評估

LLM 作為判斷

nova_micro_p5_48xl_llm_judge_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Pro 訓練/微調

受管微調 (LoRA)

nova_pro_p5_gpu_lora_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest ml.p5.48xlarge
Nova Pro 訓練/微調

受管微調 (完整)

nova_pro_p5_gpu_sft.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest ml.p5.48xlarge
Nova Pro 訓練/微調

直接偏好設定最佳化 (完整)

nova_pro_p5_gpu_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest ml.p5.48xlarge
Nova Pro 訓練/微調

直接偏好設定最佳化 (LoRA)

nova_pro_p5_gpu_lora_dpo.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest ml.p5.48xlarge
Nova Pro 訓練/強化學習

以獎勵為基礎的強化學習 (PPO)

nova_pro_p5_gpu_ppo.yaml N/A 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest ml.p5.48xlarge
Nova Pro 訓練/持續預先訓練 持續預先訓練 (基本模型) nova_pro_gpu_p5x24_pretrain.yaml N/A 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest ml.p5.48xlarge
Nova Pro 訓練/資料擴增 用於訓練後模型分割 nova_pro_r5_cpu_distill.yaml N/A 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-distillation-repo:SM-TJ-DISTILL-LATEST ml.r5.24xlarge
Nova Pro 評估/評估 標準文字基準 nova_pro_p5_48xl_general_text_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Pro 評估/評估 自訂資料集評估 nova_pro_p5_48xl_bring_your_own_dataset_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Pro 評估/評估 多模態基準 nova_pro_p5_48xl_general_multi_modal_benchmark_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Pro 評估/評估 LLM 作為判斷 nova_pro_p5_48xl_llm_judge_eval.yaml 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest ml.p5.48xlarge
Nova Premier 培訓 用於訓練後模型分割

nova_premier_r5_cpu_distill.yaml

708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-distillation-repo:SM-TJ-DISTILL-LATEST

N/A

ml.r5.24xlarge