本文為英文版的機器翻譯版本,如內容有任何歧義或不一致之處,概以英文版為準。
Amazon Nova 配方
您可以從 SageMaker HyperPod 配方儲存庫取得 Amazon Nova 配方
您也可以透過 Amazon SageMaker Studio 和 Amazon SageMaker Unified Studio 存取 Nova 配方,方法是導覽至 JumpStart 模型中樞 AWS、選取和瀏覽 Amazon Nova 模型,以尋找其相關聯的配方。Amazon SageMaker Studio 和 Amazon SageMaker Unified Studio 都會為每個配方提供範例筆記本,其中包括使用 SageMaker AI 訓練任務或 Amazon SageMaker HyperPod 環境修改配方和執行自訂任務的所有必要步驟。
若要存取 Amazon SageMaker Studio 中的配方頁面,執行角色必須具有下列許可。
{ "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "s3:GetObject" ], "Resource": [ "arn:aws:s3:::*model-customization-recipes*" ] } ] }
若要在 SageMaker 訓練任務和 SageMaker HyperPod 上執行範例筆記本,請使用下列其中一個 SageMaker 分佈映像版本:2.7.1+
、2.8.0+
、3.2.1+
、3.3.0+
。這同時適用於 Amazon SageMaker Studio 和 Amazon SageMaker Unified Studio。
取得 Amazon Nova 配方
若要取得基本 Amazon Nova 配方,請執行下列命令來複製 SageMaker HyperPod 配方
git clone https://github.com/aws/sagemaker-hyperpod-recipes.git
基本配方可在 取得recipes_collection/recipes/
cd recipes_collection/recipes/
Amazon Nova 自訂配方位於下列資料夾中。
可用的模型和演算法
下表摘要說明使用 SageMaker AI 的 Amazon Nova 模型和支援演算法自訂的可用性。
模型名稱 |
模型 ID |
微調 |
備註 |
---|---|---|---|
Amazon Nova Micro |
amazon.nova-micro-v1:0:128k |
是 |
For both SFT and DPO, this model accepts text as input and produces text as output only. |
Amazon Nova Lite |
amazon.nova-lite-v1:0:300k |
是 |
|
Amazon Nova Pro |
amazon.nova-pro-v1:0:300k |
是 |
|
Amazon Nova 配方參考
下表列出 Amazon Nova 配方參考的詳細資訊。
模型 | 類別/子類別 | 技術 | 配方名稱 | 映像 URI (SageMaker 訓練任務) | 映像 URI (SageMaker HyperPod) | 運算執行個體 |
---|---|---|---|---|---|---|
Nova Lite | 訓練/微調 |
受管微調 (LoRA) |
nova_lite_p5_gpu_lora_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest
|
ml.p5.48xlarge
|
Nova Lite | 訓練/微調 |
受管微調 (完整) |
nova_lite_p5_gpu_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest
|
ml.p5.48xlarge
|
Nova Lite | 訓練/微調 |
直接偏好設定最佳化 (完整) |
nova_lite_p5_gpu_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge
|
Nova Lite | 訓練/微調 |
直接偏好設定最佳化 (LoRA) |
nova_lite_p5_gpu_lora_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge
|
Nova Lite | 訓練/強化學習 |
以獎勵為基礎的強化學習 (PPO) |
nova_lite_p5_gpu_ppo.yaml
|
N/A |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest
|
ml.p5.48xlarge
|
Nova Lite | 訓練/持續預先訓練 | 持續訓練前 (基礎模型) |
nova_lite_gpu_p5x16_pretrain.yaml
|
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest
|
ml.p5.48xlarge
|
Nova Lite | 評估/評估 | 標準文字基準 |
nova_lite_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge
|
Nova Lite | 評估/評估 |
自訂資料集評估 |
nova_lite_p5_48xl_bring_your_own_dataset_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge
|
Nova Lite | 評估/評估 |
多模態基準 |
nova_lite_p5_48_general_multi_modal_benchmark_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge
|
Nova Lite | 評估/評估 |
LLM 作為判斷 |
nova_lite_p5_48xl_llm_judge_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge
|
Nova Micro | 訓練/微調 |
受管微調 (LoRA) |
nova_micro_p5_gpu_lora_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest
|
ml.p5.48xlarge
|
Nova Micro | 訓練/微調 |
受管微調 (完整) |
nova_micro_p5_gpu_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest
|
ml.p5.48xlarge
|
Nova Micro | 訓練/微調 |
直接偏好設定最佳化 (完整) |
nova_micro_p5_gpu_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge
|
Nova Micro | 訓練/微調 |
直接偏好設定最佳化 (LoRA) |
nova_micro_p5_gpu_lora_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge
|
Nova Micro | 訓練/強化學習 |
以獎勵為基礎的強化學習 (PPO) |
nova_micro_p5_gpu_ppo.yaml
|
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest
|
ml.p5.48xlarge |
Nova Micro | 訓練/持續預先訓練 | 持續預先訓練 (基本模型) |
nova_micro_gpu_p5x8_pretrain.yaml
|
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest
|
ml.p5.48xlarge |
Nova Micro | 評估/評估 | 一般文字基準 |
nova_micro_p5_48xl_general_text_benchmark_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Micro | 評估/評估 |
使用您自己的資料集 (gen_qa) 基準 |
nova_micro_p5_48xl_bring_your_own_dataset_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Micro | 評估/評估 |
LLM 作為判斷 |
nova_micro_p5_48xl_llm_judge_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Pro | 訓練/微調 |
受管微調 (LoRA) |
nova_pro_p5_gpu_lora_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge
|
Nova Pro | 訓練/微調 |
受管微調 (完整) |
nova_pro_p5_gpu_sft.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge |
Nova Pro | 訓練/微調 |
直接偏好設定最佳化 (完整) |
nova_pro_p5_gpu_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge |
Nova Pro | 訓練/微調 |
直接偏好設定最佳化 (LoRA) |
nova_pro_p5_gpu_lora_dpo.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest
|
ml.p5.48xlarge |
Nova Pro | 訓練/強化學習 |
以獎勵為基礎的強化學習 (PPO) |
nova_pro_p5_gpu_ppo.yaml
|
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest
|
ml.p5.48xlarge |
Nova Pro | 訓練/持續預先訓練 | 持續預先訓練 (基本模型) |
nova_pro_gpu_p5x24_pretrain.yaml
|
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest
|
ml.p5.48xlarge |
Nova Pro | 訓練/資料擴增 | 用於訓練後模型分割 |
nova_pro_r5_cpu_distill.yaml
|
N/A | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-distillation-repo:SM-TJ-DISTILL-LATEST
|
ml.r5.24xlarge
|
Nova Pro | 評估/評估 | 標準文字基準 |
nova_pro_p5_48xl_general_text_benchmark_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Pro | 評估/評估 | 自訂資料集評估 |
nova_pro_p5_48xl_bring_your_own_dataset_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Pro | 評估/評估 | 多模態基準 |
nova_pro_p5_48xl_general_multi_modal_benchmark_eval.yaml
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Pro | 評估/評估 | LLM 作為判斷 |
nova_pro_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest
|
ml.p5.48xlarge |
Nova Premier | 培訓 | 用於訓練後模型分割 |
|
|
N/A |
|