Terjemahan disediakan oleh mesin penerjemah. Jika konten terjemahan yang diberikan bertentangan dengan versi bahasa Inggris aslinya, utamakan versi bahasa Inggris.
Resep Amazon Nova
Anda bisa mendapatkan resep Amazon Nova dari repositori
Anda juga dapat mengakses resep Amazon Nova melalui Amazon SageMaker Studio dan JumpStart dengan menavigasi ke hub SageMaker JumpStart model, memilih AWS, dan menelusuri model Amazon Nova untuk menemukan resep terkait. Baik Amazon SageMaker Studio dan JumpStart menyediakan buku catatan sampel untuk setiap resep, yang mencakup semua langkah yang diperlukan untuk memodifikasi resep dan menjalankan pekerjaan penyesuaian menggunakan pekerjaan atau SageMaker HyperPod lingkungan SageMaker pelatihan.
Untuk mengakses halaman resep di Amazon SageMaker Studio, peran eksekusi harus memiliki izin berikut.
Untuk menjalankan contoh buku catatan pada pekerjaan SageMaker pelatihan dan SageMaker HyperPod, gunakan salah satu versi gambar SageMaker distribusi berikut:2.7.1+,2.8.0+,3.2.1+,3.3.0+. Ini berlaku untuk Amazon SageMaker Studio dan JumpStart.
Topik
Mendapatkan resep Amazon Nova
Untuk mendapatkan resep dasar Amazon Nova, kloning repositori
git clone https://github.com/aws/sagemaker-hyperpod-recipes.git
Resep dasar tersedia di recipes_collection/recipes/
cd recipes_collection/recipes/
Resep kustomisasi Amazon Nova ada di folder berikut.
| Jenis resep | Folder |
|---|---|
| SFT (Full-rank dan PEFT), PPO, DPO (Full-rank dan PEFT) | baik- tuning/nova |
| Evaluasi | evaluation/nova |
| CPT | training/nova |
Mendapatkan resep Amazon Nova Forge
Untuk mengakses resep Amazon Nova Forge khusus untuk SageMaker HyperPod pekerjaan, harap atur akses Anda ke Amazon Nova Forge dan kemudian ikuti lokakarya ini
Model dan algoritma yang tersedia
Tabel berikut merangkum ketersediaan penyesuaian untuk model Amazon Nova dan algoritma yang didukung menggunakan SageMaker.
Nama model |
Model ID |
Fine-tuning |
Catatan |
|---|---|---|---|
Amazon Nova Lite 2.0 |
amazon.nova-2-lite-v 1:0:256k |
Ya |
|
Amazon Nova Lite
Tabel di bawah ini mencantumkan informasi terperinci dari referensi resep Amazon Nova Lite.
| Model | Category/Sub-category | Teknik | Nama Resep | URI Gambar (Pekerjaan Pelatihan) | URI gambar (SageMaker HyperPod) | Instans Komputasi |
|---|---|---|---|---|---|---|
| Nova Lite | Training/Fine-tuning | Diawasi Fine-Tuning (LoRa) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
|
| Nova Lite | Training/Fine-tuning | Diawasi Fine-Tuning (Penuh) | nova_lite_1_0_p5_p4d_gpu_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Lite | Training/Fine-tuning | Optimasi Preferensi Langsung (Penuh) | nova_lite_1_0_p5_p4d_gpu_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Lite | Training/Fine-tuning | Optimasi Preferensi Langsung (LoRa) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
|
| Nova Lite | Training/Reinforcement belajar | Penguatan Fine-Tuning (RFT) | nova_lite_1_0_p5_gpu_ppo.yaml |
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Lite | Training/Continued Pre-Training | Lanjutan Pre-Training (model dasar) | nova_lite_gpu_p5x16_pretrain.yaml |
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest |
ml.p5.48xlarge |
| Nova Lite | Evaluation/Evaluate | Tolok ukur teks standar | nova_lite_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Lite | Evaluation/Evaluate | Evaluasi kumpulan data kustom | nova_lite_p5_48xl_bring_your_own_dataset_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Lite | Evaluation/Evaluate | Multi-modal tolok ukur | nova_lite_p5_48_general_multi_modal_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Lite | Evaluation/Evaluate | LLM sebagai Hakim | nova_lite_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
Amazon Nova Mikro
Tabel di bawah ini mencantumkan informasi terperinci dari referensi resep Amazon Nova Micro.
| Model | Category/Sub-category | Teknik | Nama Resep | URI Gambar (Pekerjaan Pelatihan) | URI gambar (SageMaker HyperPod) | Instans Komputasi |
|---|---|---|---|---|---|---|
| Nova Mikro | Training/Fine-tuning | Diawasi Fine-Tuning (LoRa) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
|
| Nova Mikro | Training/Fine-tuning | Diawasi Fine-Tuning (Penuh) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
|
| Nova Mikro | Training/Fine-tuning | Pengoptimalan Preferensi Langsung (LoRa) |
|
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
|
| Nova Mikro | Training/Fine-tuning | Optimasi Preferensi Langsung (Penuh) | nova_micro_1_0_p5_p4d_gpu_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge, ml.p4d.24xlarge |
| Nova Mikro | Training/Reinforcement belajar | Penguatan Fine-Tuning (RFT) | nova_micro_1_0_p5_gpu_ppo.yaml |
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| Nova Mikro | Training/Continued Pre-Training | Lanjutan Pre-Training (Model Dasar) | nova_micro_gpu_p5x8_pretrain.yaml |
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest |
ml.p5.48xlarge |
| Nova Mikro | Evaluation/Evaluate | Tolok ukur teks umum | nova_micro_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Mikro | Evaluation/Evaluate | Bawa benchmark dataset Anda sendiri (gen_qa) | nova_micro_p5_48xl_bring_your_own_dataset_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| Nova Mikro | Evaluation/Evaluate | LLM sebagai Hakim | nova_micro_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
Amazon Nova Pro
Tabel di bawah ini mencantumkan informasi terperinci dari referensi resep Amazon Nova Pro.
| Model | Category/Sub-category | Teknik | Nama Resep | URI Gambar (Pekerjaan Pelatihan) | URI gambar (SageMaker HyperPod) | Instans Komputasi |
|---|---|---|---|---|---|---|
| New Pro | Training/Fine-tuning | Diawasi Fine-Tuning (LoRa) | nova_pro_1_0_p5_p4d_gpu_lora_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge, ml.p5en.48xlarge, ml.p4d.24xlarge |
| New Pro | Training/Fine-tuning | Diawasi Fine-Tuning (Penuh) | nova_pro_1_0_p5_p4d_gpu_sft.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-SFT-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-SFT-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| New Pro | Training/Fine-tuning | Optimasi Preferensi Langsung (Penuh) | nova_pro_1_0_p5_gpu_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| New Pro | Training/Fine-tuning | Pengoptimalan Preferensi Langsung (LoRa) | nova_pro_1_0_p5_p4d_gpu_lora_dpo.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-TJ-DPO-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SM-HP-DPO-latest |
ml.p5.48xlarge, ml.p5en.48xlarge, ml.p4d.24xlarge |
| New Pro | Training/Reinforcement belajar | Penguatan Fine-Tuning (RFT) | nova_pro_1_0_p5_gpu_ppo.yaml |
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:SMHP-PPO-TRAIN-latest |
ml.p5.48xlarge, ml.p5en.48xlarge |
| New Pro | Training/Continued Pre-Training | Lanjutan Pre-Training (Model Dasar) | nova_pro_gpu_p5x24_pretrain.yaml |
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-fine-tune-repo:HP-CPT-latest |
ml.p5.48xlarge |
| New Pro | Training/Data augmentasi | Model distilasi untuk pasca-pelatihan | nova_pro_r5_cpu_distill.yaml |
n/a | 708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-distillation-repo:SM-TJ-DISTILL-LATEST |
ml.r5.24xlarge |
| New Pro | Evaluation/Evaluate | Tolok ukur teks standar | nova_pro_p5_48xl_general_text_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| New Pro | Evaluation/Evaluate | Evaluasi kumpulan data kustom | nova_pro_p5_48xl_bring_your_own_dataset_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| New Pro | Evaluation/Evaluate | Multi-modal tolok ukur | nova_pro_p5_48xl_general_multi_modal_benchmark_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |
| New Pro | Evaluation/Evaluate | LLM sebagai Hakim | nova_pro_p5_48xl_llm_judge_eval.yaml |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-TJ-Eval-latest |
708977205387.dkr.ecr.us-east-1.amazonaws.com/nova-evaluation-repo:SM-HP-Eval-latest |
ml.p5.48xlarge |