Terjemahan disediakan oleh mesin penerjemah. Jika konten terjemahan yang diberikan bertentangan dengan versi bahasa Inggris aslinya, utamakan versi bahasa Inggris.

# Instruksi Llama 3.1 405B
<a name="model-card-meta-llama-3-1-405b-instruct"></a>

## ![Simbol infinity biru atau ikon angka delapan pada latar belakang putih.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/models/meta.png) Meta — Llama 3.1 405B Instruksi
<a name="model-card-meta-llama-3-1-405b-instruct-header"></a>

## Detail Model
<a name="model-card-meta-llama-3-1-405b-instruct-details"></a>

Llama 3.1 405B Instruct adalah model terbuka terbesar Meta dengan 405 miliar parameter dan jendela konteks 128K, mendukung penggunaan alat dan tugas multibahasa. Untuk informasi lebih lanjut tentang pengembangan dan kinerja model, lihat [model/service kartu](https://www.llama.com/docs/model-cards-and-prompt-formats/llama3_1/).
+ **Tanggal peluncuran model:** 23 Juli 2024
+ **Tanggal model EOL:** Warisan: 7 Juli 2026
+ **Perjanjian Lisensi Pengguna Akhir dan Ketentuan Penggunaan:** [Lihat](https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/LICENSE)
+ **Siklus hidup model: Warisan**
+ **Jendela konteks:** 128K token
+ **Token keluaran maks:** 4K
+ Batas **pengetahuan: Des 2023**


| **Modalitas Masukan** | **Modalitas Keluaran** | **[API didukung](https://docs.aws.amazon.com/bedrock/latest/userguide/apis.html)** | **[Endpoint didukung](https://docs.aws.amazon.com/bedrock/latest/userguide/endpoints.html)** | 
| --- | --- | --- | --- | 
| ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)Audio | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)Menyematkan | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) Responses | ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png) bedrock-runtime | 
| ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)Gambar | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)Gambar | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) Chat Completions | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) bedrock-mantle | 
| ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)Pidato | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)Pidato | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) Invoke |  | 
| ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png)Teks | ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png)Teks | ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png) Converse |  | 
| ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)Video | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)Video |  |  | 

## Kemampuan dan Fitur
<a name="model-card-meta-llama-3-1-405b-instruct-capabilities"></a>

***Fitur Batuan Dasar***

**Fitur yang didukung menggunakan `bedrock-runtime` endpoint**


| **Didukung** | **Tidak Didukung** | 
| --- | --- | 
|  + ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png)[Streaming respons](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InvokeModelWithResponseStream.html)<br />+ ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png)[Pagar pembatas](https://docs.aws.amazon.com/bedrock/latest/userguide/guardrails.html)<br />+ ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png)[Client-side alat panggilan](https://docs.aws.amazon.com/bedrock/latest/userguide/tool-use.html)<br />+ ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png)[Manajemen yang cepat](https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-management.html)<br />+ ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png)[Arus](https://docs.aws.amazon.com/bedrock/latest/userguide/flows.html)<br />+ ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png)[Agen](https://docs.aws.amazon.com/bedrock/latest/userguide/agents.html)  |  + ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)[Perutean prompt cerdas](https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-routing.html)<br />+ ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)[Deteksi penyalahgunaan](https://docs.aws.amazon.com/bedrock/latest/userguide/abuse-detection.html)<br />+ ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)[Optimasi cepat](https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-management-optimize.html)<br />+ ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)[Hitung token](https://docs.aws.amazon.com/bedrock/latest/userguide/count-tokens.html)<br />+ ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)[Basis pengetahuan](https://docs.aws.amazon.com/bedrock/latest/userguide/knowledge-base.html)<br />+ ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)[Evaluasi model](https://docs.aws.amazon.com/bedrock/latest/userguide/evaluation.html)<br />+ ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png)[Output terstruktur](https://docs.aws.amazon.com/bedrock/latest/userguide/structured-outputs.html)  | 

## Harga
<a name="model-card-meta-llama-3-1-405b-instruct-pricing"></a>

Untuk harga, silakan merujuk ke halaman [Harga Amazon Bedrock](https://aws.amazon.com/bedrock/pricing/).

## Akses Terprogram
<a name="model-card-meta-llama-3-1-405b-instruct-programmatic-access"></a>

Gunakan ID model dan URL titik akhir berikut untuk mengakses model ini secara terprogram. Untuk informasi selengkapnya tentang API dan titik akhir yang tersedia, lihat [API yang didukung](https://docs.aws.amazon.com/bedrock/latest/userguide/apis.html) dan [Endpoint](https://docs.aws.amazon.com/bedrock/latest/userguide/endpoints.html) didukung.


| **Titik akhir** | **ID Model** | **In-Region URL titik akhir** | **ID inferensi geo** | **ID inferensi global** | 
| --- | --- | --- | --- | --- | 
| bedrock-runtime | meta.llama3-1-405b-instruct-v1:0 | https://bedrock-runtime.{region}.amazonaws.com | us.meta.llama3-1-405b-instruct-v1:0 | Tidak didukung | 

*Misalnya, jika wilayah adalah us-east-1 (Virginia N.), maka URL endpoint batuan dasar runtime akan menjadi "" dan untuk mantel dasar akan menjadi "”. https://bedrock-runtime.us-east-1.amazonaws.com https://bedrock-mantle.us-east-1.api.aws/v1*

## Tingkatan Layanan
<a name="model-card-meta-llama-3-1-405b-instruct-tiers"></a>

Amazon Bedrock menawarkan beberapa tingkatan layanan agar sesuai dengan persyaratan beban kerja Anda. **Standar** menyediakan akses bayar per token tanpa komitmen. **Prioritas** menawarkan throughput yang lebih tinggi dengan komitmen berbasis waktu. **Flex** menyediakan akses berbiaya lebih rendah untuk beban kerja yang fleksibel dan tidak sensitif terhadap waktu. **Reserved** menyediakan throughput khusus dengan komitmen jangka untuk beban kerja yang dapat diprediksi. Untuk informasi selengkapnya, lihat [tingkatan layanan](https://docs.aws.amazon.com/bedrock/latest/userguide/service-tiers-inference.html).


| **Standar** | **Prioritas** | **Fleksibel** | **Dilindungi** | 
| --- | --- | --- | --- | 
| ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png) | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) | 

## Ketersediaan Wilayah
<a name="model-card-meta-llama-3-1-405b-instruct-regional-availability"></a>

***Sekilas tentang ketersediaan regional***

Bedrock menawarkan tiga opsi inferensi: **In-Region**menyimpan permintaan dalam satu Wilayah untuk kepatuhan yang ketat, Cross-Region rute **Geo** lintas Wilayah dalam geografi (AS, UE, dll.) untuk throughput yang lebih tinggi sambil menghormati residensi data, dan Cross-Region rute **Global** di mana saja di seluruh dunia untuk throughput maksimum ketika tidak ada kendala residensi. Lihat [Ketersediaan regional berdasarkan model](models-region-compatibility.md) halaman untuk lebih jelasnya.


| **Wilayah** | **In-Region** | **Geo** | **Global** | 
| --- | --- | --- | --- | 
| us-east-2(Ohio) | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) | ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png) | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) | 
| us-west-2(Oregon) | ![Green circle with white checkmark icon.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-yes.png) | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) | ![Red circle with white X icon indicating error, cancel, or close action.](http://docs.aws.amazon.com/id_id/bedrock/latest/userguide/images/icons/icon-no.png) | 

***Detail inferensi geo***

**Geo: AS**

ID Inferensi Geo: `us.meta.llama3-1-405b-instruct-v1:0`


| **Wilayah Sumber** | **Wilayah Tujuan** | 
| --- | --- | 
| us-east-2 (Ohio) | us-east-1 (Virginia N), us-east-2 (Ohio), us-west-2 (Oregon) | 

## Kode Sampel
<a name="model-card-meta-llama-3-1-405b-instruct-sample-code"></a>

**Langkah 1 - Akun AWS:** Jika Anda sudah memiliki akun AWS, lewati langkah ini. Jika Anda baru mengenal AWS, daftar [akun AWS](https://portal.aws.amazon.com/billing/signup).

**Langkah 2 - Kunci API:** Buka [konsol Amazon Bedrock](https://console.aws.amazon.com/bedrock/home#/api-keys/long-term/create) dan buat kunci API jangka panjang.

**Langkah 3 - Dapatkan SDK:** Untuk menggunakan panduan memulai ini, Anda harus memiliki Python yang sudah diinstal. Kemudian instal perangkat lunak yang relevan tergantung pada API yang Anda gunakan.

```
pip install boto3
```

**Langkah 4 - Tetapkan variabel lingkungan:** Konfigurasikan lingkungan Anda untuk menggunakan kunci API untuk otentikasi.

```
AWS_BEARER_TOKEN_BEDROCK="<provide your Bedrock API key>"
```

**Langkah 5 - Jalankan permintaan inferensi pertama Anda:** Simpan file sebagai `bedrock-first-request.py`

------
#### [ Converse API ]

```
import boto3

client = boto3.client('bedrock-runtime', region_name='us-east-1')
response = client.converse(
    modelId='meta.llama3-1-405b-instruct-v1:0',
    messages=[
        {
            'role': 'user',
            'content': [{'text': 'Can you explain the features of Amazon Bedrock?'}]
        }
    ]
)
print(response)
```

------