Terjemahan disediakan oleh mesin penerjemah. Jika konten terjemahan yang diberikan bertentangan dengan versi bahasa Inggris aslinya, utamakan versi bahasa Inggris. # Tentang Rilis Amazon EMR Rilis Amazon EMR adalah seperangkat aplikasi sumber terbuka dari ekosistem big data. Setiap rilis terdiri dari aplikasi big data, komponen, dan fitur yang berbeda yang bisa Anda pilih untuk diinstal dan dikonfigurasi oleh Amazon EMR ketika Anda membuat sebuah klaster. Aplikasi dikemas menggunakan sistem berbasis [Apache BigTop](http://bigtop.apache.org/), yang merupakan proyek open-source yang terkait dengan ekosistem Hadoop. Panduan ini memberikan informasi untuk aplikasi yang disertakan dalam rilis Amazon EMR. Untuk informasi lebih lanjut tentang memulai dan bekerja dengan Amazon EMR, lihat [Panduan Pengelolaan Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/). Saat meluncurkan cluster, Anda dapat memilih dari beberapa rilis Amazon EMR. Ini memungkinkan Anda untuk menguji dan menggunakan versi aplikasi yang sesuai dengan kebutuhan kompatibilitas Anda. Anda menentukan nomor rilis dengan *label rilis*. Label rilis ada dalam bentuk`emr-x.x.x`. Misalnya, `emr-7.12.0`. Dimulai dengan Amazon EMR 5.18.0, Anda dapat menggunakan repositori artefak Amazon EMR untuk membangun kode pekerjaan Anda terhadap versi pustaka dan dependensi yang tepat yang tersedia dengan rilis EMR Amazon tertentu. Untuk informasi selengkapnya, lihat [Memeriksa dependensi menggunakan repositori artefak Amazon EMR](emr-artifact-repository.md). Untuk mendapatkan pembaruan saat rilis EMR Amazon baru tersedia, berlangganan umpan [RSS untuk catatan rilis Amazon EMR](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/amazon-emr-release-notes.rss). Detail **rilis terbaru**, termasuk versi aplikasi, catatan rilis, komponen, dan klasifikasi konfigurasi Amazon EMR 7.x, 6.x, dan 5.x series: + [Amazon EMR Rilis 7.12.0](emr-7120-release.md) + [Rilis EMR Amazon 6.15.0](emr-6150-release.md) + [Amazon EMR Rilis 5.36.2](emr-5362-release.md) **catatan** Rilis EMR Amazon baru tersedia di berbagai Wilayah selama beberapa hari, dimulai dengan Wilayah pertama pada tanggal rilis awal. Versi rilis terbaru mungkin tidak tersedia di Wilayah Anda selama periode ini. **Catatan rilis** untuk rilis EMR Amazon terbaru dan riwayat semua rilis: + [Ada fitur baru?](emr-whatsnew.md) + [Arsip Amazon EMR dari catatan rilis](emr-whatsnew-history.md) **Riwayat komprehensif versi aplikasi** di setiap rilis Amazon EMR: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Detail untuk setiap rilis Amazon EMR** dan perbedaan antara seri rilis, jika berlaku: + [Amazon EMR 7.x versi rilis](emr-release-7x.md) + [Amazon EMR versi rilis 6.x](emr-release-6x.md) + [Amazon EMR versi rilis 5.x](emr-release-5x.md) + [Versi rilis Amazon EMR 4.x](emr-release-4x.md) + [Amazon EMR versi 2.x dan 3.x AMI](emr-release-3x.md) # Dukungan standar Amazon EMR ## Memahami rilis Amazon EMR *Rilis Amazon EMR* adalah kendaraan yang memberikan perangkat lunak yang diperlukan untuk menjalankan aplikasi open-source Anda pada EC2, EKS, atau platform Tanpa Server. *Rilis EMR Amazon terdiri dari tiga bagian: *Lingkungan Runtime*, *Mesin Inti*, dan Ekstra.* + **Lingkungan runtime — Lingkungan** runtime mencakup sistem operasi yang disertakan sebagai bagian dari Amazon Machine Image (AMI) atau image container lainnya saat Anda meluncurkan cluster atau container (misalnya, Amazon Linux 2023). Ini juga mencakup runtime bahasa seperti Amazon Corretto JDK, bersama dengan alat terkait lainnya yang dipasang gambar. + **Mesin inti** — Ini termasuk perangkat lunak sumber terbuka inti seperti Apache Hive, dan format tabel terbuka seperti Apache Iceberg. + **Ekstra** — Ini termasuk pustaka kenyamanan dan paket Python seperti `mariadb-connector-java` dan perangkat lunak sumber terbuka seperti Apache Pig. Versi rilis Amazon EMR yang Anda pilih menggabungkan semua komponen ini ke dalam versi baru Amazon Linux (AL) berbasis Amazon Machine Images (AMI) atau gambar kontainer. Amazon EMR mempertahankan versi AL yang sama untuk semua node cluster, wadah EKS, atau aplikasi tanpa server. Amazon EMR bertujuan untuk mendapatkan *Runtime Environment terbaru dalam waktu* 90 hari setelah dirilis oleh Amazon Linux, dan versi open-source baru dari *Core Engines* dalam waktu 90 hari sejak rilis upstream. *Ekstra* dirilis sesuai kebutuhan. Anda dapat menemukan daftar perangkat lunak dalam catatan rilis untuk setiap rilis EMR Amazon. ## Versi rilis Untuk membantu Anda memahami cakupan perubahan di setiap rilis, Amazon EMR menggunakan versi semantik. Versi semantik mengikuti format. `..` Sebagai contoh, mari kita pertimbangkan rilis 7.0.0. Digit pertama menunjukkan rilis versi mayor, atau **Major Release**. Rilis Utama biasanya membawa perubahan besar, peningkatan, dan fitur baru ke Runtime Environment atau Core Engine yang tidak kompatibel ke belakang. Misalnya, Rilis Utama 7.x menggunakan Amazon Linux 2023 dengan Amazon Corretto 17 JDK sebagai default. Akibatnya, rilis berisi beberapa perubahan besar dibandingkan dengan 6.x Major Release, yang dikirimkan di Amazon Linux 2 dan dengan Amazon Corretto 8 JDK sebagai default. Digit kedua menunjukkan rilis versi minor, atau **Rilis Kecil**. Rilis Minor adalah rilis yang tidak kompatibel ke belakang yang berisi perubahan tambahan, peningkatan, dan fitur pada Mesin Inti dan Ekstra, dan fungsionalitas baru. Misalnya, 6.15 menggunakan Apache Spark 3.4.1, dibandingkan dengan 6.11.1, yang dikirimkan dengan Apache Spark 3.3.2. Digit ketiga menunjukkan rilis versi patch, atau **Patch Release**. Rilis Patch dimaksudkan untuk menjadi rilis yang kompatibel ke belakang yang berisi perbaikan dan pembaruan tambalan ke *Core Engine* dan *Ekstra*, tetapi tidak ada fungsionalitas baru atau peningkatan versi OSS. Misalnya, 6.11.1 dan 6.11.0 keduanya mengandung versi Apache Spark 3.3.2 OSS yang sama. Mulai 6.6.x, Patch Release terbaru menawarkan patch *Runtime Environment* terbaru yang tersedia. *Lingkungan Runtime* tidak memengaruhi Rilis Patch Amazon EMR. Misalnya, 6.11.1 diluncurkan dengan AL versi 2.0.20240109.0 dari 19 Desember 2023 hingga 10 Januari 2024, tetapi dengan AL versi 2.0.20240124.0 mulai 11 Januari 2024. Beberapa Amazon EMR pada rilis EKS memungkinkan Anda menambahkan tag atau sufiks ke versi sematik untuk memberi Anda fungsionalitas alternatif. Misalnya, `emr-6.15.0-latest` rilis Amazon EMR di EKS meluncurkan versi rilis berkemampuan Amazon Corretto 8 JDK, sedangkan rilis Amazon EMR di EKS memungkinkan Anda meluncurkan versi rilis berkemampuan `emr-6.15.0-java17-latest` Amazon Corretto 17 JDK. ## Kebijakan Support **Pendahuluan** Amazon EMR bertujuan untuk menerbitkan Rilis Minor baru minimal sekali setiap 90 hari, dan untuk memberikan dukungan untuk Rilis Minor untuk jangka waktu 24 bulan mulai dari tanggal rilis. Dukungan ini mencakup *Lingkungan Runtime* dan *Mesin Inti* dengan dependensi terkait, dan tidak mencakup *Ekstra* atau dependensi terkait. *Runtime Environment* juga mencakup komponen platform berpemilik dan APIs yang diperlukan untuk memulai, menghentikan, dan mengoperasikan cluster dan aplikasi. Jadwal rilis yang konsisten ini memastikan siklus yang dapat diprediksi, membuatnya lebih nyaman bagi Anda untuk merencanakan, menguji, dan beralih ke versi yang memberikan dukungan dan keamanan. **Apa yang diharapkan dengan Standard Support** Standard Support menyediakan perbaikan pada tiket dukungan teknis untuk masalah yang Anda temui untuk komponen *Runtime Environment* dan *Core Engine* di bawah konfigurasi yang direkomendasikan. Semua perbaikan tergantung ketersediaan. [Konfigurasi yang disarankan adalah penggunaan Amazon EMR tanpa modifikasi, penambahan, atau perubahan apa pun pada binari dan konfigurasi yang ada dalam rilis EMR Amazon, kecuali yang ditemukan di Dokumentasi EMR Amazon.](https://docs.aws.amazon.com/emr/) Amazon EMR menerapkan perbaikan ke patch terbaru, minor, atau versi utama dari rilis EMR Amazon dalam waktu 90 hari setelah kami memverifikasi perbaikan. Amazon EMR secara otomatis menerapkan perbaikan saat Anda meluncurkan EMR baru di EC2 cluster, meluncurkan EMR Amazon baru di wadah EKS, atau memicu pekerjaan EMR Tanpa Server baru. *Komponen tambahan disediakan sebagai kenyamanan dan Amazon EMR **tidak** menyediakan perbaikan yang terkait dengan Ekstra.* **Komponen** Standard Support mencakup komponen *Runtime Environment* dan *Core Engines* — misalnya, sistem operasi, runtime bahasa, dan perangkat lunak sumber terbuka inti seperti Apache Hive dan Apache Iceberg. Anda dapat menemukan daftar lengkap komponen yang didukung untuk setiap rilis di [Tentang Rilis Amazon EMR](emr-release-components.md) dan [Amazon Linux FAQs](https://aws.amazon.com/linux/amazon-linux-2023/faqs/). Daftar berikut menjelaskan dukungan yang kami sediakan untuk berbagai jenis komponen di bawah Dukungan Standar: + Komponen **Runtime Environment: Komponen** *Runtime Environment* akan menerima perbaikan pada tiket dukungan teknis. Perbaikan dikategorikan sebagai (a) bug kritis, (b) masalah korupsi data kritis, dan (c) masalah keamanan kritis. Jika memenuhi syarat, Amazon EMR akan melakukan backport perbaikan untuk *Runtime Environment ke versi yang lebih lama*. Untuk kompatibilitas operasional dengan komponen Core Engine open-source, komponen *Runtime Environment* tertentu harus tetap pada versi tertentu untuk mencegah kerusakan aplikasi pelanggan. Untuk komponen ini, Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan. Ketika perbaikan tersedia di open source, kami akan memberikan versi stabil terbaru dalam waktu 90 hari setelah diverifikasi oleh Amazon EMR. + **Komponen Mesin Inti**: *Mesin Inti* menyediakan versi terbaru untuk banyak proyek sumber terbuka, masing-masing memiliki ratusan pustaka ketergantungan transitif. Sementara komunitas open-source yang mengelola proyek-proyek ini mencoba untuk mengatasi masalah dan dikenal Kerentanan Umum dan Eksposur (CVE) secara sering, versi terbaru mungkin masih mengandung bug yang diketahui dan. CVEs Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen *Core Engine* dalam waktu 90 hari setelah diverifikasi oleh Amazon EMR. Dalam kasus tertentu, Amazon EMR mungkin menyediakan perbaikan untuk CVE di salah satu komponen *Core Engine* yang perlu ditangani sebelum open source hulu. Amazon EMR juga memberi Anda dukungan teknis dan perbaikan pada fitur yang ditambahkan di atas open source di bawah konfigurasi yang disarankan. Kami tidak mendukung perbaikan untuk komponen *Core Engine* ke versi Patch atau Minor yang lebih lama. + **Komponen ekstra**: Amazon EMR **tidak** *mendukung* komponen Ekstra. Komponen tambahan adalah proyek sumber terbuka yang disediakan sebagai kenyamanan dan Amazon EMR tidak menyediakan perbaikan untuk masalah yang dihadapi dengan mereka. Permintaan atau perbaikan dukungan apa pun dapat diatasi melalui komunitas sumber terbuka yang mendukung komponen ini. **Siklus hidup Dukungan Standar** Berikut ini menjelaskan tonggak sejarah dalam siklus hidup Dukungan Standar: + **Dukungan Standar**: Rilis Amazon EMR memenuhi syarat untuk Dukungan Standar 24 bulan sejak tanggal rilis. Anda dapat membuat tiket dukungan teknis dan mengharapkan pembaruan untuk masalah yang Anda temui dengan rilis ini. + **Akhir Dukungan: Setelah Dukungan Standar berakhir, Amazon EMR rilis memasuki tahap End of** Support (EoS) selama 12 bulan. Rilis EOS tidak memenuhi syarat untuk dukungan teknis dan Anda tidak akan dapat membuat tiket apa pun untuk klaster, kontainer, atau pekerjaan yang berjalan pada rilis ini. Rilis EOS tidak akan menerima perbaikan, tambalan, atau pembaruan apa pun. Rilis EOS akan dihapus dari konsol, tetapi akan terus tersedia melalui API dan AWS CLI. Anda selalu dapat terus menjalankan beban kerja pada rilis EOS. Kami sangat menyarankan agar Anda bermigrasi ke rilis EMR Amazon terbaru sehingga Anda terus menerima patch keamanan, tetap memenuhi syarat untuk dukungan teknis, dan dapat membuat tiket dukungan bila diperlukan. + **End of Life**: After the End of Support (EoS), rilis dianggap sebagai End of Life (EoL). Meskipun Anda dapat terus menjalankan klaster EoL, Amazon EMR berhak untuk menghapus rilis EoL dari API dan SDK case-by-case berdasarkan masalah keamanan dan operasional. Kami sangat menyarankan Anda bermigrasi ke EMR Amazon terbaru, rilis karena versi EoL dapat dihapus dari API dan SDK dalam kasus luar biasa. **Dukungan Jembatan** Amazon EMR mengumumkan kebijakan dukungan baru ini pada 25 Juli 2024. Berdasarkan kebijakan ini, versi Amazon EMR yang dirilis pada atau sebelum 24 Juli 2022 sekarang ditetapkan sebagai Akhir Dukungan. Namun, untuk memberi Anda waktu tambahan untuk merencanakan dan bermigrasi ke versi yang lebih baru, Amazon EMR akan menawarkan Bridge Support, setara dengan Dukungan Standar, untuk versi lama yang dirilis dalam periode dua tahun sebelum pengumuman ini. Setelah 25 Juli 2024, Anda dapat merujuk ke status saat ini dan garis waktu dukungan di catatan rilis. Tabel berikut menunjukkan status dukungan untuk semua rilis EMR Amazon yang ada pada saat pengumuman kebijakan, 25 Juli 2024: **Rilis dan periode yang didukung** | Versi rilis Amazon EMR | Tanggal rilis awal | Tanggal akhir dukungan standar | Akhir tanggal mulai dukungan | Tanggal mulai akhir kehidupan | | --- | --- | --- | --- | --- | | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-standard-support.html) | 1 Januari 2013 hingga 25 Juli 2024 | Dukungan jembatan hingga 31 Juli 2026 | Agustus 1, 2026 | Agustus 1, 2027 | **catatan** Tanggal dukungan jembatan telah diperpanjang hingga 31 Juli 2026, untuk semua rilis yang memenuhi syarat. Anda dapat menggunakan Apache Spark Upgrade Agent untuk meng-upgrade Apache Spark aplikasi yang ada di EMR dan EMR Serverless dari versi EC2 EMR yang lebih lama ke versi EMR terbaru. Untuk mempelajari selengkapnya, lihat [Apa itu Agen Peningkatan Apache Spark untuk Amazon EMR](spark-upgrades.md). ## Pertimbangan-pertimbangan Dukungan Standar tersedia untuk semua model penyebaran EMR Amazon (EMR aktif, EC2 Amazon EMR di EKS, dan EMR Tanpa Server), di semua Wilayah di mana Amazon EMR tersedia, tanpa biaya tambahan. Kluster yang berjalan dengan konfigurasi yang disarankan secara otomatis memenuhi syarat untuk mendapatkan dukungan seperti yang dijelaskan dalam kebijakan, sehingga Anda tidak perlu mengambil tindakan tambahan apa pun untuk mengaktifkan dukungan. + Standard Support hanya mendukung komponen yang diperlukan untuk klaster EMR Amazon. Amazon EMR tidak dapat menjamin penambalan keamanan dan memperbaiki ketersediaan jika komponen sumber terbuka *Core Engine* mencapai EoL upstream, atau ketika pembaruan keamanan tidak lagi tersedia untuk dependensi. Meskipun Anda dapat memilih untuk menginstal *Ekstra*, Amazon EMR tidak akan mendukung mereka atau dependensinya. Misalnya, Anda dapat menginstal aplikasi pihak ketiga di AMI kustom Anda untuk mengeraskan keamanan klaster Anda, menginstal komponen tambahan atau menyalin objek menggunakan skrip tindakan bootstrap, atau SSH ke dalam klaster Anda dan meningkatkan versi paket default. Amazon EMR tidak mendukung komponen ini. Dukungan Standar tidak mencakup tindakan bootstrap yang disediakan pelanggan, paket, pustaka, kode bring-your-own kustom dan aplikasi khusus yang dapat Anda konfigurasi Amazon EMR untuk menginstal untuk kenyamanan Anda. + Cluster Anda yang ada tidak akan terpengaruh, terlepas dari rilis EMR Amazon mana yang mereka jalankan. Anda dapat terus menjalankan cluster yang ada tanpa gangguan. Anda juga dapat terus meluncurkan cluster baru dan menjalankan pekerjaan di salah satu rilis yang ada dan rilis baru. Semua rilis yang ada dan rilis baru pada saat kebijakan menjadi efektif dicakup oleh Dukungan Standar selama 24 bulan sejak tanggal awal rilis versi rilis Amazon EMR. Amazon EMR akan memberi Anda dukungan jembatan selama pengumuman awal kebijakan. Untuk menerima dukungan tanpa gangguan, kami menyarankan untuk menguji aplikasi Anda dan segera meningkatkan ke rilis EMR Amazon terbaru. + Amazon EMR tidak akan mengubah komponen Dukungan Standar pada rilis atau kluster yang ada. Namun, Amazon EMR berhak untuk menghormati End of Life hulu atas case-by-case dasar, dan menghapus komponen tersebut dalam rilis baru, atau memindahkan rilis yang ada ke status End of Support (EoS), atau End of Life (EoS) dalam kasus luar biasa. Kami akan memberi tahu Anda tentang penghapusan apa pun melalui saluran yang tersedia. + Ketika Wilayah baru diluncurkan, Amazon EMR hanya akan mendukung versi rilis Amazon EMR di bawah Dukungan Standar, dirilis dalam enam bulan sebelum tanggal kapan Wilayah baru tersedia secara umum. + Amazon EMR tidak akan secara otomatis memperbarui cluster yang ada ke versi terbaru. Namun, Anda dapat memilih untuk memperbarui cluster baru ke versi patch terbaru jika diinginkan. + Biaya penggunaan Amazon EMR Anda yang tidak didukung akan dihitung terhadap AWS tagihan Anda. Bahkan jika Anda menggunakan Amazon EMR dengan cara yang tidak didukung, biaya yang terkait dengan penggunaan itu masih merupakan bagian dari AWS konsumsi Anda secara keseluruhan dan akan dimasukkan dalam perhitungan biaya dukungan Anda. Untuk informasi selengkapnya, hubungi [Support AWS Developer](https://aws.amazon.com/premiumsupport/). # Apa itu Agen Peningkatan Apache Spark untuk Amazon EMR ## Pengantar Apache Spark Upgrade Agent untuk Amazon EMR adalah kemampuan AI percakapan yang mempercepat peningkatan versi Apache Spark untuk aplikasi EMR Anda. Peningkatan Spark tradisional membutuhkan upaya rekayasa selama berbulan-bulan untuk menganalisis perubahan API, menyelesaikan konflik ketergantungan, dan memvalidasi kebenaran fungsional. Agen menyederhanakan proses upgrade melalui petunjuk bahasa alami, transformasi kode otomatis, dan validasi kualitas data. Anda dapat menggunakan agen untuk memutakhirkan PySpark dan Scala aplikasi yang berjalan di Amazon EMR EC2 dan Amazon EMR Tanpa Server. Agen menganalisis kode Anda, mengidentifikasi perubahan yang diperlukan, dan melakukan transformasi otomatis sambil mempertahankan kontrol persetujuan Anda atas semua modifikasi. **catatan** Agen Upgrade Apache Spark tersedia tanpa biaya tambahan sebagai bagian dari Amazon EMR. Anda hanya membayar sumber daya EMR Amazon yang mendasari yang digunakan selama eksekusi pekerjaan validasi. ## Ikhtisar Arsitektur Agen pemutakhiran memiliki tiga komponen utama: Asisten AI yang kompatibel dengan MCP di lingkungan pengembangan Anda untuk interaksi, [Proxy MCP untuk AWS](https://github.com/aws/mcp-proxy-for-aws) yang menangani komunikasi aman antara klien Anda dan server MCP, dan Server MCP Terkelola Amazon SageMaker Unified Studio (dalam pratinjau) yang menyediakan alat peningkatan Spark khusus untuk Amazon EMR. Diagram ini menggambarkan bagaimana Anda berinteraksi dengan Amazon SageMaker Unified Studio Managed MCP Server melalui Asisten AI Anda. ![\[Agen Peningkatan Apache Spark\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/images/SparkUpgradeIntroduction.png) Asisten AI akan mengatur peningkatan menggunakan alat khusus yang disediakan oleh server MCP dengan mengikuti langkah-langkah berikut: 1. **Perencanaan**: Agen menganalisis struktur proyek Anda dan menghasilkan atau merevisi rencana peningkatan yang memandu proses peningkatan end-to-end Spark. 1. **Kompilasi dan Bangun**: Agen memperbarui lingkungan build dan dependensi, mengkompilasi proyek, dan secara berulang memperbaiki kegagalan build dan pengujian. 1. **Alat edit kode percikan**: Agen menerapkan pembaruan kode yang ditargetkan untuk menyelesaikan ketidakcocokan versi Spark, memperbaiki kesalahan waktu pembuatan dan waktu proses. 1. **Execute & Validation**: Agen mengirimkan pekerjaan validasi jarak jauh ke EMR, memantau eksekusi dan log, dan secara berulang memperbaiki masalah runtime dan kualitas data. 1. **Observabilitas**: Agen melacak kemajuan peningkatan menggunakan alat observabilitas EMR dan memungkinkan pengguna untuk melihat analisis dan status peningkatan kapan saja. Silakan merujuk ke [Menggunakan Alat Peningkatan Spark](emr-spark-upgrade-agent-tools.md) untuk daftar alat utama untuk setiap langkah. **Topics** + [ ## Pengantar ](#emr-spark-upgrade-agent-intro) + [ ## Ikhtisar Arsitektur ](#emr-spark-upgrade-agent-architecture) + [ # Pengaturan untuk Agen Peningkatan ](emr-spark-upgrade-agent-setup.md) + [ # Menggunakan Agen Upgrade ](emr-spark-upgrade-agent-using.md) + [ # Fitur dan Kemampuan ](emr-spark-upgrade-agent-features.md) + [ # Pemecahan Masalah dan Tanya Jawab ](emr-spark-upgrade-agent-troubleshooting.md) + [ # Alur Kerja Agen Peningkatan Spark Secara Detail ](emr-spark-upgrade-agent-workflow-details.md) + [ # Aktifkan Validasi Kualitas Data ](emr-spark-upgrade-agent-data-quality-validation.md) + [ # Contoh Prompt untuk Agen Peningkatan Spark ](emr-spark-upgrade-agent-prompt-examples.md) + [ # Membuat target EMR Cluster/aplikasi EMR-S dari yang sudah ada ](emr-spark-upgrade-agent-target-cluster.md) + [ # Pengaturan Peran IAM ](emr-spark-upgrade-agent-iam-role.md) + [ # Mengkonfigurasi Titik Akhir VPC Antarmuka untuk SageMaker Amazon Unified Studio MCP ](spark-upgrade-agent-vpc-endpoints.md) + [ # Menggunakan Alat Peningkatan Spark ](emr-spark-upgrade-agent-tools.md) + [ # Pemrosesan lintas wilayah untuk Agen Upgrade Apache Spark ](emr-spark-upgrade-agent-cross-region.md) + [ # Pencatatan panggilan MCP Amazon SageMaker Unified Studio menggunakan AWS CloudTrail ](spark-upgrade-cloudtrail-integration.md) + [ # Peningkatan layanan untuk Apache Spark Agents ](emr-spark-agent-service-improvements.md) # Pengaturan untuk Agen Peningkatan **catatan** Apache Spark Upgrade Agent menggunakan inferensi lintas wilayah untuk memproses permintaan bahasa alami dan menghasilkan tanggapan. Untuk lebih jelasnya silakan merujuk ke halaman ini di[Pemrosesan lintas wilayah untuk Agen Upgrade Apache Spark](emr-spark-upgrade-agent-cross-region.md). Server MCP Amazon SageMaker Unified Studio sedang dalam pratinjau dan dapat berubah sewaktu-waktu. ## Prasyarat Sebelum kita memulai proses setup untuk integrasi dengan Kiro CLI, pastikan Anda memiliki yang berikut diinstal pada workstation Anda: + [Instal AWS CLI](https://docs.aws.amazon.com/cli/latest/userguide/getting-started-install.html) + [Instal Python 3.10\$1](https://www.python.org/downloads/release/python-3100/) + [Instal manajer `uv` paket](https://docs.astral.sh/uv/getting-started/installation/) untuk [MCP Proxy](https://github.com/aws/mcp-proxy-for-aws?tab=readme-ov-file) untuk AWS + [Instal Kiro CLI](https://kiro.dev/docs/cli/) + AWS kredensi lokal yang dikonfigurasi (melalui [AWS CLI](https://docs.aws.amazon.com/cli/latest/userguide/cli-chap-configure.html), variabel lingkungan, atau peran IAM) - untuk operasi lokal seperti mengunggah artefak pekerjaan yang ditingkatkan untuk pelaksanaan pekerjaan validasi EMR. ## Sumber Daya Pengaturan Anda dapat menggunakan CloudFormation template untuk mengatur sumber daya untuk server MCP. Templat ini adalah contoh yang harus Anda modifikasi untuk memenuhi kebutuhan Anda. Template membuat sumber daya berikut untuk proses upgrade: + Peran IAM yang memiliki izin untuk memanggil MCP Server dan izin yang diperlukan untuk proses upgrade untuk platform EMR yang mendasarinya. + Bucket pementasan Amazon S3 digunakan untuk mengunggah artefak upgrade dan kunci KMS opsional untuk enkripsi Amazon S3. Pilih salah satu tombol **Luncurkan Tumpukan** dalam tabel berikut. Ini meluncurkan tumpukan di CloudFormation konsol di wilayah masing-masing. | Region | Luncurkan | | --- | --- | | Timur AS (N. Virginia) | [https://console.aws.amazon.com/cloudformation/home?region=us-east-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-us-east-1.s3.us-east-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=us-east-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-us-east-1.s3.us-east-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | AS Timur (Ohio) | [https://console.aws.amazon.com/cloudformation/home?region=us-east-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-us-east-2.s3.us-east-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=us-east-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-us-east-2.s3.us-east-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | AS Barat (Oregon) | [https://console.aws.amazon.com/cloudformation/home?region=us-west-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-us-west-2.s3.us-west-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=us-west-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-us-west-2.s3.us-west-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Eropa (Irlandia) | [https://console.aws.amazon.com/cloudformation/home?region=eu-west-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-west-1.s3.eu-west-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=eu-west-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-west-1.s3.eu-west-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Asia Pacific (Tokyo) | [https://console.aws.amazon.com/cloudformation/home?region=ap-northeast-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-northeast-1.s3.ap-northeast-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=ap-northeast-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-northeast-1.s3.ap-northeast-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Asia Pasifik (Singapura) | [https://console.aws.amazon.com/cloudformation/home?region=ap-southeast-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-southeast-1.s3.ap-southeast-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=ap-southeast-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-southeast-1.s3.ap-southeast-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Asia Pacific (Sydney) | [https://console.aws.amazon.com/cloudformation/home?region=ap-southeast-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-southeast-2.s3.ap-southeast-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=ap-southeast-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-southeast-2.s3.ap-southeast-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Kanada (Pusat) | [https://console.aws.amazon.com/cloudformation/home?region=ca-central-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ca-central-1.s3.ca-central-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=ca-central-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ca-central-1.s3.ca-central-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Amerika Selatan (Sao Paulo) | [https://console.aws.amazon.com/cloudformation/home?region=sa-east-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-sa-east-1.s3.sa-east-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=sa-east-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-sa-east-1.s3.sa-east-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Eropa (Frankfurt) | [https://console.aws.amazon.com/cloudformation/home?region=eu-central-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-central-1.s3.eu-central-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=eu-central-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-central-1.s3.eu-central-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Eropa (Stockholm) | [https://console.aws.amazon.com/cloudformation/home?region=eu-north-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-north-1.s3.eu-north-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=eu-north-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-north-1.s3.eu-north-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Eropa (London) | [https://console.aws.amazon.com/cloudformation/home?region=eu-west-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-west-2.s3.eu-west-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=eu-west-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-west-2.s3.eu-west-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Eropa (Paris) | [https://console.aws.amazon.com/cloudformation/home?region=eu-west-3#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-west-3.s3.eu-west-3.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=eu-west-3#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-eu-west-3.s3.eu-west-3.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Asia Pasifik (Seoul) | [https://console.aws.amazon.com/cloudformation/home?region=ap-northeast-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-northeast-2.s3.ap-northeast-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=ap-northeast-2#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-northeast-2.s3.ap-northeast-2.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | | Asia Pasifik (Mumbai) | [https://console.aws.amazon.com/cloudformation/home?region=ap-south-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-south-1.s3.ap-south-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml](https://console.aws.amazon.com/cloudformation/home?region=ap-south-1#/stacks/new?stackName=spark-upgrade-mcp-setup&templateURL=https%3A%2F%2Fsmus-mcp-cfn-template-prod-ap-south-1.s3.ap-south-1.amazonaws.com/cloudformation/spark-upgrade-mcp-setup.yaml) | Lanjutkan ke halaman **Tentukan detail tumpukan**, masukkan **nama Stack**. Masukkan informasi tambahan di bawah **Parameter**. Berikan informasi berikut dan lanjutkan untuk membuat tumpukan. + **SparkUpgradeIAMRoleNama** - Nama peran IAM yang akan digunakan untuk proses peningkatan Spark + **Aktifkan EMREC2** - Aktifkan izin EC2 peningkatan EMR- (default: true) + **Aktifkan EMRServerless** - Aktifkan izin peningkatan tanpa server EMR (default: true) + **StagingBucketPath**- Jalur Amazon S3 untuk pementasan artefak (misalnya, s3://my - -upgrade). bucket/spark-upgrade or my-bucket/spark Biarkan kosong untuk membuat bucket baru secara otomatis + **Uses3encryption** - Aktifkan enkripsi KMS untuk bucket pementasan Amazon S3 (default: false, disetel ke true untuk menggunakan enkripsi KMS alih-alih enkripsi S3 default) + **S3 KmsKeyArn** - (Opsional) ARN kunci KMS yang ada untuk enkripsi bucket Amazon S3. Hanya digunakan jika Uses3Encryption benar dan Anda memiliki bucket yang sudah ada dengan kunci KMS + **CloudWatchKmsKeyArn**- (Opsional) ARN kunci KMS yang ada untuk enkripsi CloudWatch Log (EMR Tanpa Server saja, biarkan kosong untuk enkripsi default) + **EMRServerlessS3 LogPath** - (Opsional) jalur S3 tempat log aplikasi tanpa server EMR disimpan (misalnya, s3://my - -serverless-logs). bucket/emr-serverless-logs or my-bucket/emr Saat disediakan, memberikan akses baca peran IAM ke log ini untuk dianalisis. Hanya digunakan ketika EMRServerless Aktifkan benar + **ExecutionRoleToGrantS3Access** - (Opsional) Nama Peran IAM atau ARN dari peran eksekusi EMR EC2 - /EMR-tanpa server yang ada untuk memberikan akses bucket staging Amazon S3. Hanya berlaku saat bucket pementasan baru dibuat. Berguna untuk memberikan akses peran eksekusi pekerjaan EMR ke bucket staging. Mendukung nama peran sederhana dan ARNs dengan jalur. Anda juga dapat mengunduh dan meninjau [ CloudFormation template](https://github.com/aws-samples/aws-emr-utilities/blob/03c20fece616de23ec0ea5389f0113a5bc65fc3a/utilities/apache-spark-agents/spark-upgrade-agent-cloudformation/spark-upgrade-mcp-setup.yaml), menentukan opsi di atas dan meluncurkan template sendiri dengan perintah CloudFormation CLI, lihat di bawah untuk contoh: ``` # deploy the stack with CloudFormation CLI commands aws cloudformation deploy \ --template-file spark-upgrade-mcp-setup.yaml \ --stack-name spark-mcp-setup \ --region \ --capabilities CAPABILITY_NAMED_IAM \ --parameter-overrides \ ExecutionRoleToGrantS3Access= # retrieve the 1-line instruction to set the local environment variables, which will be used for the following MCP server configuration aws cloudformation describe-stacks \ --stack-name spark-mcp-setup \ --region \ --query "Stacks[0].Outputs[?OutputKey=='ExportCommand'].OutputValue" \ --output text ``` Buka tab Output (atau ambil dari perintah CLI CloudFormation deskripsi-tumpukan di atas) dan salin `ExportCommand` instruksi 1 baris, lalu jalankan di lingkungan lokal Anda. Contoh instruksi 1-baris: ``` export SMUS_MCP_REGION= && export IAM_ROLE=arn:aws:iam::111122223333:role/spark-upgrade-role-xxxxxx && export STAGING_BUCKET_PATH= ``` Kemudian jalankan perintah berikut secara lokal untuk mengatur profil IAM dan konfigurasi server MCP ``` # Step 1: Configure AWS CLI Profile aws configure set profile.spark-upgrade-profile.role_arn ${IAM_ROLE} aws configure set profile.spark-upgrade-profile.source_profile aws configure set profile.spark-upgrade-profile.region ${SMUS_MCP_REGION} # Step 2: if you are using Kiro CLI, use the following command to add the MCP configuration kiro-cli-chat mcp add \ --name "spark-upgrade" \ --command "uvx" \ --args "[\"mcp-proxy-for-aws@latest\",\"https://sagemaker-unified-studio-mcp.${SMUS_MCP_REGION}.api.aws/spark-upgrade/mcp\", \"--service\", \"sagemaker-unified-studio-mcp\", \"--profile\", \"spark-upgrade-profile\", \"--region\", \"${SMUS_MCP_REGION}\", \"--read-timeout\", \"180\"]" \ --timeout 180000\ --scope global ``` Ini harus diperbarui `~/.kiro/settings/mcp.json` untuk menyertakan konfigurasi server MCP seperti di bawah ini. ``` { "mcpServers": { "spark-upgrade": { "type": "stdio", "command": "uvx", "args": [ "mcp-proxy-for-aws@latest", "https://sagemaker-unified-studio-mcp.us-east-1.api.aws/spark-upgrade/mcp", "--service", "sagemaker-unified-studio-mcp", "--profile", "spark-upgrade-profile", "--region", "us-east-1", "--read-timeout", "180" ], "timeout": 180000, "disabled": false } } } ``` Lihat panduan konfigurasi [Menggunakan Agen Upgrade](emr-spark-upgrade-agent-using.md) untuk klien MCP yang berbeda seperti Kiro, Cline dan. GitHub CoPilot # Menggunakan Agen Upgrade ## Mode Penerapan yang Didukung Agen Peningkatan Apache Spark untuk Amazon EMR mendukung dua mode penerapan berikut untuk pengalaman peningkatan aplikasi end-to-end Spark termasuk peningkatan file build, script/dependency peningkatan, pengujian dan validasi lokal dengan cluster EMR target atau aplikasi EMR Tanpa Server, dan validasi kualitas data. + EMR pada EC2 + EMR Tanpa Server Silakan lihat [Fitur dan Kemampuan](emr-spark-upgrade-agent-features.md) untuk memahami fitur, kapasitas, dan batasan terperinci. ## Antarmuka yang Didukung ### Integrasi Dengan Amazon SageMaker Unified Studio VS Code Editor Spaces Di Amazon SageMaker Unified Studio VS Code Editor Spaces, Anda dapat mengonfigurasi profil IAM dan konfigurasi MCP seperti yang dijelaskan dalam Setup for Upgrade Agent hanya dengan mengikuti tangkapan layar di bawah ini: ![\[Agen Peningkatan Apache Spark\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/images/SparkUpgradeVSCodeEditor.png) Demonstrasi EMR EC2 pada pengalaman peningkatan dengan editor kode SMUS VS. Dimulai dengan prompt sederhana untuk meminta Agen memulai proses Spark Upgrade. ``` Upgrade my Spark application from EMR version 6.0.0 to 7.12.0. Use EMR-EC2 Cluster to run the validation and s3 paths s3:// to store updated application artifacts. Use spark-upgrade-profile for AWS CLI operations. ``` [![AWS Videos](http://img.youtube.com/vi/https://www.youtube.com/embed/Hk4_GPvYeqI/0.jpg)](http://www.youtube.com/watch?v=https://www.youtube.com/embed/Hk4_GPvYeqI) ### Integrasi Dengan Kiro CLI (QCLI) Mulai Kiro CLI atau Asisten AI Anda dan verifikasi alat yang dimuat untuk agen peningkatan. ``` ... spark-upgrade (MCP): - check_and_update_build_environment * not trusted - check_and_update_python_environment * not trusted - check_job_status * not trusted - compile_and_build_project * not trusted ... ``` Demonstrasi pengalaman peningkatan EMR Tanpa Server dengan Kiro CLI. Anda cukup memulai proses Upgrade dengan prompt berikut: ``` Upgrade my Spark application from EMR version 6.0.0 to 7.12.0. Use EMR-Serverless Applicaion and execution role to run the validation and s3 paths s3:// to store updated application artifacts. ``` [![AWS Videos](http://img.youtube.com/vi/https://www.youtube.com/embed/Kw8E2wWv4uQ/0.jpg)](http://www.youtube.com/watch?v=https://www.youtube.com/embed/Kw8E2wWv4uQ) ### Integrasi dengan Lainnya IDEs [Konfigurasi](emr-spark-upgrade-agent-setup.md#spark-upgrade-agent-setup-resources) juga dapat digunakan di tempat lain IDEs untuk terhubung ke server MCP Terkelola: + **Integrasi Dengan Cline** - Untuk menggunakan MCP Server dengan Cline, memodifikasi `cline_mcp_settings.json` dan menambahkan konfigurasi di atas. Konsultasikan [dokumentasi Cline](https://docs.cline.bot/mcp/configuring-mcp-servers) untuk informasi selengkapnya tentang cara mengelola konfigurasi MCP. + **Integrasi Dengan Kode Claude** Untuk menggunakan MCP Server dengan Claude Code, modifikasi file konfigurasi untuk menyertakan konfigurasi MCP. Jalur file bervariasi tergantung pada sistem operasi Anda. Lihat [https://code.claude.com/docs/en/mcp](https://code.claude.com/docs/en/mcp) untuk pengaturan terperinci. + **Integrasi Dengan GitHub Copilot** - Untuk menggunakan server MCP dengan GitHub Copilot, ikuti instruksi di [ https://docs.github.com/en/copilot/how-tos/provide-context/use-mcp/extend- copilot-chat-with-mcp](https://docs.github.com/en/copilot/how-tos/provide-context/use-mcp/extend-copilot-chat-with-mcp) untuk memodifikasi file konfigurasi yang sesuai dan ikuti instruksi per setiap IDE untuk mengaktifkan pengaturan. ## Setup EMR Cluster atau EMR Aplikasi Tanpa Server untuk Versi Target Buat cluster EMR atau aplikasi EMR Serverless dengan versi Spark yang diharapkan yang Anda rencanakan untuk digunakan untuk aplikasi yang ditingkatkan. Target EMR Cluster atau Aplikasi EMR-S akan digunakan untuk mengirimkan pekerjaan validasi yang berjalan setelah artefak aplikasi Spark ditingkatkan untuk memverifikasi peningkatan yang berhasil atau memperbaiki kesalahan tambahan yang ditemui selama validasi. Jika Anda sudah memiliki cluster EMR target atau aplikasi EMR Tanpa Server, Anda dapat merujuk ke yang sudah ada dan melewati langkah ini. Gunakan akun pengembang non-produksi dan pilih contoh kumpulan data tiruan yang mewakili data produksi Anda tetapi ukurannya lebih kecil untuk validasi dengan Peningkatan Spark. Silakan merujuk ke halaman ini untuk panduan membuat cluster EMR target atau aplikasi EMR Tanpa Server dari yang sudah ada:. [Membuat target EMR Cluster/aplikasi EMR-S dari yang sudah ada](emr-spark-upgrade-agent-target-cluster.md) # Fitur dan Kemampuan ## Teknologi yang Didukung + **Bahasa**: Aplikasi Python dan Scala + **Build Systems**: Maven dan SBT untuk proyek Scala; requirements.txt, Pipfile, dan Setuptools untuk proyek Python + **Platform Target**: Amazon EMR dan EMR Tanpa Server + **Versi yang Didukung**: Kami mendukung peningkatan Apache Spark dari versi 2.4 ke 3.5. Pemetaan mode penerapan yang sesuai adalah sebagai berikut + **Untuk EMR- EC2** + **Versi Sumber:** EMR 5.20.0 dan yang lebih baru + **Versi Target:** EMR 7.12.0 dan sebelumnya, harus lebih baru dari EMR 5.20.0 + **Untuk EMR Tanpa Server** + **Versi Sumber:** EMR Tanpa Server 6.6.0 dan yang lebih baru + **Versi Target:** EMR Tanpa Server 7.12.0 dan sebelumnya ## Apa yang Kami Upgrade Agen pemutakhiran menyediakan peningkatan aplikasi Spark yang komprehensif: + **Konfigurasi Bangun**: Secara otomatis memperbarui file manajemen ketergantungan (pom.xml, requirements.txt, dll.) + **Kode Sumber**: Memperbaiki masalah kompatibilitas API dan penggunaan metode yang tidak digunakan lagi + **Kode Uji**: Memastikan pengujian unit dan integrasi bekerja dengan versi Spark target + **Dependensi: Meningkatkan dependensi** yang dikemas ke versi yang kompatibel dengan versi EMR target + **Validasi**: Mengkompilasi dan memvalidasi aplikasi pada kluster EMR target + **Analisis Kualitas Data**: Mendeteksi perbedaan skema, penyimpangan statistik tingkat nilai (min/max/mean), dan ketidakcocokan jumlah baris agregat, dengan pelaporan dampak terperinci. ## Wilayah yang Tersedia Agen Peningkatan Spark tersedia di wilayah berikut: + **Asia Pasifik**: Tokyo (ap-northeast-1), Seoul (ap-northeast-2), Singapura (ap-southeast-1), Sydney (ap-southeast-2), dan Mumbai (ap-southeast-1) + **Amerika Utara**: Kanada (ca-central-1) + **Eropa**: Stockholm (eu-north-1), Irlandia (eu-west-1), London (eu-west-2), Paris (eu-west-3), dan Frankfurt (eu-central-1) + **Amerika Selatan**: São Paulo (sa-east-1) + **Amerika Serikat**: Virginia Utara (us-east-1), Ohio (us-east-2), dan Oregon (us-west-2) ## Lingkup Upgrade dan Persyaratan Pengguna + **Manajemen Cluster**: Agen Peningkatan Spark berfokus pada peningkatan kode aplikasi. Target kluster EMR untuk versi baru harus dibuat dan dikelola oleh pengguna. + **Tindakan Bootstrap**: Agen Peningkatan Spark tidak memutakhirkan skrip bootstrap khusus di luar kode aplikasi Spark. Mereka perlu ditingkatkan oleh pengguna. + **Upgrade for Build and Tests**: Agen pemutakhiran akan melakukan build dan menjalankan pengujian unit dan integrasi Anda di lingkungan pengembangan Anda secara lokal untuk memvalidasi bahwa aplikasi berhasil dikompilasi dengan versi Spark target. Jika Anda memiliki batasan (kebijakan keamanan, batasan sumber daya, pembatasan jaringan, atau pedoman perusahaan) untuk kode aplikasi Spark untuk eksekusi lokal, pertimbangkan untuk menggunakan [Amazon SageMaker Unified Studio VSCode IDE Spaces](https://docs.aws.amazon.com/sagemaker-unified-studio/latest/userguide/create-space.html) atau EC2 untuk menjalankan agen pemutakhiran. Agen pemutakhiran menggunakan aplikasi EC2 EMR-cluster atau EMR-S target Anda untuk memvalidasi dan meningkatkan. end-to-end + **Pendekatan Berbasis Kesalahan**: Agen pemutakhiran menggunakan metodologi yang digerakkan oleh kesalahan, membuat satu perbaikan pada satu waktu berdasarkan kompilasi atau kesalahan runtime daripada beberapa perbaikan sekaligus. Pendekatan berulang ini memastikan setiap masalah ditangani dengan benar sebelum melanjutkan ke yang berikutnya. + **Dependensi Pribadi**: Dependensi yang diinstal dari repositori artefak pribadi tidak dapat ditingkatkan secara otomatis sebagai bagian dari proses ini. Mereka harus ditingkatkan oleh pengguna. + **Sumber daya regional**: Agen peningkatan Spark bersifat regional dan menggunakan sumber daya EMR yang mendasarinya di wilayah tersebut untuk proses peningkatan. Upgrade lintas wilayah tidak didukung. # Pemecahan Masalah dan Tanya Jawab ## Pemecahan masalah Pesan kesalahan dari proses upgrade tersedia dalam berbagai cara untuk klien MCP yang berbeda. Di halaman ini, kami mencantumkan beberapa panduan umum untuk masalah umum yang mungkin Anda lihat menggunakan Apache Spark Upgrade Agent untuk Amazon EMR. **Topics** + [ ### Kesalahan: Server MCP Terkelola SMUS gagal dimuat ](#spark-upgrade-agent-mcp-server-failed) + [ ### Pengamatan: Pemuatan Alat Lambat ](#spark-upgrade-agent-slow-tool-loading) + [ ### Kesalahan: Pemanggilan Alat Gagal dengan Kesalahan Pelambatan ](#spark-upgrade-agent-throttling-error) + [ ### Kesalahan: Alat Menanggapi Dengan Kesalahan Pengguna ](#spark-upgrade-agent-user-error) + [ ### Kesalahan: Alat Menanggapi Dengan Kesalahan Internal ](#spark-upgrade-agent-internal-error) ### Kesalahan: Server MCP Terkelola SMUS gagal dimuat + Verifikasi konfigurasi MCP Anda dikonfigurasi dengan benar. + **Validasi sintaks JSON**: + Pastikan JSON Anda valid tanpa kesalahan sintaks + Periksa koma, tanda kutip, atau tanda kurung yang hilang + Verifikasi AWS kredensi lokal Anda dan verifikasi kebijakan untuk peran IAM MCP telah dikonfigurasi dengan benar. + Jalankan /mcp untuk memverifikasi ketersediaan server MCP untuk kasus `Kiro-CLI` ### Pengamatan: Pemuatan Alat Lambat + Alat mungkin memerlukan beberapa detik untuk dimuat pada upaya pertama meluncurkan server. + Jika alat tidak muncul, coba mulai ulang obrolan, + Jalankan `/tools` perintah untuk memverifikasi ketersediaan alat. + Jalankan `/mcp` jika server diluncurkan tanpa kesalahan. ### Kesalahan: Pemanggilan Alat Gagal dengan Kesalahan Pelambatan Jika Anda mencapai batas layanan, harap tunggu beberapa detik untuk mengeluarkan pemanggilan alat jika Anda melihat pengecualian pelambatan. ### Kesalahan: Alat Menanggapi Dengan Kesalahan Pengguna + AccessDeniedException - periksa pesan kesalahan dan perbaiki masalah izin. + InvalidInputException - periksa pesan kesalahan dan perbaiki parameter input alat. + ResourceNotFoundException - periksa pesan kesalahan dan perbaiki parameter input untuk referensi sumber daya. ### Kesalahan: Alat Menanggapi Dengan Kesalahan Internal + Jika Anda melihatnya, `The service is handling high-volume requests` coba lagi pemanggilan alat dalam beberapa detik. + Jika Anda melihatnya, `INTERNAL SERVICE EXCEPTION` harap dokumentasikan id analisis, nama alat, pesan kesalahan apa pun yang tersedia dari log mcp atau respons alat dan riwayat percakapan yang disanitasi opsional dan hubungi dukungan. AWS ## T&J ### 1. Haruskah saya mengaktifkan pengaturan “kepercayaan” untuk alat secara default? Jangan aktifkan setelan “trust” secara default untuk semua panggilan alat pada awalnya dan operasikan pada lingkungan build berversi git. Tinjau setiap eksekusi alat untuk memahami perubahan apa yang sedang dilakukan, misalnya tinjau rencana peningkatan sebelum memberikan persetujuan. Jangan pernah mempercayai Kiro atau alat Agen Anda - `fs_write` alat ini memodifikasi file proyek Anda dan Anda harus selalu meninjau perubahan sebelum disimpan/berkomitmen. Secara umum, periksa semua perubahan file yang diusulkan sebelum mengizinkannya ditulis. Gunakan git untuk perubahan versi dan buat pos pemeriksaan selama proses peningkatan. Bangun kepercayaan secara bertahap - Jika Anda berulang kali menggunakan sistem untuk beberapa peningkatan dan telah mendapatkan kepercayaan pada alat, Anda dapat secara selektif mempercayai alat tertentu. ### 2. Apa contoh umum yang diminta untuk memanfaatkan alat pemutakhiran? Silakan lihat untuk [Contoh Prompt untuk Agen Peningkatan Spark](emr-spark-upgrade-agent-prompt-examples.md) contoh cepat tentang memanfaatkan alat pemutakhiran. # Alur Kerja Agen Peningkatan Spark Secara Detail Untuk memulai proses pemutakhiran, Anda memerlukan kode aplikasi Spark yang dikloning ke lingkungan pengembang Anda (secara lokal atau atau EC2 [Amazon SageMaker Unified Studio IDE Spaces](https://docs.aws.amazon.com/sagemaker-unified-studio/latest/userguide/create-space.html)), sebaiknya dengan kontrol versi Git yang diinisialisasi. Selain itu, kluster EMR yang menjalankan versi Spark target harus disediakan dan dapat diakses. Terakhir, jalur bucket Amazon S3 yang ditunjuk harus dikonfigurasi untuk menyimpan artefak penerapan dan ringkasan pemutakhiran selama proses pemutakhiran. Setelah persyaratan ini ditetapkan, Anda dapat mengirimkan prompt seperti berikut untuk memulai alur kerja pemutakhiran: ``` Upgrade my Spark application from EMR version 6.0.0 to 7.12.0. Use EMR-EC2 Cluster to run the validation and s3 paths s3:// to store updated application artifacts. ``` [Pada titik ini, agen akan mengatur peningkatan menggunakan alat khusus (untuk lebih jelasnya).](emr-spark-upgrade-agent-tools.md) Alur kerja mengikuti langkah-langkah ini: 1. **Menghasilkan Rencana**: Agen akan menganalisis struktur proyek Anda dan menghasilkan rencana peningkatan. Tinjau rencana dan berikan persetujuan Anda untuk melanjutkan. 1. **Tinjauan dan Kustomisasi Rencana**: Ketika diminta untuk meninjau paket, Anda memiliki beberapa opsi: 1. **Lanjutkan apa adanya**: Terima rencana dan lanjutkan eksekusi 1. **Berikan umpan balik**: Sesuaikan paket dengan: 1. Menghapus langkah-langkah yang tidak perlu - Contoh: Hapus eksekusi uji integrasi apa pun. Hanya compile/build secara lokal, kemudian lanjutkan ke validasi EMR. 1. Menambahkan langkah-langkah tambahan - Contoh: Tambahkan langkah untuk menjalankan file uji `tests/test_jobs/test_etl_job_x.py` sebelum validasi EMR. 1. Memodifikasi pendekatan pemutakhiran - Contoh: Menerapkan Python 3.10 dan Java 17 selama langkah pembuatan dan validasi. 1. Agen akan meregenerasi rencana berdasarkan umpan balik Anda dan meminta persetujuan lagi. Proses ini berlanjut sampai Anda menyetujui rencana akhir 1. **Compile and Build**: Agen akan membuat perubahan berulang untuk memperbaiki kesalahan build hingga aplikasi berhasil dikompilasi dan dibangun. 1. **Jalankan unit dan Pengujian Integrasi**: Jika proyek memiliki pengujian, agen akan menjalankan pengujian setelah build berhasil. Jika ada tes yang gagal, agen akan memodifikasi kode sumber secara iteratif sampai tes lulus sebelum melanjutkan ke validasi EMR. 1. **Perbaikan dan Validasi Runtime**: Agen akan memvalidasi aplikasi pada kluster EMR target dan secara berulang memperbaiki kesalahan runtime hingga validasi berhasil. Setelah selesai, Anda akan melihat ringkasan semua perubahan yang dibuat untuk kompatibilitas. 1. **Ringkasan untuk pemutakhiran**: Setelah pemutakhiran selesai, agen akan memberikan ringkasan semua perubahan kode dan konfigurasi, pembaruan versi ketergantungan, dan ketidakcocokan kualitas data yang terdeteksi untuk tinjauan Anda. # Aktifkan Validasi Kualitas Data Anda dapat mengaktifkan pemeriksaan kualitas data dengan menyediakan cluster sumber dan target IDs di prompt Anda. Sistem menjalankan aplikasi Anda yang ada di cluster sumber untuk mengumpulkan metadata dasar untuk perbandingan. **Catatan: Hanya operasi penulisan Spark yang dapat dilacak untuk kualitas data.** ``` Upgrade my pyspark application /pyspark-example-24/ from EMR version 6.0.0 to 7.12.0. Use EMR-EC2 Cluster for source version run and for target version run. Use s3 path s3:// to store updated application artifacts and s3:///metadata for storing metadata. Enable data quality checks. ``` ## Perbedaan Alur Kerja Kualitas Data Alur kerja mengikuti langkah yang sama dengan proses pemutakhiran standar dengan langkah-langkah tambahan ini dalam urutan di atas: + **[Setelah Langkah 3: Tinjauan Rencana dan Kustomisasi]** + **Bangun dengan Konfigurasi Saat Ini**: Bangun aplikasi dengan konfigurasi saat ini untuk pengiriman cluster sumber. + **Validasi pada Cluster EMR Sumber**: Jalankan aplikasi asli pada versi Spark sumber dan kumpulkan metadata keluaran untuk perbandingan dasar. + **[Setelah Langkah 7: Ringkasan untuk peningkatan] Ringkasan Kualitas Data**: Laporan perbandingan kualitas data antara versi dan analisis. ### Kemampuan ketidakcocokan kualitas data saat ini meliputi: + **Pemeriksaan Skema**: Mendeteksi perubahan dalam struktur kolom: kolom hilang atau baru ditambahkan, perbedaan tipe data, dan perubahan nullability. + **Cek Nilai** *(kolom numerik dan string saja*) + Membandingkan min, max, dan mean (mean hanya untuk kolom numerik). + Untuk string, min dan max didasarkan pada urutan leksikografis. + **Pemeriksaan Statistik Agregat**: Membandingkan jumlah baris total antara output sumber dan target. ## Validasi Kualitas Data: Ruang Lingkup dan Keterbatasan Validasi Kualitas Data mendukung langkah EMR EC2 menggunakan perintah spark-submit dengan versi Spark >= 3.0 dan cluster EMR tidak dapat memiliki> 1. StepConcurrencyLevel Validasi Kualitas Data mengevaluasi statistik pada node sink data paket kueri Spark (sumber data/metadata Transforms tidak ditangkap) dan mencakup operasi penulisan Spark umum termasuk penulisan file, sisipan database, pembuatan tabel, dan berbagai output sumber data. # Contoh Prompt untuk Agen Peningkatan Spark Kami mencantumkan beberapa contoh prompt berbeda yang dapat digunakan dalam proses peningkatan. ## 1. Berikan informasi Langkah EMR yang ada untuk agen untuk meningkatkan aplikasi Spark ``` Upgrade my Spark application from EMR version 6.0.0 to 7.12.0. Use EMR-EC2 Cluster to run the validation and s3 paths s3:// to store updated application artifacts. The Spark application is already executed in the source EMR-EC2 Cluster with step id . ``` ## 2. Analisis daftar (digunakan untuk Upgrade) dan periksa status analisis tertentu ``` Can you list all the spark upgrade analysis. ``` ``` Describe the analysis with analysis id . ``` ## 3. Ubah paket pemutakhiran setelah dibuat ``` Help me to update the generated upgrade plan to skip the local test step. ``` ## 4. Ganti konfigurasi default untuk eksekusi pekerjaan validasi upgrade ``` For submitting my EMR Severless validaiton job. I would like to use S3 logging instead of CW logging, and use this S3 path . ``` # Membuat target EMR Cluster/aplikasi EMR-S dari yang sudah ada Jika Anda sudah memiliki EC2 kluster EMR yang menjalankan versi Spark sumber, Anda dapat mengkloningnya untuk membuat cluster baru dengan konfigurasi yang sama tetapi versi rilis EMR yang diperbarui untuk menjalankan langkah-langkah validasi selama proses Upgrade. ## Langkah: 1. Masuk ke Konsol Manajemen AWS dan buka konsol EMR Amazon. 1. Di panel navigasi kiri, pilih Cluster di bawah EMR aktif. EC2 1. Dari daftar cluster: + Gunakan pencarian atau filter jika diperlukan untuk menemukan klaster Anda. + Pilih kotak centang di sebelah cluster yang ingin Anda kloning. + Opsi Clone akan muncul di bagian atas daftar. Pilih Klon. + Jika klaster memiliki langkah-langkah yang dikonfigurasi, pilih Sertakan langkah dan kemudian Lanjutkan untuk mengkloning langkah-langkah bersama dengan pengaturan cluster lainnya. 1. Tinjau pengaturan untuk cluster baru yang telah disalin dari cluster asli. 1. Perbarui versi rilis Amazon EMR ke versi target. 1. Sebagai praktik terbaik untuk efisiensi biaya, pertimbangkan untuk mengaktifkan penskalaan otomatis saat mengonfigurasi cluster untuk menyesuaikan kapasitas secara otomatis berdasarkan tuntutan beban kerja. 1. Bila Anda puas dengan konfigurasi, pilih Create cluster untuk meluncurkan cluster baru. 1. Tunggu klaster mencapai status Running dan catat ID cluster. Berikan ID ini kepada agen saat diminta untuk memvalidasi aplikasi yang diperbarui. 1. [Jika Anda lebih suka membuat cluster baru dari awal, silakan merujuk ke dokumentasi EMR: https://docs.aws.amazon.com/emr/ latest/ManagementGuide/emr -gs.html.](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-gs.html) ## Mengkloning aplikasi EMR Tanpa Server ke Versi Rilis target Tidak ada cara langsung untuk mengkloning aplikasi EMR Tanpa Server ke yang baru dengan versi rilis EMR yang berbeda. Sebagai gantinya, Anda dapat menggunakan EMR Tanpa Server SDK/CLI atau konsol untuk membuat aplikasi baru dan menggunakan kembali konfigurasi dari yang sudah ada. Berikut adalah beberapa perintah CLI pembantu untuk memulai: ``` aws emr-serverless get-application --application-id XXX > old-config.json cat old-config.json | jq '{ name: (.application.name + ""), releaseLabel: "", type: .application.type, initialCapacity: .application.initialCapacity, maximumCapacity: .application.maximumCapacity, autoStartConfiguration: .application.autoStartConfiguration, autoStopConfiguration: .application.autoStopConfiguration, tags: .application.tags, architecture: .application.architecture, runtimeConfiguration: .application.runtimeConfiguration, monitoringConfiguration: .application.monitoringConfiguration }' > new-config.json aws emr-serverless create-application --cli-input-json file://new-config.json ``` **Catatan:** Pastikan bahwa peran eksekusi pekerjaan untuk aplikasi baru memungkinkan EMR Tanpa Server untuk mengambil peran tersebut. Tinjau kebijakan kepercayaan peran. Jika Anda menggunakan kembali peran eksekusi pekerjaan yang sama dari aplikasi lama, perbarui kebijakan kepercayaan untuk menyertakan aplikasi baru seperti yang ditunjukkan di bawah ini: ``` #Replace the old application id and new application id in the policy { "Version": "2012-10-17", "Statement": [ { "Sid": "ServerlessTrustPolicy", "Effect": "Allow", "Principal": { "Service": "emr-serverless.amazonaws.com" }, "Action": "sts:AssumeRole", "Condition": { "StringLike": { "aws:SourceArn": [ "arn:aws:emr-serverless:us-east-1::/applications/", "arn:aws:emr-serverless:us-east-1::/applications/" ] } } } ] } ``` # Pengaturan Peran IAM CloudFormation Tumpukan dalam Petunjuk Pengaturan mengotomatiskan pengaturan peran IAM untuk Anda. Jika Anda ingin menjalankannya secara manual, ikuti petunjuk di bawah ini: ## Pengaturan Peran IAM untuk server MCP Untuk mengakses server MCP Terkelola SMUS, diperlukan peran IAM dengan kebijakan inline berikut: ``` { "Version": "2012-10-17", "Statement": [ { "Sid": "AllowUseSagemakerUnifiedStudioMcpServer", "Effect": "Allow", "Action": [ "sagemaker-unified-studio-mcp:InvokeMcp", "sagemaker-unified-studio-mcp:CallReadOnlyTool", "sagemaker-unified-studio-mcp:CallPrivilegedTool" ], "Resource": [ "*" ] } ] } ``` Pada langkah selanjutnya, kami akan membuat profil untuk peran ini. Akun mana pun yang mengambil peran ini untuk mendapatkan kredensil harus ditambahkan ke kebijakan peran asumsi. ``` { "Version": "2012-10-17", "Statement": [ { "Sid": "AllowAccountToAssumeRole", "Effect": "Allow", "Principal": { "AWS": "arn:aws:iam:::root" }, "Action": "sts:AssumeRole" } ] } ``` ## Izin Tambahan dengan Mode Penerapan (EMR- /EMR-S) EC2 ### EMR- Aplikasi EC2 Ganti bucket pementasan Amazon S3 dalam kebijakan dengan bucket Amazon S3 tempat penyimpanan artefak yang ditingkatkan ``` { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "elasticmapreduce:DescribeCluster", "elasticmapreduce:DescribeStep", "elasticmapreduce:ListSteps", "elasticmapreduce:ListClusters", "elasticmapreduce:DescribeJobFlows", "elasticmapreduce:AddJobFlowSteps", "elasticmapreduce:CreatePersistentAppUI", "elasticmapreduce:DescribePersistentAppUI", "elasticmapreduce:GetPersistentAppUIPresignedURL" ], "Resource": "*" }, { "Effect": "Allow", "Action": [ "s3:GetBucket*", "s3:GetObject*", "s3:List*", "s3:Put*" ], "Resource": [ "arn:aws:s3:::", "arn:aws:s3:::/*" ] } ] } ``` #### Izin KMS - Staging Bucket Jika bucket staging dienkripsi dengan CMK, tambahkan kebijakan berikut. Layanan akan secara otomatis menggunakan CMK yang dikonfigurasi pada bucket saat mengunggah data. ``` { "Effect": "Allow", "Action": [ "kms:GenerateDataKey", "kms:Encrypt" ], "Resource": "arn:aws:kms:::key/" } ``` ### Aplikasi EMR Tanpa Server Ganti bucket pementasan Amazon S3 dalam kebijakan dengan bucket Amazon S3 tempat penyimpanan artefak yang ditingkatkan ``` { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "emr-serverless:StartJobRun", "emr-serverless:GetJobRun", "emr-serverless:GetApplication", "emr-serverless:ListApplications", "emr-serverless:GetDashboardForJobRun" ], "Resource": "*" }, { "Effect": "Allow", "Action": "iam:PassRole", "Resource": "*", "Condition": { "StringLike": { "iam:PassedToService": "emr-serverless.amazonaws.com" } } }, { "Effect": "Allow", "Action": [ "logs:GetLogEvents", "logs:DescribeLogStreams" ], "Resource": "arn:aws:logs:*:*:log-group:*" }, { "Effect": "Allow", "Action": [ "s3:GetBucket*", "s3:GetObject*", "s3:List*", "s3:Put*" ], "Resource": [ "arn:aws:s3:::", "arn:aws:s3:::/*" ] } ] } ``` #### Izin KMS - Staging Bucket Jika bucket staging dienkripsi dengan CMK, tambahkan kebijakan berikut. Layanan akan secara otomatis menggunakan CMK yang dikonfigurasi pada bucket saat mengunggah data ``` { "Effect": "Allow", "Action": [ "kms:GenerateDataKey", "kms:Encrypt" ], "Resource": "arn:aws:kms:::key/" } ``` #### Izin KMS - Log CloudWatch Jika CloudWatch Log dienkripsi dengan CMK, tambahkan kebijakan berikut agar layanan dapat membaca log aplikasi EMR-Serverless. ``` { "Effect": "Allow", "Action": [ "kms:Decrypt", "kms:DescribeKey" ], "Resource": "arn:aws:kms:::key/" } ``` # Mengkonfigurasi Titik Akhir VPC Antarmuka untuk SageMaker Amazon Unified Studio MCP *Anda dapat membuat koneksi pribadi antara VPC dan layanan Amazon SageMaker Unified Studio MCP dengan membuat titik akhir VPC antarmuka.* Endpoint antarmuka didukung oleh [Amazon VPC](https://aws.amazon.com/vpc/), yang memungkinkan Anda mengakses server MCP secara pribadi di VPC Anda tanpa gateway internet, perangkat NAT, koneksi VPN, atau koneksi. Instans di VPC Anda tidak memerlukan alamat IP publik untuk berkomunikasi dengan layanan MCP dan lalu lintas antara VPC dan layanan MCP Anda tidak meninggalkan jaringan Amazon. Setiap titik akhir antarmuka diwakili oleh satu atau lebih Antarmuka [Jaringan Elastis di subnet](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-eni.html) VPC Anda. Untuk informasi selengkapnya, lihat [Titik akhir VPC Antarmuka di Panduan](https://docs.aws.amazon.com/vpc/latest/userguide/vpce-interface.html) Pengguna Amazon *VPC*. ## Langkah 1: Membuat titik akhir VPC antarmuka untuk Amazon SageMaker Unified Studio MCP Anda dapat membuat titik akhir VPC untuk layanan Amazon SageMaker Unified Studio MCP menggunakan konsol VPC Amazon atau konsol. AWS CLI Untuk informasi selengkapnya, lihat [Membuat titik akhir antarmuka](https://docs.aws.amazon.com/vpc/latest/userguide/vpce-interface.html#create-interface-endpoint) dalam *Panduan Pengguna Amazon VPC*. Buat endpoint VPC untuk Amazon SageMaker Unified Studio MCP menggunakan nama layanan berikut: + com.amazonaws. **. sagemaker-unified-studio-mcp Jika Anda mengaktifkan DNS pribadi untuk titik akhir, Anda dapat membuat permintaan API ke Amazon SageMaker Unified Studio MCP menggunakan nama DNS default untuk Wilayah, misalnya, `sagemaker-unified-studio-mcp.us-east-1.api.aws` Untuk informasi selengkapnya, lihat [Mengakses layanan melalui titik akhir antarmuka](https://docs.aws.amazon.com/vpc/latest/userguide/vpce-interface.html#access-service-though-endpoint) dalam *Panduan Pengguna Amazon VPC*. ## Langkah 2: Membuat Kebijakan endpoint VPC untuk Amazon SageMaker Unified Studio MCP Anda dapat melampirkan kebijakan titik akhir ke titik akhir VPC yang mengontrol akses ke SageMaker Amazon Unified Studio MCP. Kebijakan titik akhir menentukan informasi berikut: + Prinsipal yang dapat melakukan tindakan. + Tindakan yang dapat dilakukan. + Sumber daya yang menjadi target tindakan. Untuk informasi selengkapnya, lihat [Mengontrol Akses ke Layanan dengan titik akhir VPC](https://docs.aws.amazon.com/vpc/latest/userguide/vpc-endpoints-access.html) dalam *Panduan Pengguna Amazon VPC*. ### Contoh: Kebijakan titik akhir VPC untuk mengizinkan akses MCP ke peran IAM tertentu Berikut ini adalah contoh kebijakan endpoint untuk akses Amazon SageMaker Unified Studio MCP. Saat dilampirkan ke titik akhir, kebijakan ini memberikan akses ke tindakan MCP Amazon SageMaker Unified Studio yang terdaftar untuk prinsipal peran IAM tertentu di semua sumber daya. ``` { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Principal": { "AWS": "arn:aws:iam::ACCOUNT-ID:role/YourRoleName" }, "Action": [ "sagemaker-unified-studio-mcp:InvokeMcp", "sagemaker-unified-studio-mcp:CallReadOnlyTool", "sagemaker-unified-studio-mcp:CallPrivilegedTool" ], "Resource": "*" } ] } ``` ## Langkah 3: Menguji VPC Anda `curl`Perintah memvalidasi konektivitas end-to-end jaringan dari jaringan VPC Anda EC2 () ke titik akhir VPC dengan membuat permintaan. HTTP/HTTPS Respons curl yang menerima Pesan kembali dari server MCP mengonfirmasi bahwa jalur jaringan lengkap berfungsi. ### Metode 1: Dengan DNS Pribadi Diaktifkan (Disarankan) ``` curl https://sagemaker-unified-studio-mcp.us-east-1.api.aws/spark-upgrade/mcp ``` ### Metode 2: Tanpa DNS Pribadi Diaktifkan ``` curl -k https://vpce-0069xxxx-ejwh6xxx.sagemaker-unified-studio-mcp.us-east-1.vpce.amazonaws.com/spark-upgrade/mcp ``` **catatan** `-k`Bendera melewati verifikasi sertifikat SSL karena ketidakcocokan nama host antara nama DNS titik akhir VPC dan Nama Umum (CN) sertifikat. Dalam kedua kasus, perintah curl mengembalikan respons:`{"Message":"...."}`. Kembali dengan Pesan memverifikasi konektivitas jalur jaringan yang berhasil ke titik akhir VPC layanan MCP. ## Langkah 4: Mulai gunakan titik akhir MCP VPC Setelah Anda memverifikasi koneksi, Anda dapat mengikuti langkah-langkah untuk mengonfigurasi MCP. [Pengaturan untuk Agen Peningkatan](emr-spark-upgrade-agent-setup.md) Cukup gunakan titik akhir VPC pribadi dalam konfigurasi MCP Anda. # Menggunakan Alat Peningkatan Spark ## Alat Upgrade yang Tersedia Layanan MCP menyediakan beberapa alat untuk membantu peningkatan Spark. Alat utama adalah sebagai berikut: | | Nama alat | Kategori Alat | Deskripsi | | --- | --- | --- | --- | | 1 | generate\$1spark\$1upgrade\$1plan | Perencana | Hasilkan paket peningkatan EMR- EC2 /EMR-S | | 2 | reuse\$1existing\$1spark\$1upgrade\$1plan | Perencana | Gunakan kembali paket peningkatan lokal yang ada | | 3 | update\$1build\$1configuration | Build | Tingkatkan file konfigurasi build | | 4 | check\$1and\$1update\$1build\$1environment | Build | Periksa/perbarui lingkungan Java untuk peningkatan Spark | | 5 | compile\$1and\$1build\$1project | Build | Memberikan panduan untuk compiling/building proyek | | 6 | run\$1validation\$1job | Uji | Kirim aplikasi Spark ke EMR- /EMR-S EC2 | | 7 | check\$1job\$1status | Uji | Periksa status EMR- EC2 step atau EMR-S job run | | 8 | check\$1and\$1update\$1python\$1environment | Sunting kode percikan | Periksa/perbarui Python env untuk peningkatan Spark | | 9 | fix\$1upgrade\$1failure | Sunting kode percikan | Menganalisis kegagalan dan menyarankan perbaikan | | 10 | get\$1data\$1quality\$1summary | Observablitas | Ambil ringkasan kualitas data setelah aplikasi ditingkatkan | | 11 | describe\$1upgrade\$1analysis | Observablitas | Jelaskan analisis yang diberikan | | 12 | list\$1upgrade\$1analisis | Observablitas | daftar semua analisis yang dibuat oleh akun saat ini | Untuk daftar lengkap semua alat pemutakhiran yang disediakan oleh server MCP Terkelola SMUS, Anda dapat mencantumkan semua alat dari server. # Pemrosesan lintas wilayah untuk Agen Upgrade Apache Spark Apache Spark Upgrade Agent menggunakan inferensi lintas wilayah untuk memproses permintaan bahasa alami dan menghasilkan tanggapan. Dengan inferensi lintas wilayah, agen akan secara otomatis merutekan permintaan inferensi Anda untuk mengoptimalkan kinerja, memaksimalkan sumber daya komputasi dan ketersediaan model yang tersedia, dan memberikan pengalaman pelanggan terbaik. Jenis inferensi lintas wilayah yang digunakan tergantung pada wilayah tempat Anda menjalankan Agen Upgrade Apache Spark. Di sebagian besar Wilayah, agen akan memilih wilayah optimal dalam geografi Anda untuk memproses permintaan inferensi Anda. Namun, di beberapa Wilayah permintaan inferensi yang dibuat oleh Agen akan diarahkan dengan aman ke semua sumber daya komputasi yang tersedia di semua Wilayah komersial global. AWS ## Inferensi Lintas Wilayah Agen Apache Spark Upgrade didukung oleh dan menggunakan inferensi lintas wilayah untuk mendistribusikan lalu lintas di berbagai AWS Wilayah untuk meningkatkan kinerja dan keandalan inferensi model bahasa besar (LLM). Meskipun inferensi lintas wilayah tidak berubah di mana aplikasi Spark Anda atau pengalaman peningkatan Anda di-host atau data Anda disimpan, prompt input dan hasil output Anda dapat dikirimkan ke Wilayah yang berbeda untuk pemrosesan inferensi. Semua data akan dikirimkan dienkripsi di seluruh jaringan aman Amazon. Tidak ada biaya tambahan untuk menggunakan inferensi lintas wilayah. ## Wilayah yang didukung untuk inferensi lintas wilayah ### Wilayah Menggunakan inferensi lintas wilayah Geografis Untuk sebagian besar Wilayah, permintaan inferensi lintas wilayah disimpan dalam AWS Wilayah yang merupakan bagian dari geografi yang sama tempat Anda menjalankan Agen Peningkatan Apache Spark. Misalnya, permintaan yang dibuat dari agen di Wilayah AS Timur (Virginia N.) hanya dialihkan ke AWS Wilayah dalam geografi Amerika Serikat. Tabel berikut menjelaskan Wilayah mana permintaan Anda dapat diarahkan tergantung pada geografi tempat permintaan tersebut berasal: | | Geografi yang didukung | Daerah inferensi | | --- | --- | --- | | 1 | Amerika Serikat | AS Timur (Virginia N.) (us-timur-1), AS Barat (Oregon) (us-barat-2), AS Timur (Ohio) (us-timur-2), AS Barat (California Utara) (us-barat-2) | | 2 | Eropa | Eropa (Frankfurt) (eu-central-1), Eropa (Irlandia) (eu-west-1), Eropa (Paris) (eu-west-3), Eropa (eu-west-3), Eropa (Stockholm) (eu-north-1), Eropa (London) (eu-west-2) | | 3 | Asia Pasifik | Asia Pasifik (Tokyo) (ap-northeast-1), Asia Pasifik (Seoul) (ap-northeast-2), Asia Pasifik (ap-south-1) | ### Wilayah Menggunakan Inferensi Lintas Wilayah Global **penting** AWS Wilayah berikut menggunakan inferensi lintas wilayah global. Saat Anda menggunakan Agen Peningkatan Apache Spark di Wilayah ini, permintaan Anda dapat dikirimkan secara global ke AWS Wilayah lain untuk pemrosesan inferensi guna mengoptimalkan kinerja dan ketersediaan: + Amerika Selatan (Sao Paulo) (sa-east-1) + Asia Pasifik (Singapura) (ap-southeast-1) + Asia Pasifik (Sydney) (ap-southeast-2) + Kanada (Pusat) (ca-central-1) # Pencatatan panggilan MCP Amazon SageMaker Unified Studio menggunakan AWS CloudTrail Amazon SageMaker Unified Studio MCP Server terintegrasi dengan AWS CloudTrail, layanan yang menyediakan catatan tindakan yang diambil oleh pengguna, peran, atau AWS layanan di Amazon SageMaker Unified Studio MCP Server. CloudTrail menangkap semua panggilan API untuk Amazon SageMaker Unified Studio MCP Server sebagai peristiwa. Panggilan yang diambil termasuk panggilan ke Amazon SageMaker Unified Studio MCP Server dan panggilan kode ke AWS operasi lain selama eksekusi alat dari SageMaker Unified Studio MCP Server. Jika Anda membuat jejak, Anda dapat mengaktifkan pengiriman CloudTrail acara secara terus menerus ke bucket Amazon S3, termasuk acara untuk Amazon SageMaker Unified Studio MCP Server. Jika Anda tidak mengonfigurasi jejak, Anda masih dapat melihat peristiwa terbaru di CloudTrail konsol dalam **Riwayat acara**. Dengan menggunakan informasi yang dikumpulkan oleh CloudTrail, Anda dapat menentukan permintaan yang dibuat ke Amazon SageMaker Unified Studio MCP Server, alamat IP dari mana permintaan dibuat, siapa yang membuat permintaan, kapan dibuat, dan detail tambahan. Untuk mempelajari selengkapnya CloudTrail, lihat [Panduan AWS CloudTrail Pengguna](https://docs.aws.amazon.com/awscloudtrail/latest/userguide/). ## Informasi Server MCP Amazon SageMaker Unified Studio di CloudTrail CloudTrail diaktifkan di AWS akun Anda saat Anda membuat akun. Ketika aktivitas terjadi di Amazon SageMaker Unified Studio MCP Server, aktivitas tersebut direkam dalam suatu CloudTrail peristiwa bersama dengan peristiwa AWS layanan lainnya dalam riwayat **Acara**. Anda dapat melihat, mencari, dan mengunduh acara terbaru di AWS akun Anda. Untuk informasi selengkapnya, lihat [Melihat peristiwa dengan Riwayat CloudTrail acara](https://docs.aws.amazon.com/awscloudtrail/latest/userguide/view-cloudtrail-events.html). Untuk catatan peristiwa yang sedang berlangsung di AWS akun Anda, termasuk acara untuk SageMaker Unified Studio MCP Server, buat jejak. Jejak memungkinkan CloudTrail untuk mengirimkan file log ke bucket Amazon S3. Secara default, saat Anda membuat jejak di konsol, jejak tersebut berlaku untuk semua AWS Wilayah. Jejak mencatat peristiwa dari semua Wilayah di AWS partisi dan mengirimkan file log ke bucket Amazon S3 yang Anda tentukan. Selain itu, Anda dapat mengonfigurasi AWS layanan lain untuk menganalisis lebih lanjut dan menindaklanjuti data peristiwa yang dikumpulkan dalam CloudTrail log. Untuk informasi selengkapnya, lihat berikut: + [Gambaran umum untuk membuat jejak](https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-create-and-update-a-trail.html) + [CloudTrail layanan dan integrasi yang didukung](https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-aws-service-specific-topics.html) + [Mengonfigurasi notifikasi Amazon SNS untuk CloudTrail](https://docs.aws.amazon.com/awscloudtrail/latest/userguide/configure-sns-notifications-for-cloudtrail.html) + [Menerima file CloudTrail log dari beberapa wilayah](https://docs.aws.amazon.com/awscloudtrail/latest/userguide/receive-cloudtrail-log-files-from-multiple-regions.html) dan [Menerima file CloudTrail log dari beberapa akun](https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-receive-logs-from-multiple-accounts.html) Semua pemanggilan alat SageMaker Unified Studio MCP Server dan panggilan API ke AWS layanan selama eksekusi alat dicatat oleh. CloudTrail Misalnya, panggilan ke berbagai alat dan panggilan AWS layanan yang dibuat dari alat menghasilkan entri dalam file CloudTrail log. Setiap entri peristiwa atau log berisi informasi tentang entitas yang membuat permintaan tersebut. Informasi identitas membantu Anda menentukan hal berikut ini: + Apakah permintaan tersebut dibuat dengan kredensial root atau pengguna IAM. + Apakah permintaan tersebut dibuat dengan kredensial keamanan sementara untuk satu peran atau pengguna terfederasi. + Apakah permintaan itu dibuat oleh AWS layanan lain. Untuk informasi selengkapnya, lihat [Elemen userIdentity CloudTrail ](https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-event-reference-user-identity.html). ## Memahami entri file log Amazon SageMaker Unified Studio MCP Server Trail adalah konfigurasi yang memungkinkan pengiriman peristiwa sebagai file log ke bucket Amazon S3 yang Anda tentukan. CloudTrail file log berisi satu atau lebih entri log. Peristiwa mewakili permintaan tunggal dari sumber mana pun dan mencakup informasi tentang tindakan yang diminta, tanggal dan waktu tindakan, parameter permintaan, dan sebagainya. CloudTrail file log bukanlah jejak tumpukan yang diurutkan dari panggilan API publik, jadi file tersebut tidak muncul dalam urutan tertentu. Contoh berikut menunjukkan entri CloudTrail log yang menunjukkan `CallTool` tindakan. ``` { "eventVersion": "1.09", "userIdentity": { ... }, "eventTime": "...", "eventSource": "sagemaker-unified-studio-mcp.amazonaws.com", "eventName": "CallPrivilegedTool", "awsRegion": "us-east-1", "sourceIPAddress": "...", "userAgent": "...", "requestParameters": { "id": 1, "method": "tools/call", "params": { "name": "generate_spark_upgrade_plan", "arguments": "***", "_meta": { "progressToken": 1 } }, "jsonrpc": "2.0" }, "responseElements": { "result": { "content": "***", "structuredContent": "***", "isError": false }, "id": 1, "jsonrpc": "2.0" }, "requestID": "12345678-1234-1234-1234-123456789012", "eventID": "87654321-4321-4321-4321-210987654321", "readOnly": false, "eventType": "AwsMcpEvent", "managementEvent": true, "recipientAccountId": "123456789012", "eventCategory": "Management" } ``` Contoh berikut menunjukkan entri CloudTrail log yang menunjukkan `AddJobFlowSteps` tindakan dari Amazon SageMaker Unified Studio MCP selama pemanggilan alat pemutakhiran. ``` { "eventVersion": "1.11", "userIdentity": { "type": "AssumedRole", "principalId": "...", "arn": "...", "accountId": "123456789012", "accessKeyId": "...", "sessionContext": { ... }, "invokedBy": "sagemaker-unified-studio-mcp.amazonaws.com" }, "eventTime": "...", "eventSource": "elasticmapreduce.amazonaws.com", "eventName": "AddJobFlowSteps", "awsRegion": "us-east-1", "sourceIPAddress": "sagemaker-unified-studio-mcp.amazonaws.com", "userAgent": "sagemaker-unified-studio-mcp.amazonaws.com", "requestParameters": { "jobFlowId": "j-2PY4KXXXXXX63", "steps": [ ... ] }, "responseElements": { "stepIds": [ ... ] }, "requestID": "12345678-1234-1234-1234-123456789013", "eventID": "87654321-4321-4321-4321-210987654322", "readOnly": false, "eventType": "AwsApiCall", "managementEvent": true, "recipientAccountId": "123456789012", "sharedEventID": "12345678-1234-1234-1234-123456789012", "vpcEndpointId": "sagemaker-unified-studio-mcp.amazonaws.com", "vpcEndpointAccountId": "sagemaker-unified-studio-mcp.amazonaws.com", "eventCategory": "Management" } ``` # Peningkatan layanan untuk Apache Spark Agents Agen Apache Spark untuk Amazon EMR dapat menggunakan konten, misalnya, untuk membantu Agen memberikan tanggapan yang lebih baik terhadap pertanyaan umum, memperbaiki masalah operasional, atau untuk debugging. ## Konten yang AWS dapat digunakan untuk peningkatan layanan + Bahasa alami Anda meminta dan menghasilkan tanggapan dari agen Apache Spark untuk Amazon EMR, dan Amazon Notebooks SageMaker ## Konten yang AWS tidak digunakan untuk peningkatan layanan + Kode yang Anda tulis sendiri untuk aplikasi Spark + SageMaker Konteks dan metadata notebook + Data dari Katalog Data Anda atau sumber data lainnya Hanya karyawan Amazon yang akan memiliki akses ke data. Kepercayaan, privasi, dan keamanan Konten Pelanggan Anda adalah prioritas utama kami dan memastikan bahwa penggunaan kami sesuai dengan komitmen kami kepada Anda. Untuk informasi selengkapnya, lihat FAQ Privasi Data. ## Cara memilih keluar Untuk memilih keluar dari pengumpulan data untuk Agen Spark Apache, konfigurasikan kebijakan opt-out layanan AI untuk Layanan MCP Amazon SageMaker Unified Studio. Untuk informasi selengkapnya, lihat [kebijakan opt-out layanan AI](https://docs.aws.amazon.com/organizations/latest/userguide/orgs_manage_policies_ai-opt-out.html) di *Panduan Pengguna AWS Organizations*. Saat Anda mengonfigurasi kebijakan opt-out layanan AI, kebijakan tersebut memiliki efek berikut: + AWS akan menghapus data yang dikumpulkan dan disimpan untuk perbaikan layanan sebelum Anda memilih keluar (jika ada). + Setelah Anda memilih keluar, tidak AWS akan lagi mengumpulkan atau menyimpan data ini. + AWS tidak akan lagi menggunakan konten Anda untuk peningkatan layanan. # Amazon EMR 7.x versi rilis Bagian ini berisi versi aplikasi, catatan rilis, versi komponen, dan klasifikasi konfigurasi yang tersedia di setiap versi rilis Amazon EMR 7.x. Saat meluncurkan klaster, Anda dapat memilih dari beberapa rilis Amazon EMR. Ini memungkinkan Anda untuk menguji dan menggunakan versi aplikasi yang sesuai dengan kebutuhan kompatibilitas Anda. Anda menentukan nomor rilis dengan *label rilis*. Label rilis ada dalam bentuk`emr-x.x.x`. Misalnya, `emr-7.12.0`. Rilis EMR Amazon baru tersedia di berbagai Wilayah selama beberapa hari, dimulai dengan Wilayah pertama pada tanggal rilis awal. Versi rilis terbaru mungkin tidak tersedia di Wilayah Anda selama periode ini. Untuk tabel lengkap versi aplikasi di setiap rilis Amazon EMR 7.x, lihat. [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) **Topics** + [ # Versi aplikasi di Amazon EMR 7.x rilis ](emr-release-app-versions-7.x.md) + [ # Amazon EMR rilis 7.12.0 ](emr-7120-release.md) + [ # Amazon EMR rilis 7.11.0 ](emr-7110-release.md) + [ # Amazon EMR rilis 7.10.0 ](emr-7100-release.md) + [ # Amazon EMR rilis 7.9.0 ](emr-790-release.md) + [ # Amazon EMR rilis 7.8.0 ](emr-780-release.md) + [ # Amazon EMR rilis 7.7.0 ](emr-770-release.md) + [ # Amazon EMR rilis 7.6.0 ](emr-760-release.md) + [ # Amazon EMR rilis 7.5.0 ](emr-750-release.md) + [ # Amazon EMR rilis 7.4.0 ](emr-740-release.md) + [ # Amazon EMR rilis 7.3.0 ](emr-730-release.md) + [ # Amazon EMR rilis 7.2.0 ](emr-720-release.md) + [ # Amazon EMR rilis 7.1.0 ](emr-710-release.md) + [ # Amazon EMR rilis 7.0.0 ](emr-700-release.md) # Versi aplikasi di Amazon EMR 7.x rilis Tabel berikut mencantumkan versi aplikasi yang tersedia di setiap rilis Amazon EMR 7.x. **Informasi versi aplikasi** | | emr-7.12.0 | emr-7.11.0 | emr-7.10.0 | emr-7.9.0 | emr-7.8.0 | emr-7.7.0 | emr-7.6.0 | emr-7.5.0 | emr-7.4.0 | emr-7.3.0 | emr-7.2.0 | emr-7.1.0 | emr-7.0.0 | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.35.5, 1.12.792 | 2.35.5, 1.12.792 | 2.31.48, 1.12.782 | 2.31.16, 1.12.782 | 2.29.52, 1.12.780 | 2.29.44, 1.12.780 | 2.29.25, 1.12.779 | 2.28.8, 1.12.772 | 2.28.8, 1.12.772 | 2.25.70, 1.12.747 | 2.23.18, 1.12.705 | 2.23.18, 1.12.656 | 2.20.160-amzn-0, 1.12.569 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9 | | Skala | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.17 | 2.12.17 | 2.12.17 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300031.1-amzn-0 | | Delta | 3.3.2-amzn-1 | 3.3.2-amzn-0 | 3.3.0-amzn-2 | 3.3.0-amzn-1 | 3.3.0-amzn-0 | 3.2.1-amzn-2 | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0 | 3.2.0-amzn-1 | 3.2.0-amzn-0 | 3.1.0 | 3.0.0 | 3.0.0 | | Flink | 1.20.0-amzn-6 | 1.20.0-amzn-5 | 1.20.0-amzn-4 | 1.20.0-amzn-3 | 1.20.0-amzn-2 | 1.20.0-amzn-1 | 1.20.0-amzn-0 | 1.19.1-amzn-1 | 1.19.1-amzn-0 | 1.18.1-amzn-2 | 1.18.1-amzn-1 | 1.18.1-amzn-0 | 1.18.0-amzn-0 | | Ganglia | - | - | - | - | - | - | - | - | - | - | - | - | - | | HBase | 2.6.2-amzn-3 | 2.6.2-amzn-2 | 2.6.2-amzn-1 | 2.6.2-amzn-0 | 2.6.1-amzn-2 | 2.6.1-amzn-1 | 2.6.1-amzn-0 | 2.5.10-amzn-0 | 2.5.5-amzn-0 | 2.4.17-amzn-7 | 2.4.17-amzn-6 | 2.4.17-amzn-5 | 2.4.17-amzn-4 | | HCatalog | 3.1.3-amzn-21 | 3.1.3-amzn-20 | 3.1.3-amzn-19 | 3.1.3-amzn-18 | 3.1.3-amzn-17 | 3.1.3-amzn-16 | 3.1.3-amzn-15 | 3.1.3-amzn-14 | 3.1.3-amzn-13 | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hadoop | 3.4.1-amzn-4 | 3.4.1-amzn-3 | 3.4.1-amzn-2 | 3.4.1-amzn-1 | 3.4.1-amzn-0 | 3.4.0-amzn-3 | 3.4.0-amzn-2 | 3.4.0-amzn-1 | 3.4.0-amzn-0 | 3.3.6-amzn-5 | 3.3.6-amzn-4 | 3.3.6-amzn-3 | 3.3.6-amzn-2 | | Hive | 3.1.3-amzn-21 | 3.1.3-amzn-20 | 3.1.3-amzn-19 | 3.1.3-amzn-18 | 3.1.3-amzn-17 | 3.1.3-amzn-16 | 3.1.3-amzn-15 | 3.1.3-amzn-14 | 3.1.3-amzn-13 | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hudi | 1.0.2-amzn-1 | 1.0.2-amzn-0 | 0.15.0-amzn-7 | 0.15.0-amzn-6 | 0.15.0-amzn-5 | 0.15.0-amzn-4 | 0.15.0-amzn-3 | 0.15.0-amzn-2 | 0.15.0-amzn-1 | 0.15.0-amzn-0 | 0.14.1-amzn-1 | 0.14.1-amzn-0 | 0.14.0-amzn-1 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.10.0-amzn-0 | 1.9.1-amzn-0 | 1.8.1-amzn-0 | 1.7.1-amzn-2 | 1.7.1-amzn-1 | 1.7.1-amzn-0 | 1.6.1-amzn-2 | 1.6.1-amzn-1 | 1.6.1-amzn-0 | 1.5.2-amzn-0 | 1.5.0-amzn-0 | 1.4.3-amzn-0 | 1.4.2-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.7.1-inkubasi | | MXNet | - | - | - | - | - | - | - | - | - | - | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | - | - | - | - | - | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.0 | 5.2.0 | 5.2.0 | 5.1.3 | 5.1.3 | 5.1.3 | 5.1.3 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,27-amzn-6 | 0,27-amzn-5 | 0,27-amzn-4 | 0,287-amzn-3 | 0,287-amzn-2 | 0,287-amzn-1 | 0,287-amzn-1 | 0,287-amzn-0 | 0,287-amzn-0 | 0.285-amzn-1 | 0,285-amzn-0 | 0,284-amzn-0 | 0,283-amzn-1 | | Spark | 3.5.6-amzn-1 | 3.5.6-amzn-0 | 3.5.5-amzn-1 | 3.5.5-amzn-0 | 3.5.4-amzn-0 | 3.5.3-amzn-1 | 3.5.3-amzn-0 | 3.5.2-amzn-1 | 3.5.2-amzn-0 | 3.5.1-amzn-1 | 3.5.1-amzn-0 | 3.5.0-amzn-1 | 3.5.0-amzn-0 | | Sqoop | - | - | - | - | - | - | - | - | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.19.0 | 2.19.0 | 2.18.0 | 2.16.1 | 2.16.1 | 2.16.1 | 2.16.1 | 2.16.1 | 2.16.1 | 2.16.1 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-19 | 0.10.2-amzn-18 | 0.10.2-amzn-17 | 0.10.2-amzn-16 | 0.10.2-amzn-15 | 0.10.2-amzn-14 | 0.10.2-amzn-13 | 0.10.2-amzn-12 | 0.10.2-amzn-11 | 0.10.2-amzn-10 | 0.10.2-amzn-9 | 0.10.2-amzn-8 | 0.10.2-amzn-7 | | Trino (PrestoSQL) | 476-amzn-1 | 475-amzn-0 | 470-amzn-0 | 467-amzn-2 | 467-amzn-1 | 467-amzn-0 | 457-amzn-0 | 446-amzn-0 | 446-amzn-0 | 442-amzn-0 | 436-amzn-0 | 435-amzn-0 | 426-amzn-1 | | Zeppelin | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.9.3-amzn-4 | 3.9.3-amzn-3 | 3.9.3-amzn-2 | 3.9.3-amzn-1 | 3.9.3-amzn-0 | 3.9.2-amzn-1 | 3.9.2-amzn-0 | 3.9.2-amzn-0 | 3.9.2-amzn-0 | 3.9.1-amzn-1 | 3.9.1-amzn-1 | 3.9.1-amzn-0 | 3.5.10 | # Amazon EMR rilis 7.12.0 ## 7.12.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.12.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | November 21, 2025 | | Dukungan standar sampai | November 21, 2027 | | Akhir dari dukungan | November 22, 2027 | | Akhir hidup | November 21, 2028 | ## 7.12.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.12.0 | emr-7.11.0 | emr-7.10.0 | emr-7.9.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.35.5, 1.12.792 | 2.35.5, 1.12.792 | 2.31.48, 1.12.782 | 2.31.16, 1.12.782 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | | Skala | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | | Delta | 3.3.2-amzn-1 | 3.3.2-amzn-0 | 3.3.0-amzn-2 | 3.3.0-amzn-1 | | Flink | 1.20.0-amzn-6 | 1.20.0-amzn-5 | 1.20.0-amzn-4 | 1.20.0-amzn-3 | | Ganglia | - | - | - | - | | HBase | 2.6.2-amzn-3 | 2.6.2-amzn-2 | 2.6.2-amzn-1 | 2.6.2-amzn-0 | | HCatalog | 3.1.3-amzn-21 | 3.1.3-amzn-20 | 3.1.3-amzn-19 | 3.1.3-amzn-18 | | Hadoop | 3.4.1-amzn-4 | 3.4.1-amzn-3 | 3.4.1-amzn-2 | 3.4.1-amzn-1 | | Hive | 3.1.3-amzn-21 | 3.1.3-amzn-20 | 3.1.3-amzn-19 | 3.1.3-amzn-18 | | Hudi | 1.0.2-amzn-1 | 1.0.2-amzn-0 | 0.15.0-amzn-7 | 0.15.0-amzn-6 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.10.0-amzn-0 | 1.9.1-amzn-0 | 1.8.1-amzn-0 | 1.7.1-amzn-2 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | | MXNet | - | - | - | - | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,27-amzn-6 | 0,27-amzn-5 | 0,27-amzn-4 | 0,287-amzn-3 | | Spark | 3.5.6-amzn-1 | 3.5.6-amzn-0 | 3.5.5-amzn-1 | 3.5.5-amzn-0 | | Sqoop | - | - | - | - | | TensorFlow | 2.19.0 | 2.19.0 | 2.18.0 | 2.16.1 | | Tez | 0.10.2-amzn-19 | 0.10.2-amzn-18 | 0.10.2-amzn-17 | 0.10.2-amzn-16 | | Trino (PrestoSQL) | 476-amzn-1 | 475-amzn-0 | 470-amzn-0 | 467-amzn-2 | | Zeppelin | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | | ZooKeeper | 3.9.3-amzn-4 | 3.9.3-amzn-3 | 3.9.3-amzn-2 | 3.9.3-amzn-1 | # 7.12.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi Amazon EMR 7.12.0 yang direkomendasikan. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 13 November 2025. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2016-5018 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2017-15095 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2017-17485 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2017-7525 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-10202 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10202)-2019-10202 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-37865 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2024-51504 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-51504 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-53990 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-53990)-2024-53990 | | CVE-2025-30065 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30065)-2025-30065 | | CVE-2025-30065 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30065)-2025-30065 | | CVE-2014-3643 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2014-3643)-2014-3643 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-10172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10172)-2019-10172 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-28052 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2021-0341 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-0341)-2021-0341 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-41404 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41404)-2022-41404 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-13009 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-13009)-2024-13009 | | CVE-2024-13009 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-13009)-2024-13009 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-36114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-47561 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-9823 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-9823)-2024-9823 | | CVE-2025-24970 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-24970 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-27553 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27553)-2025-27553 | | CVE-2025-27817 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27817)-2025-27817 | | CVE-2025-46762 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46762)-2025-46762 | | CVE-2025-46762 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46762)-2025-46762 | | CVE-2025-46762 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46762)-2025-46762 | | CVE-2025-48734 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48734)-2025-48734 | | CVE-2025-52434 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52434)-2025-52434 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-55163 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-55163)-2025-55163 | | CVE-2025-58056 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58056)-2025-58056 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-59250 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-59250)-2025-59250 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-11798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11798)-2018-11798 | | CVE-2018-1313 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1313)-2018-1313 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2020-13955 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13955)-2020-13955 | | CVE-2020-13956 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-1945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2020-1945](https://nvd.nist.gov/vuln/detail/CVE-2020-1945) | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-27568 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-27568)-2021-27568 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-29425 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-36373 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36373)-2021-36373 | | CVE-2021-36374 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36374)-2021-36374 | | CVE-2022-38749 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38749)-2022-38749 | | CVE-2022-38750 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38750)-2022-38750 | | CVE-2022-38751 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38751)-2022-38751 | | CVE-2022-38752 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38752)-2022-38752 | | CVE-2022-41854 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41854)-2022-41854 | | CVE-2023-0833 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-0833)-2023-0833 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-42503 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-42503)-2023-42503 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-23944 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-23945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23953 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-23953 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-29025 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29025)-2024-29025 | | CVE-2024-29869 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-29869 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-31141 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-31141)-2024-31141 | | CVE-2024-47535 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-56128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56128)-2024-56128 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-8184 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2025-11226 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-11226)-2025-11226 | | CVE-2025-11226 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-11226)-2025-11226 | | CVE-2025-11226 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-11226)-2025-11226 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-30474 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30474)-2025-30474 | | CVE-2025-3588 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-3588)-2025-3588 | | CVE-2025-46392 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46392)-2025-46392 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-53864 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-53864)-2025-53864 | | CVE-2025-58457 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58457)-2025-58457 | | CVE-2025-58457 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58457)-2025-58457 | | CVE-2025-59419 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-59419](https://nvd.nist.gov/vuln/detail/CVE-2025-59419) | | CVE-2025-59419 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-59419](https://nvd.nist.gov/vuln/detail/CVE-2025-59419) | | CVE-2025-8885 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-8885)-2025-8885 | | CVE-2025-8885 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-8885)-2025-8885 | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2025-46551 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46551)-2025-46551 | ## Catatan terbitan 7.12.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.12.0. + **Fitur baru** + **Penyimpanan tanpa server untuk EMR Tanpa Server - Amazon EMR tanpa server** memperkenalkan penyimpanan tanpa server, dengan rilis EMR 7.12 dan yang lebih baru, yang menghilangkan penyediaan disk lokal untuk beban kerja Apache Spark. EMR Serverless secara otomatis menangani operasi data perantara seperti shuffle tanpa biaya penyimpanan. Penyimpanan tanpa server memisahkan penyimpanan dari komputasi, memungkinkan Spark untuk segera melepaskan pekerja saat idle daripada membuat mereka tetap aktif untuk menyimpan data sementara. Untuk mempelajari selengkapnya, lihat [aws.amazon.com/serverless-storage-for-emr-serverless](aws.amazon.com/serverless-storage-for-emr-serverless). + **Peningkatan aplikasi - Peningkatan aplikasi** Amazon EMR 7.12.0 termasuk Delta 3.3.2-amzn-1, Flink 1.20.0-amzn-6, 2.6.2-amzn-3, 3.1.3-amzn-21, Hadoop 3.4.1-amzn-4, Hive 3.1.3-amzn-21, Hudi 1.0.2-amzn-1, Iceberg 1.10.0-amzn-0, Presto 0.287-amzn-6 HBase , Spark 3.5.6-amzn-1, Tez 0.10.2-amzn-19, Trino 476-amzn-1 HCatalog , dan 3.9.3-amzn-4. ZooKeeper + **Iceberg Materialized Views** - Memulai Amazon EMR 7.12.0, Amazon EMR Spark mendukung pembuatan dan pengelolaan Iceberg Materialized Views (MV) + **Akses Tabel Lengkap Hudi** - Memulai Amazon EMR 7.12.0, Amazon EMR sekarang mendukung kontrol Akses Tabel Penuh (FTA) untuk Apache Hudi di Apache Spark berdasarkan kebijakan Anda yang ditentukan dalam Lake Formation. Fitur ini memungkinkan operasi baca dan tulis dari pekerjaan Amazon EMR Spark Anda di tabel terdaftar Lake Formation saat peran pekerjaan memiliki akses tabel penuh. + **Peningkatan versi Iceberg** - Amazon EMR 7.12.0 mendukung Apache Iceberg versi 1.10 + **Spark dukungan FGAC asli menggunakan Lake Formation** - Anda dapat melakukan DDL/DML operasi (seperti CREATE, ALTER, DELETE, DROP) dengan kontrol akses berbutir halus untuk tabel Apache Hive, Apache Iceberg, dan Delta Lake yang terdaftar di Lake Formation. + **Konteks audit untuk pekerjaan Spark - Memulai Amazon EMR 7.12.0, konteks** audit untuk pekerjaan Amazon EMR Spark dengan kluster yang diaktifkan Lake Formation akan tersedia untuk panggilan Glue dan Lake Formation API di AWS log. CloudTrail + Amazon EMR 7.12.0 meningkatkan proses otentikasi kredensi GetClusterSessionCredentials sesi, secara signifikan mengurangi latensi untuk Sesi Interaktif Livy dan akses UI on-cluster pada kluster yang mendukung IAM Identity Center dibandingkan dengan rilis EMR Amazon sebelumnya. + Mulai Amazon EMR 7.12.0, Amazon HBase EMR di S3 telah menambahkan fitur prewarm baca-replika untuk menyederhanakan peningkatan versi Amazon EMR. Fitur ini dapat digunakan untuk meng-upgrade HBase cluster yang ada ke dan dari Amazon EMR versi 7.12\$1 + **Masalah dan keterbatasan yang diketahui** + **Athena SQL kompatibilitas** + Athena SQL tidak dapat membaca tabel Iceberg tipe V3 yang dibuat oleh Amazon EMR Spark karena kesalahan berikut: GENERIC\$1INTERNAL\$1ERROR: Tidak dapat membaca versi 3 yang tidak didukung. + Menulis data menggunakan Amazon EMR Spark ke dalam tabel gunung es yang dibuat menggunakan Athena gagal karena kesalahan berikut: Properti 'write.object-storage.path' telah usang dan akan dihapus di 2.0, gunakan 'write.data.path' sebagai gantinya. + **Iceberg Materialized Views (MV) - Amazon** EMR 7.12.0 memiliki dukungan terbatas untuk klausa tampilan SQL untuk pembuatan tampilan terwujud, penulisan ulang kueri, dan penyegaran tambahan. Rincian lebih lanjut dapat ditemukan di halaman dokumentasi fitur Iceberg Materialized Views + **Hudi FTA menulis** require using HoodieCredentialedHadoopStorage for credential vending selama eksekusi pekerjaan. Atur konfigurasi berikut saat menjalankan pekerjaan Hudi: + `hoodie.storage.class=org.apache.spark.sql.hudi.storage.HoodieCredentialedHadoopStorage` + Dukungan penulisan Hudi FTA hanya berfungsi dengan konfigurasi Hudi default. Pengaturan Hudi khusus atau non-default mungkin tidak sepenuhnya didukung dan dapat mengakibatkan perilaku yang tidak terduga. Pengelompokan untuk tabel Hudi Merge-On-Read (MOR) juga tidak didukung dalam mode tulis FTA. + **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Mulai EMR 7.12.0, EMR mendukung KMS Key ARN untuk log percikan yang dihosting layanan melalui server riwayat percikan yang persisten. Versi EMR sebelumnya hanya mendukung KeyID. + Mulai EMR 7.12.0, EMR telah mengatasi masalah dengan Hue yang mencegah penggunaan sertifikat SSL saat menghosting Hue di Cluster EMR. ## 7.12.0 versi Java default Amazon EMR rilis 7.12.0 dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.12.0. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 17, 11, 8 | | Pig | 17, 11, 8 | | Zookeeper | 17, 11, 8 | ## 7.12.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.3.2-amzn-1 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.21.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.25.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.18.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.42.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.21.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.6 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.73.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.20.0-amzn-6 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.20.0-amzn-6 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.4.1-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.4.1-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.4.1-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.4.1-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-zkfc | 3.4.1-amzn-4 | Layanan ZKFC untuk melacak namenodes untuk mode HA. | | hadoop-hdfs-journalnode | 3.4.1-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.4.1-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.4.1-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.4.1-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.4.1-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.4.1-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.4.1-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.6.2-amzn-3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.6.2-amzn-3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.6.2-amzn-3 | HBase klien baris perintah. | | hbase-rest-server | 2.6.2-amzn-3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.6.2-amzn-3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.6.2-amzn-3 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-21 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-21 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-21 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-21 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-21 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-21 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-21 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 1.0.2-amzn-1 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 1.0.2-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 1.0.2-amzn-1 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 1.0.2-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.10.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.5.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.2.1 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,27-amzn-6 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,27-amzn-6 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,27-amzn-6 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 476-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 476-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 476-amzn-1 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.6-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 3.5.6-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.6-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.6-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 25.08.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | tensorflow | 2.19.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-19 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-19 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.3-amzn-4 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.3-amzn-4 | ZooKeeper klien baris perintah. | ## 7.12.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.12.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j2 | Ubah nilai dalam file HBase hbase-log4j2.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j2 | Ubah nilai dalam file log4j2.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | cloudwatch-logs | Konfigurasikan integrasi CloudWatch Log untuk node cluster EMR. | Not available. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.12.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.12.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-11-21 | Publikasi Docs | Amazon EMR 7.12.0 catatan rilis pertama kali diterbitkan | # Amazon EMR rilis 7.11.0 ## 7.11.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.11.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | November 03, 2025 | | Dukungan standar sampai | November 03, 2027 | | Akhir dari dukungan | November 04, 2027 | | Akhir hidup | November 03, 2028 | ## 7.11.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.11.0 | emr-7.10.0 | emr-7.9.0 | emr-7.8.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.35.5, 1.12.792 | 2.31.48, 1.12.782 | 2.31.16, 1.12.782 | 2.29.52, 1.12.780 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | | Skala | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | | Delta | 3.3.2-amzn-0 | 3.3.0-amzn-2 | 3.3.0-amzn-1 | 3.3.0-amzn-0 | | Flink | 1.20.0-amzn-5 | 1.20.0-amzn-4 | 1.20.0-amzn-3 | 1.20.0-amzn-2 | | Ganglia | - | - | - | - | | HBase | 2.6.2-amzn-2 | 2.6.2-amzn-1 | 2.6.2-amzn-0 | 2.6.1-amzn-2 | | HCatalog | 3.1.3-amzn-20 | 3.1.3-amzn-19 | 3.1.3-amzn-18 | 3.1.3-amzn-17 | | Hadoop | 3.4.1-amzn-3 | 3.4.1-amzn-2 | 3.4.1-amzn-1 | 3.4.1-amzn-0 | | Hive | 3.1.3-amzn-20 | 3.1.3-amzn-19 | 3.1.3-amzn-18 | 3.1.3-amzn-17 | | Hudi | 1.0.2-amzn-0 | 0.15.0-amzn-7 | 0.15.0-amzn-6 | 0.15.0-amzn-5 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.9.1-amzn-0 | 1.8.1-amzn-0 | 1.7.1-amzn-2 | 1.7.1-amzn-1 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | | MXNet | - | - | - | - | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,27-amzn-5 | 0,27-amzn-4 | 0,287-amzn-3 | 0,287-amzn-2 | | Spark | 3.5.6-amzn-0 | 3.5.5-amzn-1 | 3.5.5-amzn-0 | 3.5.4-amzn-0 | | Sqoop | - | - | - | - | | TensorFlow | 2.19.0 | 2.18.0 | 2.16.1 | 2.16.1 | | Tez | 0.10.2-amzn-18 | 0.10.2-amzn-17 | 0.10.2-amzn-16 | 0.10.2-amzn-15 | | Trino (PrestoSQL) | 475-amzn-0 | 470-amzn-0 | 467-amzn-2 | 467-amzn-1 | | Zeppelin | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | | ZooKeeper | 3.9.3-amzn-3 | 3.9.3-amzn-2 | 3.9.3-amzn-1 | 3.9.3-amzn-0 | # 7.11.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi yang direkomendasikan Amazon EMR 7.11.0. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 18 November 2025. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2016-5018 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2017-15095 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2017-17485 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2017-7525 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-10202 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10202)-2019-10202 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-37865 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2024-51504 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-51504 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-53990 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-53990)-2024-53990 | | CVE-2025-30065 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30065)-2025-30065 | | CVE-2014-3643 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2014-3643)-2014-3643 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-10172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10172)-2019-10172 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-28052 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2021-0341 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-0341)-2021-0341 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-41404 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41404)-2022-41404 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-13009 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-13009)-2024-13009 | | CVE-2024-13009 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-13009)-2024-13009 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-36114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-9823 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-9823)-2024-9823 | | CVE-2025-24970 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-24970 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-27553 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27553)-2025-27553 | | CVE-2025-27817 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27817)-2025-27817 | | CVE-2025-46762 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46762)-2025-46762 | | CVE-2025-46762 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46762)-2025-46762 | | CVE-2025-48734 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48734)-2025-48734 | | CVE-2025-52434 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52434)-2025-52434 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-55163 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-55163)-2025-55163 | | CVE-2025-55163 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-55163)-2025-55163 | | CVE-2025-55163 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-55163)-2025-55163 | | CVE-2025-58056 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58056)-2025-58056 | | CVE-2025-58056 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58056)-2025-58056 | | CVE-2025-58056 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58056)-2025-58056 | | CVE-2025-58056 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58056)-2025-58056 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-59250 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-59250)-2025-59250 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-11798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11798)-2018-11798 | | CVE-2018-1313 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1313)-2018-1313 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2020-13955 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13955)-2020-13955 | | CVE-2020-13956 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-1945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2020-1945](https://nvd.nist.gov/vuln/detail/CVE-2020-1945) | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-27568 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-27568)-2021-27568 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-29425 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-36373 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36373)-2021-36373 | | CVE-2021-36374 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36374)-2021-36374 | | CVE-2022-38749 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38749)-2022-38749 | | CVE-2022-38750 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38750)-2022-38750 | | CVE-2022-38751 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38751)-2022-38751 | | CVE-2022-38752 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38752)-2022-38752 | | CVE-2022-41854 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41854)-2022-41854 | | CVE-2023-0833 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-0833)-2023-0833 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-42503 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-42503)-2023-42503 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-23944 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-23945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23953 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-23953 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-29025 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29025)-2024-29025 | | CVE-2024-29869 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-29869 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-31141 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-31141)-2024-31141 | | CVE-2024-47535 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-56128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56128)-2024-56128 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-8184 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2025-11226 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-11226)-2025-11226 | | CVE-2025-11226 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-11226)-2025-11226 | | CVE-2025-11226 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-11226)-2025-11226 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-30474 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30474)-2025-30474 | | CVE-2025-3588 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-3588)-2025-3588 | | CVE-2025-46392 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46392)-2025-46392 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-53864 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-53864)-2025-53864 | | CVE-2025-58457 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58457)-2025-58457 | | CVE-2025-58457 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58457)-2025-58457 | | CVE-2025-59419 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-59419](https://nvd.nist.gov/vuln/detail/CVE-2025-59419) | | CVE-2025-8885 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-8885)-2025-8885 | | CVE-2025-8885 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-8885)-2025-8885 | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2025-46551 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46551)-2025-46551 | ## Catatan terbitan 7.11.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.11.0. + **Fitur baru** + **Peningkatan aplikasi - Peningkatan aplikasi** Amazon EMR 7.11.0 termasuk Delta 3.3.2-amzn-0, Flink 1.20.0-amzn-5, 2.6.2-amzn-2, 3.1.3-amzn-20, Hadoop 3.4.1-amzn-3, Hive 3.1.3-amzn-20, Hudi 1.0.2-amzn-0, Iceberg 1.9.1-amzn-0, Presto 0.287-amzn-5 HBase , Spark 3.5.6-amzn-0, 2.19.0, Tez 0.10.2-amzn-18 HCatalog , Trino 475-amzn-0, dan 3.9.3-amzn-3. TensorFlow ZooKeeper + Amazon EMR di EC2 sekarang mendukung Sesi Latar Belakang Pengguna Pusat Identitas IAM + **Sesi Latar Belakang Pengguna**: Memungkinkan beban kerja Spark yang berjalan lama untuk terus berjalan bahkan setelah pengguna log off dari SageMaker Unified Studio, mendukung sesi hingga 90 hari + **Konfigurasi Sesi Latar Belakang Fleksibel**: Konfigurasi dua tingkat (instans Pusat Identitas IAM dan cluster Amazon EMR-EC2) dengan durasi sesi latar belakang yang dapat disesuaikan dari 15 menit hingga 90 hari (default: 7 hari) + **Propagasi Identitas Tepercaya**: Mempertahankan konteks identitas aman sepanjang siklus hidup sesi latar belakang menggunakan fitur propagasi identitas tepercaya Amazon EMR + **SageMaker Integrasi Studio Terpadu**: Sesi latar belakang dimulai melalui sesi interaktif Livy di Unified Studio SageMaker + **Sesi jangka panjang dengan identitas perusahaan** - Amazon SageMaker Unified Studio kini mendukung sesi jangka panjang dengan identitas perusahaan melalui Propagasi Identitas Tepercaya (TIP) IAM Identity Center. Pengguna dapat meluncurkan notebook interaktif dan sesi pemrosesan data di Amazon EMR dan AWS Glue yang bertahan menggunakan kredensyal perusahaan, bahkan ketika log off atau sesi kedaluwarsa. Sesi berjalan hingga 90 hari (default 7 hari) sambil mempertahankan izin identitas dan kontrol keamanan yang konsisten. ## 7.11.0 versi Java default Amazon EMR rilis 7.11.0 dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.11.0. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 17, 11, 8 | | Pig | 17, 11, 8 | | Zookeeper | 17, 11, 8 | ## 7.11.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.3.2-amzn-0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.20.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.24.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.18.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.41.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.20.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.5 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.72.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.20.0-amzn-5 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.20.0-amzn-5 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.4.1-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.4.1-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.4.1-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.4.1-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-zkfc | 3.4.1-amzn-3 | Layanan ZKFC untuk melacak namenodes untuk mode HA. | | hadoop-hdfs-journalnode | 3.4.1-amzn-3 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.4.1-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.4.1-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.4.1-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.4.1-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.4.1-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.4.1-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.6.2-amzn-2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.6.2-amzn-2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.6.2-amzn-2 | HBase klien baris perintah. | | hbase-rest-server | 2.6.2-amzn-2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.6.2-amzn-2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.6.2-amzn-2 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-20 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-20 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-20 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-20 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-20 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-20 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-20 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 1.0.2-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 1.0.2-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 1.0.2-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 1.0.2-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.9.1-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.5.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.2.1 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,27-amzn-5 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,27-amzn-5 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,27-amzn-5 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 475-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 475-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 475-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.6-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.5.6-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.6-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.6-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 25.06.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | tensorflow | 2.19.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-18 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-18 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.3-amzn-3 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.3-amzn-3 | ZooKeeper klien baris perintah. | ## 7.11.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.11.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j2 | Ubah nilai dalam file HBase hbase-log4j2.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j2 | Ubah nilai dalam file log4j2.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | cloudwatch-logs | Konfigurasikan integrasi CloudWatch Log untuk node cluster EMR. | Not available. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.11.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.11.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-11-12 | Publikasi Docs | Amazon EMR 7.11.0 catatan rilis pertama kali diterbitkan | # Amazon EMR rilis 7.10.0 ## 7.10.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.10.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | Agustus 15, 2025 | | Dukungan standar sampai | Agustus 15, 2027 | | Akhir dari dukungan | Agustus 16, 2027 | | Akhir hidup | Agustus 15, 2028 | ## 7.10.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.10.0 | emr-7.9.0 | emr-7.8.0 | emr-7.7.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.31.48, 1.12.782 | 2.31.16, 1.12.782 | 2.29.52, 1.12.780 | 2.29.44, 1.12.780 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | | Skala | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | | Delta | 3.3.0-amzn-2 | 3.3.0-amzn-1 | 3.3.0-amzn-0 | 3.2.1-amzn-2 | | Flink | 1.20.0-amzn-4 | 1.20.0-amzn-3 | 1.20.0-amzn-2 | 1.20.0-amzn-1 | | Ganglia | - | - | - | - | | HBase | 2.6.2-amzn-1 | 2.6.2-amzn-0 | 2.6.1-amzn-2 | 2.6.1-amzn-1 | | HCatalog | 3.1.3-amzn-19 | 3.1.3-amzn-18 | 3.1.3-amzn-17 | 3.1.3-amzn-16 | | Hadoop | 3.4.1-amzn-2 | 3.4.1-amzn-1 | 3.4.1-amzn-0 | 3.4.0-amzn-3 | | Hive | 3.1.3-amzn-19 | 3.1.3-amzn-18 | 3.1.3-amzn-17 | 3.1.3-amzn-16 | | Hudi | 0.15.0-amzn-7 | 0.15.0-amzn-6 | 0.15.0-amzn-5 | 0.15.0-amzn-4 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.8.1-amzn-0 | 1.7.1-amzn-2 | 1.7.1-amzn-1 | 1.7.1-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | | MXNet | - | - | - | - | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,27-amzn-4 | 0,27-amzn-3 | 0,287-amzn-2 | 0,287-amzn-1 | | Spark | 3.5.5-amzn-1 | 3.5.5-amzn-0 | 3.5.4-amzn-0 | 3.5.3-amzn-1 | | Sqoop | - | - | - | - | | TensorFlow | 2.18.0 | 2.16.1 | 2.16.1 | 2.16.1 | | Tez | 0.10.2-amzn-17 | 0.10.2-amzn-16 | 0.10.2-amzn-15 | 0.10.2-amzn-14 | | Trino (PrestoSQL) | 470-amzn-0 | 467-amzn-2 | 467-amzn-1 | 467-amzn-0 | | Zeppelin | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | | ZooKeeper | 3.9.3-amzn-2 | 3.9.3-amzn-1 | 3.9.3-amzn-0 | 3.9.2-amzn-1 | # 7.10.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi yang direkomendasikan Amazon EMR 7.10.0. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 25 September 2025. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2016-5018 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2017-15095 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2017-17485 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2017-7525 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-10202 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10202)-2019-10202 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-37865 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-42889 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42889)-2022-42889 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2024-51504 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-51504 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-52577 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52577)-2024-52577 | | CVE-2024-53990 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-53990)-2024-53990 | | CVE-2024-56325 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56325)-2024-56325 | | CVE-2025-30065 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30065)-2025-30065 | | CVE-2014-3643 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2014-3643)-2014-3643 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-10172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10172)-2019-10172 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-28052 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-41404 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41404)-2022-41404 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-13009 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-13009)-2024-13009 | | CVE-2024-13009 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-13009)-2024-13009 | | CVE-2024-29131 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29131)-2024-29131 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-36114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-36114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-47561 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-57699 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-57699)-2024-57699 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-9823 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-9823)-2024-9823 | | CVE-2025-1948 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-1948)-2025-1948 | | CVE-2025-24970 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-24970 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-27553 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27553)-2025-27553 | | CVE-2025-27817 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27817)-2025-27817 | | CVE-2025-27817 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27817)-2025-27817 | | CVE-2025-27817 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27817)-2025-27817 | | CVE-2025-27820 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27820)-2025-27820 | | CVE-2025-27820 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27820)-2025-27820 | | CVE-2025-30706 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30706)-2025-30706 | | CVE-2025-30706 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30706)-2025-30706 | | CVE-2025-46762 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46762)-2025-46762 | | CVE-2025-48734 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48734)-2025-48734 | | CVE-2025-48734 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48734)-2025-48734 | | CVE-2025-49146 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49146)-2025-49146 | | CVE-2025-5115 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-5115)-2025-5115 | | CVE-2025-52434 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52434)-2025-52434 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-52999 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-52999)-2025-52999 | | CVE-2025-55163 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-55163)-2025-55163 | | CVE-2025-55163 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-55163)-2025-55163 | | CVE-2025-58056 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58056)-2025-58056 | | CVE-2025-58056 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58056)-2025-58056 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2025-58057 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58057)-2025-58057 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-11798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11798)-2018-11798 | | CVE-2018-1313 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1313)-2018-1313 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2020-13955 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13955)-2020-13955 | | CVE-2020-13956 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-1945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2020-1945](https://nvd.nist.gov/vuln/detail/CVE-2020-1945) | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-27568 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-27568)-2021-27568 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-29425 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-36373 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36373)-2021-36373 | | CVE-2021-36374 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36374)-2021-36374 | | CVE-2022-38749 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38749)-2022-38749 | | CVE-2022-38750 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38750)-2022-38750 | | CVE-2022-38751 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38751)-2022-38751 | | CVE-2022-38752 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38752)-2022-38752 | | CVE-2022-41854 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41854)-2022-41854 | | CVE-2023-0833 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-0833)-2023-0833 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-42503 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-42503)-2023-42503 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-23944 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-23945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23953 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-23953 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-29025 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29025)-2024-29025 | | CVE-2024-29133 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29133)-2024-29133 | | CVE-2024-29869 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-29869 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-31141 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-31141)-2024-31141 | | CVE-2024-47535 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-52980 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52980)-2024-52980 | | CVE-2024-56128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56128)-2024-56128 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-8184 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2025-22227 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-22227](https://nvd.nist.gov/vuln/detail/CVE-2025-22227) | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-30474 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30474)-2025-30474 | | CVE-2025-3588 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-3588)-2025-3588 | | CVE-2025-46392 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46392)-2025-46392 | | CVE-2025-46551 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46551)-2025-46551 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-48924 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-48924)-2025-48924 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-49128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-49128)-2025-49128 | | CVE-2025-53864 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-53864)-2025-53864 | | CVE-2025-53864 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-53864)-2025-53864 | | CVE-2025-58457 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58457)-2025-58457 | | CVE-2025-58457 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58457)-2025-58457 | | CVE-2025-58457 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-58457)-2025-58457 | | CVE-2025-8885 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-8885)-2025-8885 | | CVE-2025-8885 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-8885)-2025-8885 | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2025-8916 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2025-8916](https://nvd.nist.gov/vuln/detail/CVE-2025-8916) | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2025-27496 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27496)-2025-27496 | ## Catatan terbitan 7.10.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 7.10.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.10.0 application upgrades include AWS SDK for Java 2.31.48/1.12.782, Delta 3.3.0-amzn-2, Hadoop 3.4.1-amzn-2, Hudi 0.15.0-amzn-7, Iceberg 1.8.1-amzn-0, Spark 3.5.5-amzn-1, and Zookeeper 3.9.3-amzn-2. + Sistem **file S3A - Mulai dari rilis EMR 7.10.0, sistem** file S3A telah menggantikan EMRFS sebagai konektor EMR S3 default. Untuk informasi selengkapnya, lihat [Panduan Migrasi: Sistem File EMRFS ke S3A](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-s3a-migrate.html). + **Dukungan streaming Spark Kafka** - Mulai dari rilis EMR 7.10.0, dependensi aws-msk-iam-auth 2.3.2 dan commons-pool2 2.11.1 disertakan untuk beban kerja streaming Spark dengan sumber data Kafka. Ini JARs tersedia ketika aplikasi Spark dipilih pada peluncuran cluster. + **Konektor streaming Flink** - Mulai dari rilis EMR 7.10.0 flink-sql-connector-kafka, 3.4.0, 5.0.0, aws-msk-iam-auth dan 2.3.2 flink-sql-connector-kinesis disertakan untuk beban kerja streaming Flink dengan sumber data Kafka dan Kinesis. Konektor ini JARs tersedia ketika aplikasi Flink dipilih pada peluncuran cluster. **Masalah yang diketahui** + **Status DITERIMA** - Aplikasi YARN macet Dalam Status DITERIMA karena bug sumber terbuka [YARN-11834](https://issues.apache.org/jira/browse/YARN-11834). Hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **ConcurrentModificationException pengecualian** [- YARN sering memulai ulang dengan ConcurrentModificationException pengecualian karena bug sumber terbuka YARN-11838.](https://issues.apache.org/jira/browse/YARN-11838) Hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **Log aplikasi YARN** - log aplikasi YARN tidak terlihat melalui UI Manajer Sumber Daya. Untuk memperbaiki masalah ini, ikuti langkah-langkah berikut: 1. Perbarui `yarn.log.server.url` konfigurasi di yarn-site.xml ke nilai berikut: ``` yarn.log.server.url https://:19890/jobhistory/logs ``` 1. Mulai ulang layanan pengelola sumber daya hadoop: `systemctl restart hadoop-resourcemanager.service` + **Mengunggah log langkah** — Beberapa cluster mungkin tidak dapat mengunggah log langkah ke bucket S3 Anda karena kondisi balapan. Hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **HBase pembuatan tabel di katalog Hive with Glue** - Dari EMR-7.3.0 hingga EMR-7.10.0, ada bug karena integrasi Hive Iceberg, yang menyebabkan HBase pembuatan tabel di Hive gagal saat Glue Data Catalog digunakan sebagai metastore. Silakan hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **Tez UI** - Dari EMR-7.3 ke EMR-7.10, ada bug di mana mengakses UI Tez melalui UI Web Manajer Sumber Daya YARN gagal saat enkripsi dalam transit diaktifkan. Ini terjadi karena proxy YARN mencoba menggunakan protokol HTTP sementara Tez UI memerlukan HTTPS. Harap ubah `tez.tez-ui.history-url.base` konfigurasi `tez-site` dari `http` ke `https` untuk menyelesaikan masalah ini. + Label rilis dan wilayah yang didukung. [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-7100-release.html) ## 7.10.0 versi Java default Amazon EMR merilis 7.10 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.10.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | JERAM Spark | 17, 11, 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 17, 11, 8 | | Pig | 17, 11, 8 | | Zookeeper | 17, 11, 8 | ## 7.10.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.3.0-amzn-2 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.19.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.23.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.18.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.40.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.19.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.4 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.71.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.20.0-amzn-4 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.20.0-amzn-4 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.4.1-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.4.1-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.4.1-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.4.1-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.4.1-amzn-2 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.4.1-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.4.1-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.4.1-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.4.1-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.4.1-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.4.1-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.6.2-amzn-1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.6.2-amzn-1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.6.2-amzn-1 | HBase klien baris perintah. | | hbase-rest-server | 2.6.2-amzn-1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.6.2-amzn-1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.6.2-amzn-1 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-19 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-19 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-19 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-19 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-19 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-19 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-19 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.15.0-amzn-7 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.15.0-amzn-7 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.15.0-amzn-7 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.15.0-amzn-7 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.8.1-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.5.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.2.1 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,27-amzn-4 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,27-amzn-4 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,27-amzn-4 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 470-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 470-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 470-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.5-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 3.5.5-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.5-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.5-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 3.5.5-amzn-1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | tensorflow | 2.18.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-17 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-17 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.3-amzn-2 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.3-amzn-2 | ZooKeeper klien baris perintah. | ## 7.10.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.10.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j2 | Ubah nilai dalam file HBase hbase-log4j2.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j2 | Ubah nilai dalam file log4j2.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.10.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.10.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-08-15 | Publikasi Docs | Amazon EMR 7.10.0 catatan rilis pertama kali diterbitkan | | 2025-08-15 | Penerapan selesai | [Amazon EMR 7.10.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2025-08-15 | Rilis terbatas awal | Amazon EMR 7.10.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.9.0 ## 7.9.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.9.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | 19 Mei 2025 | | Dukungan standar sampai | 19 Mei 2027 | | Akhir dari dukungan | 20 Mei 2027 | | Akhir hidup | 19 Mei 2028 | ## 7.9.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.9.0 | emr-7.8.0 | emr-7.7.0 | emr-7.6.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.31.16, 1.12.782 | 2.29.52, 1.12.780 | 2.29.44, 1.12.780 | 2.29.25, 1.12.779 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | | Skala | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | | Delta | 3.3.0-amzn-1 | 3.3.0-amzn-0 | 3.2.1-amzn-2 | Versi 3.2.1-amzn-1 | | Flink | 1.20.0-amzn-3 | 1.20.0-amzn-2 | 1.20.0-amzn-1 | 1.20.0-amzn-0 | | Ganglia | - | - | - | - | | HBase | 2.6.2-amzn-0 | 2.6.1-amzn-2 | 2.6.1-amzn-1 | 2.6.1-amzn-0 | | HCatalog | 3.1.3-amzn-18 | 3.1.3-amzn-17 | 3.1.3-amzn-16 | 3.1.3-amzn-15 | | Hadoop | 3.4.1-amzn-1 | 3.4.1-amzn-0 | 3.4.0-amzn-3 | 3.4.0-amzn-2 | | Hive | 3.1.3-amzn-18 | 3.1.3-amzn-17 | 3.1.3-amzn-16 | 3.1.3-amzn-15 | | Hudi | 0.15.0-amzn-6 | 0.15.0-amzn-5 | 0.15.0-amzn-4 | 0.15.0-amzn-3 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.7.1-amzn-2 | 1.7.1-amzn-1 | 1.7.1-amzn-0 | 1.6.1-amzn-2 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | | MXNet | - | - | - | - | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.0 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,27-amzn-3 | 0,287-amzn-2 | 0,287-amzn-1 | 0,287-amzn-1 | | Spark | 3.5.5-amzn-0 | 3.5.4-amzn-0 | 3.5.3-amzn-1 | 3.5.3-amzn-0 | | Sqoop | - | - | - | - | | TensorFlow | 2.16.1 | 2.16.1 | 2.16.1 | 2.16.1 | | Tez | 0.10.2-amzn-16 | 0.10.2-amzn-15 | 0.10.2-amzn-14 | 0.10.2-amzn-13 | | Trino (PrestoSQL) | 467-amzn-2 | 467-amzn-1 | 467-amzn-0 | 457-amzn-0 | | Zeppelin | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | | ZooKeeper | 3.9.3-amzn-1 | 3.9.3-amzn-0 | 3.9.2-amzn-1 | 3.9.2-amzn-0 | # 7.9.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi yang direkomendasikan Amazon EMR 7.9.0. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 12 Mei 2025. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2016-5018 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2017-15095 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2017-17485 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2017-7525 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-10202 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10202)-2019-10202 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-37865 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-42889 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42889)-2022-42889 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2024-51504 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-51504 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-52577 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52577)-2024-52577 | | CVE-2024-53990 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-53990)-2024-53990 | | CVE-2024-56325 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56325)-2024-56325 | | CVE-2025-30065 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30065)-2025-30065 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-10172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10172)-2019-10172 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-28052 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-13009 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-13009)-2024-13009 | | CVE-2024-13009 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-13009)-2024-13009 | | CVE-2024-29131 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29131)-2024-29131 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-36114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-36114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-47561 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-57699 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-57699)-2024-57699 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2025-1948 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-1948)-2025-1948 | | CVE-2025-1948 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-1948)-2025-1948 | | CVE-2025-24789 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24789)-2025-24789 | | CVE-2025-24970 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-24970 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-24970 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-27553 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27553)-2025-27553 | | CVE-2025-27820 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27820)-2025-27820 | | CVE-2025-27820 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27820)-2025-27820 | | CVE-2025-46762 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46762)-2025-46762 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-11798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11798)-2018-11798 | | CVE-2018-1313 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1313)-2018-1313 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2020-13955 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13955)-2020-13955 | | CVE-2020-13956 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-1945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2020-1945](https://nvd.nist.gov/vuln/detail/CVE-2020-1945) | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22570 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-22570 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-27568 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-27568)-2021-27568 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-29425 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-36373 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36373)-2021-36373 | | CVE-2021-36374 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36374)-2021-36374 | | CVE-2022-38749 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38749)-2022-38749 | | CVE-2022-38750 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38750)-2022-38750 | | CVE-2022-38751 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38751)-2022-38751 | | CVE-2022-38752 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38752)-2022-38752 | | CVE-2022-41854 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41854)-2022-41854 | | CVE-2023-0833 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-0833)-2023-0833 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-42503 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-42503)-2023-42503 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-23944 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-23945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23953 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-23953 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-29025 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29025)-2024-29025 | | CVE-2024-29133 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29133)-2024-29133 | | CVE-2024-29869 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-29869 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-31141 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-31141)-2024-31141 | | CVE-2024-43382 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-43382)-2024-43382 | | CVE-2024-47535 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-52980 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52980)-2024-52980 | | CVE-2024-56128 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56128)-2024-56128 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-8184 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2024-9823 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-9823)-2024-9823 | | CVE-2025-24790 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24790)-2025-24790 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-30474 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-30474)-2025-30474 | | CVE-2025-3588 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-3588)-2025-3588 | | CVE-2025-46551 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46551)-2025-46551 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2025-27496 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-27496)-2025-27496 | | CVE-2025-46392 | TIDAK DIPERTARUHAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-46392)-2025-46392 | ## Catatan rilis 7.9.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.9.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.9.0 application upgrades include AWS SDK for Java 2.31.16/1.12.782, Delta 3.3.0-amzn-1, Hadoop 3.4.1, Hudi 0.15.0-amzn-6, Iceberg 1.7.1-amzn-2, Spark 3.5.5, and Zookeeper 3.9.3. + **Dukungan CM-CMK untuk Persistent App UI** — Fitur ini memperluas enkripsi SSE yang diterapkan ke log yang dikelola dalam bucket layanan EMR untuk menghormati Customer Managed Custom Master Key (CM-CMK). Fitur ini memungkinkan pelanggan untuk mengelola aksesibilitas log setelah cluster mereka berakhir. **Masalah yang diketahui** + Ketika opsi logging untuk EMR pada EC2 dinonaktifkan, log tidak tersedia setelah cluster berakhir dan aplikasi persisten tidak UIs akan berisi log apa pun. + **Enkripsi KMS menggunakan SecretAgent komponen EMR-EC2** — Ada kesalahan yang terjadi ketika enkripsi KMS saat istirahat diaktifkan untuk cluster yang mendukung Lake Formation di EMR versi 7.8 dan 7.9. Pekerjaan yang mendukung Lake Formation akan gagal dengan a. *NoSuchMethodError* Ada dua solusi yang tersedia: + Nonaktifkan sementara enkripsi KMS saat istirahat untuk cluster yang terpengaruh. + Hubungi AWS Support untuk meminta artefak Bootstrap Action jika enkripsi KMS harus dipertahankan. **catatan** **Perbaikan permanen** - Pada Agustus 2025 pembaruan untuk mengatasi masalah di atas telah diterapkan ke semua wilayah. Tidak perlu menonaktifkan enkripsi KMS saat istirahat. + **Mengunggah log langkah** — Beberapa cluster mungkin tidak dapat mengunggah log langkah ke bucket S3 Anda karena kondisi balapan. Hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **HBase pembuatan tabel di katalog Hive with Glue** - Dari EMR-7.3.0 hingga EMR-7.10.0, ada bug karena integrasi Hive Iceberg, yang menyebabkan HBase pembuatan tabel di Hive gagal saat Glue Data Catalog digunakan sebagai metastore. Silakan hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **Tez UI** - Dari EMR-7.3 ke EMR-7.10, ada bug di mana mengakses UI Tez melalui UI Web Manajer Sumber Daya YARN gagal saat enkripsi dalam transit diaktifkan. Ini terjadi karena proxy YARN mencoba menggunakan protokol HTTP sementara Tez UI memerlukan HTTPS. Harap ubah `tez.tez-ui.history-url.base` konfigurasi `tez-site` dari `http` ke `https` untuk menyelesaikan masalah ini. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + *Oozie penghentian* - Karena OSS Oozie telah masuk ke mode loteng, Apache Oozie akan dihapus dari Amazon EMR rilis 8.x seri. Oozie masih akan dimasukkan sebagai bagian dari seri 7.x. Kami menyarankan Anda menggunakan MWAA sebagai alternatif untuk Oozie. Pelanggan dapat merujuk ke [oozie-to-airflow-emr](https://github.com/dgghosalaws/oozie-to-airflow-emr)utilitas untuk GitHub memigrasikan alur kerja Oozie yang ada ke MWAA. + *Pengepakan tempat sampah kontainer YARN* - Dimulai dengan Amazon EMR versi 7.9.0, kebijakan pengepakan tempat sampah kontainer sekarang tersedia untuk penjadwal kapasitas YARN, yang dibangun di atas kebijakan penempatan multi-node YARN. + *hudi-cli.sh* - Skrip **hudi-cli.sh** telah usang dalam rilis EMR 7.9.0 dan yang lebih tinggi. **Amazon EMR rilis 7.9.0 dan yang lebih tinggi menggunakan.jar. hudi-cli-bundle** + *Cluster EMR pada AMI yang mendukung FIPS AL2023 —* [Mulai dari EMR 7.9, pelanggan dapat meluncurkan cluster EMR pada AMI yang mendukung FIPS. AL2023 ](https://docs.aws.amazon.com/linux/al2023/ug/fips-mode.html) Perubahan ini memperbarui tanda tangan digital EMR dan algoritma hash untuk memastikan semua paket EMR mematuhi kebijakan kriptografi yang direkomendasikan untuk FIPS 140-3. Catatan: Ini tidak mencakup status sertifikasi FIPS EMR AL2023 atau - lihat FAQ FIPS [AL2023 untuk informasi terbaru tentang status validasi FIPS](https://aws.amazon.com/linux/amazon-linux-2023/faqs/) 140-3. + *Latensi langkah* - Rilis ini menyelesaikan masalah di mana latensi langkah meningkat saat menggunakan enkripsi dalam transit tanpa secara eksplisit memilih aplikasi Hadoop untuk instalasi. + *Peluncuran cluster dengan volume terenkripsi EBS* - Rilis ini memperbaiki masalah di mana panggilan KMS pada volume terenkripsi EBS dapat menyebabkan peluncuran cluster EMR gagal. + [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-790-release.html) ## 7.9.0 versi Java default Amazon EMR merilis 7.9 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.9.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 17, 11, 8 | | Pig | 17, 11, 8 | | Zookeeper | 17, 11, 8 | ## 7.9.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.3.0-amzn-1 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.18.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.22.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.18.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.39.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.18.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.4 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.70.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.20.0-amzn-3 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.20.0-amzn-3 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.4.1-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.4.1-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.4.1-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.4.1-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.4.1-amzn-1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.4.1-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.4.1-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.4.1-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.4.1-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.4.1-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.4.1-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.6.2-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.6.2-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.6.2-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.6.2-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.6.2-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.6.2-amzn-0 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-18 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-18 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-18 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-18 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-18 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-18 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-18 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.15.0-amzn-6 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.15.0-amzn-6 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.15.0-amzn-6 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.15.0-amzn-6 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.7.1-amzn-2 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.3.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.2.1 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,27-amzn-3 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,27-amzn-3 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,27-amzn-3 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 467-amzn-2 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 467-amzn-2 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 467-amzn-2 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.5-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.5.5-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.5-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.5-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 25.02.1-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | tensorflow | 2.16.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-16 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-16 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.3-amzn-1 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.3-amzn-1 | ZooKeeper klien baris perintah. | ## 7.9.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.9.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j2 | Ubah nilai dalam file HBase hbase-log4j2.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j2 | Ubah nilai dalam file log4j2.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.9.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.9.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-05-19 | Publikasi Docs | Amazon EMR 7.9.0 catatan rilis pertama kali diterbitkan | | 2025-05-19 | Penerapan selesai | [Amazon EMR 7.9.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2025-05-19 | Rilis terbatas awal | Amazon EMR 7.9.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.8.0 ## 7.8.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.8.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | 7 Maret 2025 | | Dukungan standar sampai | 6 Maret 2027 | | Akhir dari dukungan | 7 Maret 2027 | | Akhir hidup | 7 Maret 2028 | ## 7.8.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.8.0 | emr-7.7.0 | emr-7.6.0 | emr-7.5.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.29.52, 1.12.780 | 2.29.44, 1.12.780 | 2.29.25, 1.12.779 | 2.28.8, 1.12.772 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | | Skala | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | | Delta | 3.3.0-amzn-0 | 3.2.1-amzn-2 | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0 | | Flink | 1.20.0-amzn-2 | 1.20.0-amzn-1 | 1.20.0-amzn-0 | 1.19.1-amzn-1 | | Ganglia | - | - | - | - | | HBase | 2.6.1-amzn-2 | 2.6.1-amzn-1 | 2.6.1-amzn-0 | 2.5.10-amzn-0 | | HCatalog | 3.1.3-amzn-17 | 3.1.3-amzn-16 | 3.1.3-amzn-15 | 3.1.3-amzn-14 | | Hadoop | 3.4.1-amzn-0 | 3.4.0-amzn-3 | 3.4.0-amzn-2 | 3.4.0-amzn-1 | | Hive | 3.1.3-amzn-17 | 3.1.3-amzn-16 | 3.1.3-amzn-15 | 3.1.3-amzn-14 | | Hudi | 0.15.0-amzn-5 | 0.15.0-amzn-4 | 0.15.0-amzn-3 | 0.15.0-amzn-2 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.7.1-amzn-1 | 1.7.1-amzn-0 | 1.6.1-amzn-2 | 1.6.1-amzn-1 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | | MXNet | - | - | - | - | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.1 | 5.2.1 | 5.2.0 | 5.2.0 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,287-amzn-2 | 0,287-amzn-1 | 0,287-amzn-1 | 0,287-amzn-0 | | Spark | 3.5.4-amzn-0 | 3.5.3-amzn-1 | 3.5.3-amzn-0 | 3.5.2-amzn-1 | | Sqoop | - | - | - | - | | TensorFlow | 2.16.1 | 2.16.1 | 2.16.1 | 2.16.1 | | Tez | 0.10.2-amzn-15 | 0.10.2-amzn-14 | 0.10.2-amzn-13 | 0.10.2-amzn-12 | | Trino (PrestoSQL) | 467-amzn-1 | 467-amzn-0 | 457-amzn-0 | 446-amzn-0 | | Zeppelin | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | | ZooKeeper | 3.9.3-amzn-0 | 3.9.2-amzn-1 | 3.9.2-amzn-0 | 3.9.2-amzn-0 | # 7.8.0 rincian komponen rilis Lihat tabel berikut untuk informasi selengkapnya tentang paket *Ekstra* di Amazon EMR 7.7.0. | Aplikasi | Jenis Aplikasi | Paket | Jenis Package | Versi Package | | --- | --- | --- | --- | --- | | AmazonCloudWatchAgent | Core | hadoop-hdfs-journalnode | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | AmazonCloudWatchAgent | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | s3-dist-cp | Ekstra | 2.38.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | penjaga kebun binatang | Ekstra | 3.9.3-amzn-0-1.amzn2023 | | AmazonCloudWatchAgent | Core | zookeper-server | Ekstra | 3.9.3-amzn-0-1.amzn2023 | | Flink | Core | hadop-client | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-hdfs | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-hdfs-datanode | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-hdfs-journalnode | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-hdfs-namenode | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-httpfs | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-km | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-mapreduce | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-benang | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-yarn-nodemanager | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-yarn-resourcemanager | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hadoop-yarn-timelineserver | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Flink | Core | hudi | Ekstra | 0.15.0-amzn-5-1.amzn2023 | | Flink | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Flink | Core | hadoop | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | HBase | Core | s3-dist-cp | Ekstra | 2.38.0-1.amzn2023 | | HCatalog | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | HCatalog | Core | mariadb-connector-java | Ekstra | | | Hive | Core | hadoop-httpfs | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Hive | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Hive | Core | hive-hbase | Ekstra | 3.1.3-amzn-17-1.amzn2023 | | Hive | Core | mariadb-connector-java | Ekstra | 3.1.3-amzn-17-1 | | Hive | Core | s3-dist-cp | Ekstra | 2.38.0-1.amzn2023 | | Phoenix | Core | s3-dist-cp | Ekstra | 2.38.0-1.amzn2023 | | Spark | Core | spark-datanucleus | Ekstra | 3.5.3.amzn.1-1.amzn2023 | | Tez | Core | hadoop-mapreduce | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Tez | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Tez | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.1-amzn-0-1.amzn2023 | | Trino | Core | utilitas besar | Ekstra | 1.2.0-1.amzn2023 | | Trino | Core | hadop-client | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-hdfs | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-hdfs-datanode | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-hdfs-journalnode | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-hdfs-namenode | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-km | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-mapreduce | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-benang | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-yarn-nodemanager | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-yarn-resourcemanager | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-yarn-timelineserver | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hive | Ekstra | 3.1.3.amzn.17-1.amzn2023 | | Trino | Core | hive-hcatalog-server | Ekstra | 3.1.3.amzn.17-1.amzn2023 | | Trino | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Trino | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Trino | Core | penjaga kebun binatang | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Trino | Core | zookeper-server | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Trino | Core | bigtop-groovy | Ekstra | 2.5.4-1.amzn2023 | | Trino | Core | bigtop-jsvc | Ekstra | 1.2.4-1.amzn2023 | | Trino | Core | hadoop | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Trino | Core | hadoop-lzo | Ekstra | 0.4.19-1.amzn2023 | | Trino | Core | hive-hcatalog | Ekstra | 3.1.3.amzn.17-1.amzn2023 | | Trino | Core | sarang-jdbc | Ekstra | 3.1.3.amzn.17-1.amzn2023 | | Zookeeper | Core | emrfs | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Zookeeper | Core | hadop-client | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-datanode | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-journalnode | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-namenode | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-httpfs | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-km | Ekstra | 3.9.3.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-benang | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-nodemanager | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-resourcemanager | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-timelineserver | Ekstra | 3.4.1.amzn.0-1.amzn2023 | | Zookeeper | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | # 7.8.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi yang direkomendasikan Amazon EMR 7.8.0. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 6 Maret 2025. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2016-5018 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2017-15095 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2017-17485 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2017-7525 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-10202 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10202)-2019-10202 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-37865 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-42889 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42889)-2022-42889 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-53990 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-53990)-2024-53990 | | CVE-2024-53990 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-53990)-2024-53990 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-10172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10172)-2019-10172 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13936 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13936)-2020-13936 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-28052 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-20883 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20883)-2023-20883 | | CVE-2023-25194 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-25194)-2023-25194 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-34455 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-11798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11798)-2018-11798 | | CVE-2018-1313 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1313)-2018-1313 | | CVE-2019-10219 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2019-10219](https://nvd.nist.gov/vuln/detail/CVE-2019-10219) | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2020-10693 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10693)-2020-10693 | | CVE-2020-13955 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13955)-2020-13955 | | CVE-2020-13956 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-1945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2020-1945](https://nvd.nist.gov/vuln/detail/CVE-2020-1945) | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-29582 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-29582)-2020-29582 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22570 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-22570 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-27568 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-27568)-2021-27568 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-29425 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-36373 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36373)-2021-36373 | | CVE-2021-36374 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36374)-2021-36374 | | CVE-2021-38153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-38153)-2021-38153 | | CVE-2022-24329 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2022-24329](https://nvd.nist.gov/vuln/detail/CVE-2022-24329) | | CVE-2022-38749 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38749)-2022-38749 | | CVE-2022-38750 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38750)-2022-38750 | | CVE-2022-38751 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38751)-2022-38751 | | CVE-2022-38752 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38752)-2022-38752 | | CVE-2022-41854 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41854)-2022-41854 | | CVE-2023-0833 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-0833)-2023-0833 | | CVE-2023-20863 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20863)-2023-20863 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-42503 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-42503)-2023-42503 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-38820 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38820)-2024-38820 | | CVE-2024-38820 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38820)-2024-38820 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-8184 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | GHSA-CHFM-68VV-PVW5 | RENDAH | [https://nvd.nist. gov/vuln/detail/GHSA-chfm-68vv-pvw5](https://nvd.nist.gov/vuln/detail/GHSA-chfm-68vv-pvw5) | | CVE-2024-23454 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23454)-2024-23454 | | CVE-2024-23944 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-23945 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23945 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23953 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-23953 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-27137 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-27137)-2024-27137 | | CVE-2024-29025 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29025)-2024-29025 | | CVE-2024-29131 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29131)-2024-29131 | | CVE-2024-29133 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29133)-2024-29133 | | CVE-2024-29857 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29869 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-29869 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-30171 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30172 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-30172 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-31141 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-31141)-2024-31141 | | CVE-2024-31141 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-31141)-2024-31141 | | CVE-2024-34447 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-34447 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-36114 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-36114 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-36114 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-36114 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-38808 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38808)-2024-38808 | | CVE-2024-47535 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-51504 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-51504 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-56128 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56128)-2024-56128 | | CVE-2024-56128 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56128)-2024-56128 | | CVE-2024-57699 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-57699)-2024-57699 | | CVE-2024-9823 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-9823)-2024-9823 | | CVE-2025-23015 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-23015)-2025-23015 | | CVE-2025-24860 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24860)-2025-24860 | | CVE-2025-24970 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-24970 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-24970 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-24970 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24970)-2025-24970 | | CVE-2025-25193 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | | CVE-2025-25193 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-25193)-2025-25193 | ## Catatan rilis 7.8.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.8.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.8.0 application upgrades include AWS SDK for Java 2.29.52/1.12.780, Delta 3.3.0-amzn-0, Hadoop 3.4.1, Hudi 0.15.0-amzn-5, Iceberg 1.7.1-amzn-1, Spark 3.5.4, and Zookeeper 3.9.3. **Masalah yang diketahui** + **Enkripsi KMS menggunakan SecretAgent komponen EMR-EC2** — Ada kesalahan yang terjadi ketika enkripsi KMS saat istirahat diaktifkan untuk cluster yang mendukung Lake Formation di EMR versi 7.8 dan 7.9. Pekerjaan yang mendukung Lake Formation akan gagal dengan a. *NoSuchMethodError* Ada dua solusi yang tersedia: + Nonaktifkan sementara enkripsi KMS saat istirahat untuk cluster yang terpengaruh. + Hubungi AWS Support untuk meminta artefak Bootstrap Action jika enkripsi KMS harus dipertahankan. **catatan** **Perbaiki pembaruan** - Pada Agustus 2025 pembaruan untuk mengatasi masalah di atas telah diterapkan ke semua wilayah. Tidak perlu menonaktifkan enkripsi KMS saat istirahat. + **HBase pembuatan tabel di katalog Hive with Glue** - Dari EMR-7.3.0 hingga EMR-7.10.0, ada bug karena integrasi Hive Iceberg, yang menyebabkan HBase pembuatan tabel di Hive gagal saat Glue Data Catalog digunakan sebagai metastore. Silakan hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **Tez UI** - Dari EMR-7.3 ke EMR-7.10, ada bug di mana mengakses UI Tez melalui UI Web Manajer Sumber Daya YARN gagal saat enkripsi dalam transit diaktifkan. Ini terjadi karena proxy YARN mencoba menggunakan protokol HTTP sementara Tez UI memerlukan HTTPS. Harap ubah `tez.tez-ui.history-url.base` konfigurasi `tez-site` dari `http` ke `https` untuk menyelesaikan masalah ini. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-780-release.html) ## 7.8.0 versi Java default Amazon EMR merilis 7.8 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.8.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 17, 11, 8 | | Pig | 17, 11, 8 | | Zookeeper | 17, 11, 8 | ## 7.8.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.3.0-amzn-0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.17.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.21.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.18.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.38.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.17.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.3 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.69.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.20.0-amzn-2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.20.0-amzn-2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.4.1-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.4.1-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.4.1-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.4.1-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.4.1-amzn-0 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.4.1-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.4.1-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.4.1-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.4.1-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.4.1-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.4.1-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.6.1-amzn-2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.6.1-amzn-2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.6.1-amzn-2 | HBase klien baris perintah. | | hbase-rest-server | 2.6.1-amzn-2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.6.1-amzn-2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.6.1-amzn-2 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-17 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-17 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-17 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-17 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-17 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-17 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-17 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.15.0-amzn-5 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.15.0-amzn-5 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.15.0-amzn-5 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.15.0-amzn-5 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.7.1-amzn-1 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.3.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.2.1 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,287-amzn-2 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,287-amzn-2 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,287-amzn-2 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 467-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 467-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 467-amzn-1 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.4-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.5.4-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.4-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.4-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 24.12.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | tensorflow | 2.16.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-15 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-15 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.3-amzn-0 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.3-amzn-0 | ZooKeeper klien baris perintah. | ## 7.8.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.8.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j2 | Ubah nilai dalam file log4j2.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.8.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.8.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-03-07 | Publikasi Docs | Amazon EMR 7.8.0 catatan rilis pertama kali diterbitkan | | 2025-03-06 | Penerapan selesai | [Amazon EMR 7.8.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2025-02-28 | Rilis terbatas awal | Amazon EMR 7.8.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.7.0 ## 7.7.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.7.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | Februari 6, 2025 | | Dukungan standar sampai | Februari 5, 2027 | | Akhir dari dukungan | Februari 6, 2027 | | Akhir hidup | Februari 6, 2028 | ## 7.7.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.7.0 | emr-7.6.0 | emr-7.5.0 | emr-7.4.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.29.44, 1.12.780 | 2.29.25, 1.12.779 | 2.28.8, 1.12.772 | 2.28.8, 1.12.772 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | | Skala | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | | Delta | 3.2.1-amzn-2 | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0 | 3.2.0-amzn-1 | | Flink | 1.20.0-amzn-1 | 1.20.0-amzn-0 | 1.19.1-amzn-1 | 1.19.1-amzn-0 | | Ganglia | - | - | - | - | | HBase | 2.6.1-amzn-1 | 2.6.1-amzn-0 | 2.5.10-amzn-0 | 2.5.5-amzn-0 | | HCatalog | 3.1.3-amzn-16 | 3.1.3-amzn-15 | 3.1.3-amzn-14 | 3.1.3-amzn-13 | | Hadoop | 3.4.0-amzn-3 | 3.4.0-amzn-2 | 3.4.0-amzn-1 | 3.4.0-amzn-0 | | Hive | 3.1.3-amzn-16 | 3.1.3-amzn-15 | 3.1.3-amzn-14 | 3.1.3-amzn-13 | | Hudi | 0.15.0-amzn-4 | 0.15.0-amzn-3 | 0.15.0-amzn-2 | 0.15.0-amzn-1 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.7.1-amzn-0 | 1.6.1-amzn-2 | 1.6.1-amzn-1 | 1.6.1-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | | MXNet | - | - | - | - | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.1 | 5.2.0 | 5.2.0 | 5.2.0 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,287-amzn-1 | 0,287-amzn-1 | 0,287-amzn-0 | 0,287-amzn-0 | | Spark | 3.5.3-amzn-1 | 3.5.3-amzn-0 | 3.5.2-amzn-1 | 3.5.2-amzn-0 | | Sqoop | - | - | - | 1.4.7 | | TensorFlow | 2.16.1 | 2.16.1 | 2.16.1 | 2.16.1 | | Tez | 0.10.2-amzn-14 | 0.10.2-amzn-13 | 0.10.2-amzn-12 | 0.10.2-amzn-11 | | Trino (PrestoSQL) | 467-amzn-0 | 457-amzn-0 | 446-amzn-0 | 446-amzn-0 | | Zeppelin | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | | ZooKeeper | 3.9.2-amzn-1 | 3.9.2-amzn-0 | 3.9.2-amzn-0 | 3.9.2-amzn-0 | # 7.7.0 rincian komponen rilis Lihat tabel berikut untuk informasi selengkapnya tentang paket *Ekstra* di Amazon EMR 7.7.0. | Aplikasi | Jenis Aplikasi | Paket | Jenis Package | Versi Package | | --- | --- | --- | --- | --- | | AmazonCloudWatchAgent | Core | hadoop-hdfs-journalnode | Ekstra | 3.4.0-amzn-3-1.amzn2023 | | AmazonCloudWatchAgent | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | s3-dist-cp | Ekstra | 2.37.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | penjaga kebun binatang | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | AmazonCloudWatchAgent | Core | zookeper-server | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Flink | Core | hadop-client | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-hdfs | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-hdfs-datanode | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-hdfs-journalnode | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-hdfs-namenode | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-httpfs | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-km | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-mapreduce | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-benang | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-yarn-nodemanager | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-yarn-resourcemanager | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hadoop-yarn-timelineserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Flink | Core | hudi | Ekstra | 0.15.0.amzn.4-1.amzn2023 | | Flink | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Flink | Core | hadoop | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | HBase | Core | s3-dist-cp | Ekstra | 2.37.0-1.amzn2023 | | HCatalog | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | HCatalog | Core | mariadb-connector-java | Ekstra | | | Hive | Core | hadoop-httpfs | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Hive | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Hive | Core | hive-hbase | Ekstra | 3.1.3.amzn.16-1.amzn2023 | | Hive | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Hive | Core | s3-dist-cp | Ekstra | 2.37.0-1.amzn2023 | | Phoenix | Core | s3-dist-cp | Ekstra | 2.37.0-1.amzn2023 | | Spark | Core | spark-datanucleus | Ekstra | 3.5.3.amzn.1-1.amzn2023 | | Tez | Core | hadoop-mapreduce | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Tez | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Tez | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | utilitas besar | Ekstra | 1.2.0-1.amzn2023 | | Trino | Core | hadop-client | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-hdfs | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-hdfs-datanode | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-hdfs-journalnode | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-hdfs-namenode | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-km | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-mapreduce | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-benang | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-yarn-nodemanager | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-yarn-resourcemanager | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-yarn-timelineserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hive | Ekstra | 3.1.3.amzn.16-1.amzn2023 | | Trino | Core | hive-hcatalog-server | Ekstra | 3.1.3.amzn.16-1.amzn2023 | | Trino | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Trino | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Trino | Core | penjaga kebun binatang | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Trino | Core | zookeper-server | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Trino | Core | bigtop-groovy | Ekstra | 2.5.4-1.amzn2023 | | Trino | Core | bigtop-jsvc | Ekstra | 1.2.4-1.amzn2023 | | Trino | Core | hadoop | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Trino | Core | hadoop-lzo | Ekstra | 0.4.19-1.amzn2023 | | Trino | Core | hive-hcatalog | Ekstra | 3.1.3.amzn.16-1.amzn2023 | | Trino | Core | sarang-jdbc | Ekstra | 3.1.3.amzn.16-1.amzn2023 | | Zookeeper | Core | emrfs | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Zookeeper | Core | hadop-client | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-datanode | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-journalnode | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-namenode | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Zookeeper | Core | hadoop-httpfs | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Zookeeper | Core | hadoop-km | Ekstra | 3.9.2.amzn.1-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Zookeeper | Core | hadoop-benang | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-nodemanager | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-resourcemanager | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-timelineserver | Ekstra | 3.4.0.amzn.3-1.amzn2023 | | Zookeeper | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | # 7.7.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi Amazon EMR 7.7.0 yang direkomendasikan. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 4 Februari 2025. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2016-5018 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2017-15095 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2017-17485 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2017-7525 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-10202 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10202)-2019-10202 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-37865 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-42889 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42889)-2022-42889 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-53990 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-53990)-2024-53990 | | CVE-2024-53990 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-53990)-2024-53990 | | CVE-2012-0881 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-0881)-2012-0881 | | CVE-2013-4002 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2013-4002)-2013-4002 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-10172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10172)-2019-10172 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13936 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13936)-2020-13936 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-28052 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-43859 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-43859)-2021-43859 | | CVE-2022-1415 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1415)-2022-1415 | | CVE-2022-1415 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1415)-2022-1415 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40151 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40151)-2022-40151 | | CVE-2022-40152 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40152)-2022-40152 | | CVE-2022-41966 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41966)-2022-41966 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45688 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45688)-2022-45688 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-20883 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20883)-2023-20883 | | CVE-2023-25194 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-25194)-2023-25194 | | CVE-2023-25194 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-25194)-2023-25194 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-34455 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-36478 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-36478)-2023-36478 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-50387 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-50387)-2023-50387 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-52428 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-52428)-2023-52428 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-21634 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-21634)-2024-21634 | | CVE-2024-35178 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-35178)-2024-35178 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2009-2625 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2009-2625)-2009-2625 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2017-10355 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-10355)-2017-10355 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-11798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11798)-2018-11798 | | CVE-2018-1313 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1313)-2018-1313 | | CVE-2018-2799 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-2799)-2018-2799 | | CVE-2019-10219 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2019-10219](https://nvd.nist.gov/vuln/detail/CVE-2019-10219) | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2020-10693 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10693)-2020-10693 | | CVE-2020-13955 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13955)-2020-13955 | | CVE-2020-13956 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-13956 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-14338 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14338)-2020-14338 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-1945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2020-1945](https://nvd.nist.gov/vuln/detail/CVE-2020-1945) | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-29582 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-29582)-2020-29582 | | CVE-2021-21290 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21290)-2021-21290 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22570 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-22570 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-22570 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-27568 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-27568)-2021-27568 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-29425 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-29425 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-36373 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36373)-2021-36373 | | CVE-2021-36374 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36374)-2021-36374 | | CVE-2021-37533 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37533)-2021-37533 | | CVE-2021-38153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-38153)-2021-38153 | | CVE-2022-23437 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-23437)-2022-23437 | | CVE-2022-24329 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2022-24329](https://nvd.nist.gov/vuln/detail/CVE-2022-24329) | | CVE-2022-38749 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38749)-2022-38749 | | CVE-2022-38750 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38750)-2022-38750 | | CVE-2022-38751 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38751)-2022-38751 | | CVE-2022-38752 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38752)-2022-38752 | | CVE-2022-41854 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41854)-2022-41854 | | CVE-2023-0833 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-0833)-2023-0833 | | CVE-2023-20863 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20863)-2023-20863 | | CVE-2023-26048 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-26048)-2023-26048 | | CVE-2023-26049 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-26049)-2023-26049 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-39968 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39968)-2023-39968 | | CVE-2023-40167 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-40167)-2023-40167 | | CVE-2023-40170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-40170)-2023-40170 | | CVE-2023-42503 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-42503)-2023-42503 | | CVE-2023-49080 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-49080)-2023-49080 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-38820 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38820)-2024-38820 | | CVE-2024-38820 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38820)-2024-38820 | | CVE-2024-43805 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-43805)-2024-43805 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-8184 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2024-8184 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2022-2047 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-2047)-2022-2047 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | GHSA-58QW-P7QM-5RVH | RENDAH | [https://nvd.nist. gov/vuln/detail/GHSA-58qw-p7qm-5rvh](https://nvd.nist.gov/vuln/detail/GHSA-58qw-p7qm-5rvh) | | GHSA-CHFM-68VV-PVW5 | RENDAH | [https://nvd.nist. gov/vuln/detail/GHSA-chfm-68vv-pvw5](https://nvd.nist.gov/vuln/detail/GHSA-chfm-68vv-pvw5) | | CVE-2023-50868 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-50868)-2023-50868 | | CVE-2024-23454 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23454)-2024-23454 | | CVE-2024-23454 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23454)-2024-23454 | | CVE-2024-23944 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-23944 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-23944 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-23945 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-23953 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23953)-2024-23953 | | CVE-2024-25638 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25638)-2024-25638 | | CVE-2024-27137 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-27137)-2024-27137 | | CVE-2024-29025 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29025)-2024-29025 | | CVE-2024-29131 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29131)-2024-29131 | | CVE-2024-29131 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29131)-2024-29131 | | CVE-2024-29133 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29133)-2024-29133 | | CVE-2024-29133 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29133)-2024-29133 | | CVE-2024-29857 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29857 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-29869 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29869)-2024-29869 | | CVE-2024-30171 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30171 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30172 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-30172 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-31141 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-31141)-2024-31141 | | CVE-2024-31141 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-31141)-2024-31141 | | CVE-2024-34447 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-34447 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-36114 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-36114 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-36114 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-36114 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-38808 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38808)-2024-38808 | | CVE-2024-43382 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-43382)-2024-43382 | | CVE-2024-47072 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47072)-2024-47072 | | CVE-2024-47535 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47535 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-51504 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-51504 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-51504 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-56128 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56128)-2024-56128 | | CVE-2024-56128 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56128)-2024-56128 | | CVE-2024-9823 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-9823)-2024-9823 | | CVE-2025-23015 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-23015)-2025-23015 | | CVE-2025-24789 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24789)-2025-24789 | | CVE-2025-24790 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24790)-2025-24790 | | CVE-2025-24860 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2025-24860)-2025-24860 | ## Catatan rilis 7.7.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.7.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.7.0 application upgrades include Delta 3.2.1-amzn-2, Hudi 0.15.0-amzn-4, Iceberg 1.7.1-amzn-0, and Trino 467. **Masalah yang diketahui** + **HBase pembuatan tabel di katalog Hive with Glue** - Dari EMR-7.3.0 hingga EMR-7.10.0, ada bug karena integrasi Hive Iceberg, yang menyebabkan HBase pembuatan tabel di Hive gagal saat Glue Data Catalog digunakan sebagai metastore. Silakan hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **Tez UI** - Dari EMR-7.3 ke EMR-7.10, ada bug di mana mengakses UI Tez melalui UI Web Manajer Sumber Daya YARN gagal saat enkripsi dalam transit diaktifkan. Ini terjadi karena proxy YARN mencoba menggunakan protokol HTTP sementara Tez UI memerlukan HTTPS. Harap ubah `tez.tez-ui.history-url.base` konfigurasi `tez-site` dari `http` ke `https` untuk menyelesaikan masalah ini. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Versi Iceberg yang digunakan pada EMR 7.7.0 tidak lagi mendukung Java 8. Selain itu, Iceberg dikecualikan dari gambar Java 8 berikut: `emr-7.7.0-java8-latest` dan. `emr-7.7.0-spark-rapids-java8-latest` + Lake Formation untuk FGAC dengan Amazon EMR di EKS — Dengan Amazon EMR rilis 7.7 dan lebih tinggi, Anda dapat memanfaatkan AWS Lake Formation untuk menerapkan kontrol akses berbutir halus pada tabel Katalog Data yang didukung oleh Amazon S3. Kemampuan ini memungkinkan Anda mengonfigurasi tabel, baris, kolom, dan kontrol akses tingkat sel untuk kueri baca dalam EMR Amazon Amazon Anda di EKS Spark Jobs. Untuk informasi selengkapnya, lihat [Menggunakan Amazon Amazon EMR di EKS dengan AWS Lake Formation untuk kontrol akses berbutir halus](https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/security_iam_fgac-lf.html). + [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-770-release.html) ## 7.7.0 versi Java default Amazon EMR merilis 7.7 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.7.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 17, 11, 8 | | Pig | 17, 11, 8 | | Zookeeper | 17, 11, 8 | ## 7.7.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.2.1-amzn-2 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.16.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.20.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.18.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.37.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.16.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.2 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.68.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.20.0-amzn-1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.20.0-amzn-1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.4.0-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.4.0-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.4.0-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.4.0-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.4.0-amzn-3 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.4.0-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.4.0-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.4.0-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.4.0-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.4.0-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.4.0-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.6.1-amzn-1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.6.1-amzn-1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.6.1-amzn-1 | HBase klien baris perintah. | | hbase-rest-server | 2.6.1-amzn-1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.6.1-amzn-1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.6.1-amzn-1 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-16 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-16 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-16 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-16 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-16 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-16 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-16 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.15.0-amzn-4 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.15.0-amzn-4 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.15.0-amzn-4 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.15.0-amzn-4 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.7.1-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.3.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.2.1 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,287-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,287-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,287-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 467-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 467-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 467-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.3-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 3.5.3-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.3-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.3-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 24.10.1-amzn-1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | tensorflow | 2.16.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-14 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-14 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.2-amzn-1 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.2-amzn-1 | ZooKeeper klien baris perintah. | ## 7.7.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.7.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j2 | Ubah nilai dalam file log4j2.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.7.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.7.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-02-07 | Publikasi Docs | Amazon EMR 7.7.0 catatan rilis pertama kali diterbitkan | | 2025-02-06 | Penerapan selesai | [Amazon EMR 7.7.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2025-01-30 | Rilis terbatas awal | Amazon EMR 7.7.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.6.0 ## 7.6.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.6.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | Januari 10, 2025 | | Dukungan standar sampai | Januari 09, 2027 | | Akhir dari dukungan | Januari 10, 2027 | | Akhir hidup | Januari 10, 2028 | ## 7.6.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.6.0 | emr-7.5.0 | emr-7.4.0 | emr-7.3.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.29.25, 1.12.779 | 2.28.8, 1.12.772 | 2.28.8, 1.12.772 | 2.25.70, 1.12.747 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | | Skala | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.18 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | | Delta | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0 | 3.2.0-amzn-1 | 3.2.0-amzn-0 | | Flink | 1.20.0-amzn-0 | 1.19.1-amzn-1 | 1.19.1-amzn-0 | 1.18.1-amzn-2 | | Ganglia | - | - | - | - | | HBase | 2.6.1-amzn-0 | 2.5.10-amzn-0 | 2.5.5-amzn-0 | 2.4.17-amzn-7 | | HCatalog | 3.1.3-amzn-15 | 3.1.3-amzn-14 | 3.1.3-amzn-13 | 3.1.3-amzn-12 | | Hadoop | 3.4.0-amzn-2 | 3.4.0-amzn-1 | 3.4.0-amzn-0 | 3.3.6-amzn-5 | | Hive | 3.1.3-amzn-15 | 3.1.3-amzn-14 | 3.1.3-amzn-13 | 3.1.3-amzn-12 | | Hudi | 0.15.0-amzn-3 | 0.15.0-amzn-2 | 0.15.0-amzn-1 | 0.15.0-amzn-0 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.6.1-amzn-2 | 1.6.1-amzn-1 | 1.6.1-amzn-0 | 1.5.2-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | | MXNet | - | - | - | - | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.0 | 5.2.0 | 5.2.0 | 5.1.3 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,287-amzn-1 | 0,287-amzn-0 | 0,287-amzn-0 | 0.285-amzn-1 | | Spark | 3.5.3-amzn-0 | 3.5.2-amzn-1 | 3.5.2-amzn-0 | 3.5.1-amzn-1 | | Sqoop | - | - | 1.4.7 | 1.4.7 | | TensorFlow | 2.16.1 | 2.16.1 | 2.16.1 | 2.16.1 | | Tez | 0.10.2-amzn-13 | 0.10.2-amzn-12 | 0.10.2-amzn-11 | 0.10.2-amzn-10 | | Trino (PrestoSQL) | 457-amzn-0 | 446-amzn-0 | 446-amzn-0 | 442-amzn-0 | | Zeppelin | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | | ZooKeeper | 3.9.2-amzn-0 | 3.9.2-amzn-0 | 3.9.2-amzn-0 | 3.9.1-amzn-1 | # Rincian komponen rilis 7.6.0 Lihat tabel berikut untuk informasi selengkapnya tentang paket *Ekstra* di Amazon EMR 7.6.0. | Aplikasi | Jenis Aplikasi | Paket | Jenis Package | Versi Package | | --- | --- | --- | --- | --- | | AmazonCloudWatchAgent | Core | hadoop-hdfs-journalnode | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | AmazonCloudWatchAgent | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | s3-dist-cp | Ekstra | 2.36.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | penjaga kebun binatang | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | zookeper-server | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Flink | Core | hadop-client | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-hdfs | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-hdfs-datanode | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-hdfs-journalnode | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-hdfs-namenode | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-httpfs | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-km | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-mapreduce | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-benang | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-yarn-nodemanager | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-yarn-resourcemanager | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hadoop-yarn-timelineserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Flink | Core | hudi | Ekstra | 0.15.0.amzn.3-1.amzn2023 | | Flink | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Flink | Core | hadoop | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | HBase | Core | s3-dist-cp | Ekstra | 2.36.0-1.amzn2023 | | HCatalog | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | HCatalog | Core | mariadb-connector-java | Ekstra | | | Hive | Core | hadoop-httpfs | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Hive | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Hive | Core | hive-hbase | Ekstra | 3.1.3.amzn.15-1.amzn2023 | | Hive | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Hive | Core | s3-dist-cp | Ekstra | 2.36.0-1.amzn2023 | | Phoenix | Core | s3-dist-cp | Ekstra | 2.36.0-1.amzn2023 | | Spark | Core | spark-datanucleus | Ekstra | 3.5.1.amzn.0-1.amzn2023 | | Tez | Core | hadoop-mapreduce | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Tez | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Tez | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | utilitas besar | Ekstra | 1.2.0-1.amzn2023 | | Trino | Core | hadop-client | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-hdfs | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-hdfs-datanode | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-hdfs-journalnode | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-hdfs-namenode | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-km | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-mapreduce | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-benang | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-yarn-nodemanager | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-yarn-resourcemanager | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-yarn-timelineserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hive | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | hive-hcatalog-server | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Trino | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Trino | Core | penjaga kebun binatang | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Trino | Core | zookeper-server | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Trino | Core | bigtop-groovy | Ekstra | 2.5.4-1.amzn2023 | | Trino | Core | bigtop-jsvc | Ekstra | 1.2.4-1.amzn2023 | | Trino | Core | hadoop | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Trino | Core | hadoop-lzo | Ekstra | 0.4.19-1.amzn2023 | | Trino | Core | hive-hcatalog | Ekstra | 3.1.3.amzn.15-1.amzn2023 | | Trino | Core | sarang-jdbc | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Zookeeper | Core | emrfs | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Zookeeper | Core | hadop-client | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-datanode | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-journalnode | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-namenode | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-httpfs | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-km | Ekstra | 3.9.2.amzn.0-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce-historyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Zookeeper | Core | hadoop-benang | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-nodemanager | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-proxyserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-resourcemanager | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-timelineserver | Ekstra | 3.4.0.amzn.2-1.amzn2023 | | Zookeeper | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | # 7.6.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi Amazon EMR 7.6.0 yang direkomendasikan. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 9 Januari 2025. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2013-7285 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2013-7285)-2013-7285 | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2016-5018 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2017-15095 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2017-17485 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2017-7525 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-10173 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10173)-2019-10173 | | CVE-2019-10202 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10202)-2019-10202 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20444 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20444)-2019-20444 | | CVE-2019-20445 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20445)-2019-20445 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2021-21342 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21342)-2021-21342 | | CVE-2021-21344 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21344)-2021-21344 | | CVE-2021-21345 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21345)-2021-21345 | | CVE-2021-21346 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21346)-2021-21346 | | CVE-2021-21347 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21347)-2021-21347 | | CVE-2021-21350 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21350)-2021-21350 | | CVE-2021-21351 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21351)-2021-21351 | | CVE-2021-41411 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-41411)-2021-41411 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-37865 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-42889 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42889)-2022-42889 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2024-47561 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-52046 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-52046)-2024-52046 | | CVE-2024-53990 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-53990)-2024-53990 | | CVE-2012-0881 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-0881)-2012-0881 | | CVE-2013-4002 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2013-4002)-2013-4002 | | CVE-2014-8125 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2014-8125)-2014-8125 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-3674 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-3674)-2016-3674 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2017-7957 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7957)-2017-7957 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-10172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10172)-2019-10172 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13936 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13936)-2020-13936 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-26217 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26217)-2020-26217 | | CVE-2020-26258 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26258)-2020-26258 | | CVE-2020-28052 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-21341 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21341)-2021-21341 | | CVE-2021-21343 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21343)-2021-21343 | | CVE-2021-21348 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21348)-2021-21348 | | CVE-2021-21349 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21349)-2021-21349 | | CVE-2021-29505 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29505)-2021-29505 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-37136 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37136)-2021-37136 | | CVE-2021-39139 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39139)-2021-39139 | | CVE-2021-39141 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39141)-2021-39141 | | CVE-2021-39144 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39144)-2021-39144 | | CVE-2021-39145 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39145)-2021-39145 | | CVE-2021-39146 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39146)-2021-39146 | | CVE-2021-39147 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39147)-2021-39147 | | CVE-2021-39148 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39148)-2021-39148 | | CVE-2021-39149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39149)-2021-39149 | | CVE-2021-39150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39150)-2021-39150 | | CVE-2021-39151 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39151)-2021-39151 | | CVE-2021-39152 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39152)-2021-39152 | | CVE-2021-39153 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39153)-2021-39153 | | CVE-2021-39154 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-39154)-2021-39154 | | CVE-2021-43859 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-43859)-2021-43859 | | CVE-2022-1415 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1415)-2022-1415 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40151 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40151)-2022-40151 | | CVE-2022-40152 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40152)-2022-40152 | | CVE-2022-41966 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41966)-2022-41966 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45688 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45688)-2022-45688 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-20883 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20883)-2023-20883 | | CVE-2023-25194 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-25194)-2023-25194 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-34455 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-44487 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44487)-2023-44487 | | CVE-2023-50387 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-50387)-2023-50387 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-52428 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-52428)-2023-52428 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-21634 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-21634)-2024-21634 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2009-2625 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2009-2625)-2009-2625 | | CVE-2012-5783 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2012-6153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2017-10355 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-10355)-2017-10355 | | CVE-2018-10237 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-11798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11798)-2018-11798 | | CVE-2018-1313 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1313)-2018-1313 | | CVE-2018-2799 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-2799)-2018-2799 | | CVE-2019-10219 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2019-10219](https://nvd.nist.gov/vuln/detail/CVE-2019-10219) | | CVE-2019-12384 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-12814 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2020-10693 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10693)-2020-10693 | | CVE-2020-13955 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13955)-2020-13955 | | CVE-2020-13956 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-14338 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14338)-2020-14338 | | CVE-2020-15250 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-17521 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-1945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2020-1945](https://nvd.nist.gov/vuln/detail/CVE-2020-1945) | | CVE-2020-26939 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-29582 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-29582)-2020-29582 | | CVE-2021-21290 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21290)-2021-21290 | | CVE-2021-21295 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21295)-2021-21295 | | CVE-2021-22569 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-22570 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-27568 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-27568)-2021-27568 | | CVE-2021-28170 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-29425 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-36373 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36373)-2021-36373 | | CVE-2021-36374 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36374)-2021-36374 | | CVE-2021-37533 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37533)-2021-37533 | | CVE-2021-38153 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-38153)-2021-38153 | | CVE-2022-23437 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-23437)-2022-23437 | | CVE-2022-24329 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2022-24329](https://nvd.nist.gov/vuln/detail/CVE-2022-24329) | | CVE-2022-38749 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38749)-2022-38749 | | CVE-2022-38750 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38750)-2022-38750 | | CVE-2022-38751 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38751)-2022-38751 | | CVE-2022-38752 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38752)-2022-38752 | | CVE-2022-41854 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41854)-2022-41854 | | CVE-2023-0833 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-0833)-2023-0833 | | CVE-2023-20863 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20863)-2023-20863 | | CVE-2023-26049 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-26049)-2023-26049 | | CVE-2023-33201 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33202 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-34462 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34462)-2023-34462 | | CVE-2023-42503 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-42503)-2023-42503 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2024-12798 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12798)-2024-12798 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-38820 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38820)-2024-38820 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2024-8184 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2020-8908 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2024-12801 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-12801)-2024-12801 | | CVE-2023-50868 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-50868)-2023-50868 | | CVE-2024-23454 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23454)-2024-23454 | | CVE-2024-23944 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-23945 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23945)-2024-23945 | | CVE-2024-25638 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25638)-2024-25638 | | CVE-2024-29025 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29025)-2024-29025 | | CVE-2024-29131 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29131)-2024-29131 | | CVE-2024-29133 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29133)-2024-29133 | | CVE-2024-29857 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2024-30171 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-31141 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-31141)-2024-31141 | | CVE-2024-36114 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-38808 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38808)-2024-38808 | | CVE-2024-43382 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-43382)-2024-43382 | | CVE-2024-47072 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47072)-2024-47072 | | CVE-2024-47535 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47535)-2024-47535 | | CVE-2024-47554 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-51504 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-56128 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-56128)-2024-56128 | | CVE-2024-9823 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-9823)-2024-9823 | ## Catatan rilis 7.6.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.6.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.6.0 application upgrades include HBase 2.6.1, Flink 1.20.0, Spark 3.5.3, and Trino 457. **Masalah yang diketahui** + **Saat penskalaan terkelola diaktifkan, YARN ResourceManager (RM) mengalami masalah kebuntuan kritis, menyebabkannya menjadi tidak responsif, saat beralih dari status DECOMMISSIONING ke **DECOMMISSIONED** dengan operasi simultan.** Ini terjadi terutama di lingkungan cluster besar. Ketika itu terjadi, baik transisi keadaan simpul dan transisi keadaan aplikasi gagal diproses, secara efektif melumpuhkan fungsionalitas inti dari. ResourceManager Sebagai solusinya, restart RM JVM menggunakan perintah berikut pada node utama: ``` sudo systemctl restart hadoop-yarn-resourcemanager ``` + Ketika cluster EMR dimulai dengan penjadwal YARN selain `CapacityScheduler` atau `FairScheduler` (misalnya, Penjadwal FIFO), metrik tidak didorong ke`YARNMemoryAvailablePercentage`. CloudWatch Masalah ini berdampak pada penurunan skala dalam klaster yang diaktifkan penskalaan terkelola. Ini mungkin juga memengaruhi penskalaan terkelola khusus jika bergantung pada `YARNMemoryAvailablePercentage` metrik. Sebagai solusinya, gunakan atau. `CapacityScheduler` `FairScheduler` + **HBase pembuatan tabel di katalog Hive with Glue** - Dari EMR-7.3.0 hingga EMR-7.10.0, ada bug karena integrasi Hive Iceberg, yang menyebabkan HBase pembuatan tabel di Hive gagal saat Glue Data Catalog digunakan sebagai metastore. Silakan hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **Tez UI** - Dari EMR-7.3 ke EMR-7.10, ada bug di mana mengakses UI Tez melalui UI Web Manajer Sumber Daya YARN gagal saat enkripsi dalam transit diaktifkan. Ini terjadi karena proxy YARN mencoba menggunakan protokol HTTP sementara Tez UI memerlukan HTTPS. Harap ubah `tez.tez-ui.history-url.base` konfigurasi `tez-site` dari `http` ke `https` untuk menyelesaikan masalah ini. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Dimulai dengan EMR 7.6.0, proses pembatalan langkah sekarang memastikan bahwa semua aplikasi Hadoop YARN yang dibuat oleh langkah dihentikan ketika langkah itu dibatalkan. Ini memberikan pembersihan yang lebih andal untuk aplikasi seperti pekerjaan Spark yang berjalan dalam mode cluster. + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + CloudWatch agen didukung pada Runtime Role Clusters untuk EMR 7.6 dan di atasnya. Untuk informasi selengkapnya, lihat [ CloudWatch Agen Amazon](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-AmazonCloudWatchAgent.html). + Dimulai dengan rilis Amazon Elastic Map Reduce (EMR) versi 7.6.0, konektor sistem file S3A sekarang mendukung enkripsi sisi klien Amazon S3. + Dimulai dengan EMR 7.6.0, TLS didukung pada dan titik akhir. HMaster RegionServer Untuk informasi selengkapnya, lihat tabel berikut mengenai dukungan TLS dengan HBase: [HBase](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-encryption-support-matrix.html#emr-encryption-support-matrix-hbase). + [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-760-release.html) ## 7.6.0 versi Java default Amazon EMR merilis 7.6 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.6.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 17, 11, 8 | | Pig | 17, 11, 8 | | Zookeeper | 17, 11, 8 | ## 7.6.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | Versi 3.2.1-amzn-1 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.15.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.19.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.18.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.36.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.15.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.1 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.67.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.20.0-amzn-0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.20.0-amzn-0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.4.0-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.4.0-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.4.0-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.4.0-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.4.0-amzn-2 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.4.0-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.4.0-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.4.0-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.4.0-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.4.0-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.4.0-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.6.1-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.6.1-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.6.1-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.6.1-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.6.1-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.6.1-amzn-0 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-15 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-15 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-15 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-15 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-15 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-15 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-15 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.15.0-amzn-3 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.15.0-amzn-3 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.15.0-amzn-3 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.15.0-amzn-3 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.6.1-amzn-2 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.3.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.2.0 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,287-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,287-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,287-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 457-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 457-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 457-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.3-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.5.3-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.3-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.3-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 24.10.1-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | tensorflow | 2.16.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-13 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-13 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.2-amzn-0 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.2-amzn-0 | ZooKeeper klien baris perintah. | ## 7.6.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.6.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j2 | Ubah nilai dalam file log4j2.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.6.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.6.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-01-13 | Publikasi Docs | Amazon EMR 7.6.0 catatan rilis pertama kali diterbitkan | | 2025-01-10 | Penerapan selesai | [Amazon EMR 7.6.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2025-12-26 | Rilis awal | Amazon EMR 7.6.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.5.0 ## 7.5.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.5.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | November 21, 2024 | | Dukungan standar sampai | November 20, 2026 | | Akhir dari dukungan | November 21, 2026 | | Akhir hidup | November 21, 2027 | ## 7.5.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.5.0 | emr-7.4.0 | emr-7.3.0 | emr-7.2.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.28.8, 1.12.772 | 2.28.8, 1.12.772 | 2.25.70, 1.12.747 | 2.23.18, 1.12.705 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | | Skala | 2.12.18 | 2.12.18 | 2.12.18 | 2.12.17 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | | Delta | 3.2.1-amzn-0 | 3.2.0-amzn-1 | 3.2.0-amzn-0 | 3.1.0 | | Flink | 1.19.1-amzn-1 | 1.19.1-amzn-0 | 1.18.1-amzn-2 | 1.18.1-amzn-1 | | Ganglia | - | - | - | - | | HBase | 2.5.10-amzn-0 | 2.5.5-amzn-0 | 2.4.17-amzn-7 | 2.4.17-amzn-6 | | HCatalog | 3.1.3-amzn-14 | 3.1.3-amzn-13 | 3.1.3-amzn-12 | 3.1.3-amzn-11 | | Hadoop | 3.4.0-amzn-1 | 3.4.0-amzn-0 | 3.3.6-amzn-5 | 3.3.6-amzn-4 | | Hive | 3.1.3-amzn-14 | 3.1.3-amzn-13 | 3.1.3-amzn-12 | 3.1.3-amzn-11 | | Hudi | 0.15.0-amzn-2 | 0.15.0-amzn-1 | 0.15.0-amzn-0 | 0.14.1-amzn-1 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.6.1-amzn-1 | 1.6.1-amzn-0 | 1.5.2-amzn-0 | 1.5.0-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | | MXNet | - | - | - | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.0 | 5.2.0 | 5.1.3 | 5.1.3 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,287-amzn-0 | 0,287-amzn-0 | 0.285-amzn-1 | 0,285-amzn-0 | | Spark | 3.5.2-amzn-1 | 3.5.2-amzn-0 | 3.5.1-amzn-1 | 3.5.1-amzn-0 | | Sqoop | - | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.16.1 | 2.16.1 | 2.16.1 | 2.11.0 | | Tez | 0.10.2-amzn-12 | 0.10.2-amzn-11 | 0.10.2-amzn-10 | 0.10.2-amzn-9 | | Trino (PrestoSQL) | 446-amzn-0 | 446-amzn-0 | 442-amzn-0 | 436-amzn-0 | | Zeppelin | 0.11.1 | 0.11.1 | 0.11.1 | 0.10.1 | | ZooKeeper | 3.9.2-amzn-0 | 3.9.2-amzn-0 | 3.9.1-amzn-1 | 3.9.1-amzn-1 | # Rincian komponen rilis 7.5.0 Lihat tabel berikut untuk informasi selengkapnya tentang paket *Ekstra* di Amazon EMR 7.5.0. | Aplikasi | Jenis Aplikasi | Paket | Jenis Package | Versi Package | | --- | --- | --- | --- | --- | | AmazonCloudWatchAgent | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | AmazonCloudWatchAgent | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | penjaga kebun binatang | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | AmazonCloudWatchAgent | Core | zookeper-server | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Flink | Core | hadop-client | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-km | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-benang | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hudi | Ekstra | 0.15.0.amzn.0-1.amzn2023 | | Flink | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Flink | Core | hadoop | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | HBase | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | HCatalog | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | HCatalog | Core | mariadb-connector-java | Ekstra | | | Hive | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Hive | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Hive | Core | hive-hbase | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Hive | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Hive | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | Phoenix | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | Spark | Core | spark-datanucleus | Ekstra | 3.5.1.amzn.0-1.amzn2023 | | Tez | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Tez | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Tez | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | utilitas besar | Ekstra | 1.2.0-1.amzn2023 | | Trino | Core | hadop-client | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-km | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-benang | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hive | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | hive-hcatalog-server | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Trino | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Trino | Core | penjaga kebun binatang | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Trino | Core | zookeper-server | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Trino | Core | bigtop-groovy | Ekstra | 2.5.4-1.amzn2023 | | Trino | Core | bigtop-jsvc | Ekstra | 1.2.4-1.amzn2023 | | Trino | Core | hadoop | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-lzo | Ekstra | 0.4.19-1.amzn2023 | | Trino | Core | hive-hcatalog | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | sarang-jdbc | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Zookeeper | Core | emrfs | Ekstra | 2.64.0-1.amzn2023 | | Zookeeper | Core | hadop-client | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-km | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-benang | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | # 7.5.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi Amazon EMR 7.5.0 yang direkomendasikan. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 23 November 2021. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2013-4002 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2013-4002)-2013-4002 | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2018-12022 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2019-12384 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14439 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2020-10672 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-11112 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-13949 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14195 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-17521 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-24616 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-36183 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36186 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36188 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-8908 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2021-37137 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37137)-2021-37137 | | CVE-2021-38153 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-38153)-2021-38153 | | CVE-2022-25857 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3509 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-37866 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-41966 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41966)-2022-41966 | | CVE-2022-45688 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45688)-2022-45688 | | CVE-2023-34455 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-3635 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-38647 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-38647)-2023-38647 | | CVE-2023-40167 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-40167)-2023-40167 | | CVE-2023-43642 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2023-50387 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-50387)-2023-50387 | | CVE-2024-23454 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23454)-2024-23454 | | CVE-2024-29025 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29025)-2024-29025 | | CVE-2024-36124 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36124)-2024-36124 | | CVE-2024-8184 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2012-0881 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-0881)-2012-0881 | | CVE-2012-5783 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-5018 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2017-15095 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-10054 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10054)-2018-10054 | | CVE-2018-10237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-11798 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11798)-2018-11798 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-14721 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19361 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2018-7489 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12814 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2019-14540 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16869 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16869)-2019-16869 | | CVE-2019-16942 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-17267 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20444 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20444)-2019-20444 | | CVE-2019-20445 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20445)-2019-20445 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13955 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13955)-2020-13955 | | CVE-2020-13956 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-15250 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-26939 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-8840 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-21290 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21290)-2021-21290 | | CVE-2021-22569 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-28170 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-29425 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-36374 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36374)-2021-36374 | | CVE-2021-37533 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37533)-2021-37533 | | CVE-2021-43859 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-43859)-2021-43859 | | CVE-2022-1415 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1415)-2022-1415 | | CVE-2022-1471 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37865 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-38749 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38749)-2022-38749 | | CVE-2022-38751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38751)-2022-38751 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40151 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40151)-2022-40151 | | CVE-2022-40152 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40152)-2022-40152 | | CVE-2022-41854 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41854)-2022-41854 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42889 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42889)-2022-42889 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46337 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2023-0833 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-0833)-2023-0833 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-20863 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20863)-2023-20863 | | CVE-2023-25194 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-25194)-2023-25194 | | CVE-2023-33201 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33202 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34454 | tinggi | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-42503 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-42503)-2023-42503 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-50868 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-50868)-2023-50868 | | CVE-2023-52428 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-52428)-2023-52428 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-21634 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-21634)-2024-21634 | | CVE-2024-23944 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-29131 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29131)-2024-29131 | | CVE-2024-30171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-35255 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-35255)-2024-35255 | | CVE-2024-36114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-38808 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38808)-2024-38808 | | CVE-2024-39676 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-39676)-2024-39676 | | CVE-2024-51504 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2017-17485 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2018-14719 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-19362 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2020-10650 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10968 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-13936 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13936)-2020-13936 | | CVE-2020-14062 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-1945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2020-1945](https://nvd.nist.gov/vuln/detail/CVE-2020-1945) | | CVE-2020-28052 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2021-36373 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36373)-2021-36373 | | CVE-2022-25647 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-38750 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38750)-2022-38750 | | CVE-2022-38752 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38752)-2022-38752 | | CVE-2022-42004 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-46751 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-20883 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20883)-2023-20883 | | CVE-2023-26048 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-26048)-2023-26048 | | CVE-2023-2976 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-36478 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-36478)-2023-36478 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2024-25638 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25638)-2024-25638 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-29133 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29133)-2024-29133 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47561 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2012-6153 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2020-11113 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2021-22570 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-27568 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-27568)-2021-27568 | | CVE-2024-29857 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2017-7525 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2018-11307 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-1313 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1313)-2018-1313 | | CVE-2018-19360 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2019-16335 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16943 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2020-36180 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2021-37136 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37136)-2021-37136 | | CVE-2022-24329 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE-2022-24329](https://nvd.nist.gov/vuln/detail/CVE-2022-24329) | | CVE-2022-39135 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-40149 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2023-26049 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-26049)-2023-26049 | ## Catatan rilis 7.5.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.5.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.5.0 application upgrades include Delta 3.2.1-amzn-0, HBase 2.5.10, Hudi 0.15.0-amzn-2, and Iceberg 1.6.1-amzn-1. + EMR write-ahead logs (WAL) mendukung replikasi lintas cluster. Untuk informasi lebih lanjut, lihat Replikasi [lintas cluster EMR WAL](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hbase-wal-cross-cluster.html). **Masalah yang diketahui** + Apache Sqoop telah dihapus dari Amazon EMR Release 7.5 dan rilis yang lebih baru. + **Saat penskalaan terkelola diaktifkan, YARN ResourceManager (RM) mengalami masalah kebuntuan kritis, menyebabkannya menjadi tidak responsif, saat beralih dari status DECOMMISSIONING ke **DECOMMISSIONED** dengan operasi simultan.** Ini terjadi terutama di lingkungan cluster besar. Ketika itu terjadi, baik transisi keadaan simpul dan transisi keadaan aplikasi gagal diproses, secara efektif melumpuhkan fungsionalitas inti dari. ResourceManager Sebagai solusinya, restart RM JVM menggunakan perintah berikut pada node utama: ``` sudo systemctl restart hadoop-yarn-resourcemanager ``` + Ketika cluster EMR dimulai dengan penjadwal YARN selain `CapacityScheduler` atau `FairScheduler` (misalnya, Penjadwal FIFO), metrik tidak didorong ke`YARNMemoryAvailablePercentage`. CloudWatch Masalah ini berdampak pada penurunan skala dalam klaster yang diaktifkan penskalaan terkelola. Ini mungkin juga memengaruhi penskalaan terkelola khusus jika bergantung pada `YARNMemoryAvailablePercentage` metrik. Sebagai solusinya, gunakan atau. `CapacityScheduler` `FairScheduler` + **HBase pembuatan tabel di katalog Hive with Glue** - Dari EMR-7.3.0 hingga EMR-7.10.0, ada bug karena integrasi Hive Iceberg, yang menyebabkan HBase pembuatan tabel di Hive gagal saat Glue Data Catalog digunakan sebagai metastore. Silakan hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **Tez UI** - Dari EMR-7.3 ke EMR-7.10, ada bug di mana mengakses UI Tez melalui UI Web Manajer Sumber Daya YARN gagal saat enkripsi dalam transit diaktifkan. Ini terjadi karena proxy YARN mencoba menggunakan protokol HTTP sementara Tez UI memerlukan HTTPS. Harap ubah `tez.tez-ui.history-url.base` konfigurasi `tez-site` dari `http` ke `https` untuk menyelesaikan masalah ini. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Amazon EMR menggunakan build TensorFlow library yang berbeda, bergantung pada jenis instans yang Anda pilih untuk klaster. Amazon EMR juga mendukung TensorFlow klaster dengan tipe instans **aarch64** (instans Graviton) dari EMR-7.5.0 ke atas. Daftar tabel berikut dibuat berdasarkan jenis instans untuk EMR-7.5.0: [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-750-release.html) + Sebuah AWS Lake Formation dengan FGAC (Fine-Grained Access Control) mengaktifkan Amazon EMR cluster sekarang dapat mendukung hingga 256 langkah bersamaan dengan konfigurasi hdfs-site.xml berikut: ``` [ { "Classification": "hdfs-site", "Properties": { "dfs.datanode.handler.count": "40", "dfs.datanode.max.transfer.threads": "16384", "dfs.namenode.handler.count": "64", "dfs.replication": "1" } }, { "Classification": "hdfs-env", "Configurations": [ { "Classification": "export", "Properties": { "HADOOP_DATANODE_HEAPSIZE": "5120" } } ], "Properties": {} } ] ``` + [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-750-release.html) ## 7.5.0 versi Java default Amazon EMR merilis 7.5 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.5.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 17, 11, 8 | | Pig | 8 | | Zookeeper | 17, 11, 8 | ## 7.5.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.2.1-amzn-0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.14.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.18.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.16.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.35.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.14.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.1 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.66.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.19.1-amzn-1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.19.1-amzn-1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.4.0-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.4.0-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.4.0-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.4.0-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.4.0-amzn-1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.4.0-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.4.0-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.4.0-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.4.0-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.4.0-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.4.0-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.5.10-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.5.10-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.5.10-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.5.10-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.5.10-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.5.10-amzn-0 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-14 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-14 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-14 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-14 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-14 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-14 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-14 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.15.0-amzn-2 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.15.0-amzn-2 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.15.0-amzn-2 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.15.0-amzn-2 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.6.1-amzn-1 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.3.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.2.0 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,287-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,287-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,287-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 446-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 446-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 446-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.2-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 3.5.2-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.2-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.2-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 24.08.1-amzn-1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | tensorflow | 2.16.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-12 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-12 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.2-amzn-0 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.2-amzn-0 | ZooKeeper klien baris perintah. | ## 7.5.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.5.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j2 | Ubah nilai dalam file log4j2.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.5.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.5.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2024-11-21 | Publikasi Docs | Amazon EMR 7.5.0 catatan rilis pertama kali diterbitkan | | 2024-11-21 | Penerapan selesai | [Amazon EMR 7.5.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2024-11-13 | Rilis awal | Amazon EMR 7.5.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.4.0 ## 7.4.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.4.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | November 13, 2024 | | Dukungan standar sampai | November 12, 2026 | | Akhir dari dukungan | November 13, 2026 | | Akhir hidup | November 13, 2027 | ## 7.4.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.4.0 | emr-7.3.0 | emr-7.2.0 | emr-7.1.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.28.8, 1.12.772 | 2.25.70, 1.12.747 | 2.23.18, 1.12.705 | 2.23.18, 1.12.656 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | | Skala | 2.12.18 | 2.12.18 | 2.12.17 | 2.12.17 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | | Delta | 3.2.0-amzn-1 | 3.2.0-amzn-0 | 3.1.0 | 3.0.0 | | Flink | 1.19.1-amzn-0 | 1.18.1-amzn-2 | 1.18.1-amzn-1 | 1.18.1-amzn-0 | | Ganglia | - | - | - | - | | HBase | 2.5.5-amzn-0 | 2.4.17-amzn-7 | 2.4.17-amzn-6 | 2.4.17-amzn-5 | | HCatalog | 3.1.3-amzn-13 | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | | Hadoop | 3.4.0-amzn-0 | 3.3.6-amzn-5 | 3.3.6-amzn-4 | 3.3.6-amzn-3 | | Hive | 3.1.3-amzn-13 | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | | Hudi | 0.15.0-amzn-1 | 0.15.0-amzn-0 | 0.14.1-amzn-1 | 0.14.1-amzn-0 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.6.1-amzn-0 | 1.5.2-amzn-0 | 1.5.0-amzn-0 | 1.4.3-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | | MXNet | - | - | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.2.0 | 5.1.3 | 5.1.3 | 5.1.3 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,287-amzn-0 | 0.285-amzn-1 | 0,285-amzn-0 | 0,284-amzn-0 | | Spark | 3.5.2-amzn-0 | 3.5.1-amzn-1 | 3.5.1-amzn-0 | 3.5.0-amzn-1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.16.1 | 2.16.1 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-11 | 0.10.2-amzn-10 | 0.10.2-amzn-9 | 0.10.2-amzn-8 | | Trino (PrestoSQL) | 446-amzn-0 | 442-amzn-0 | 436-amzn-0 | 435-amzn-0 | | Zeppelin | 0.11.1 | 0.11.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.9.2-amzn-0 | 3.9.1-amzn-1 | 3.9.1-amzn-1 | 3.9.1-amzn-0 | # 7.4.0 rincian komponen rilis Lihat tabel berikut untuk informasi selengkapnya tentang paket *Ekstra* di Amazon EMR 7.4.0. | Aplikasi | Jenis Aplikasi | Paket | Jenis Package | Versi Package | | --- | --- | --- | --- | --- | | AmazonCloudWatchAgent | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | AmazonCloudWatchAgent | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | penjaga kebun binatang | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | AmazonCloudWatchAgent | Core | zookeper-server | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Flink | Core | hadop-client | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-km | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-benang | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hudi | Ekstra | 0.15.0.amzn.0-1.amzn2023 | | Flink | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Flink | Core | hadoop | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | HBase | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | HCatalog | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | HCatalog | Core | mariadb-connector-java | Ekstra | | | Hive | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Hive | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Hive | Core | hive-hbase | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Hive | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Hive | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | Phoenix | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | Spark | Core | spark-datanucleus | Ekstra | 3.5.1.amzn.0-1.amzn2023 | | Tez | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Tez | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Tez | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | utilitas besar | Ekstra | 1.2.0-1.amzn2023 | | Trino | Core | hadop-client | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-km | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-benang | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hive | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | hive-hcatalog-server | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Trino | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Trino | Core | penjaga kebun binatang | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Trino | Core | zookeper-server | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Trino | Core | bigtop-groovy | Ekstra | 2.5.4-1.amzn2023 | | Trino | Core | bigtop-jsvc | Ekstra | 1.2.4-1.amzn2023 | | Trino | Core | hadoop | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-lzo | Ekstra | 0.4.19-1.amzn2023 | | Trino | Core | hive-hcatalog | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | sarang-jdbc | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Zookeeper | Core | emrfs | Ekstra | 2.64.0-1.amzn2023 | | Zookeeper | Core | hadop-client | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-km | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-benang | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | # 7.4.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi Amazon EMR 7.4.0 yang direkomendasikan. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 14 November 2024. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2013-4002 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2013-4002)-2013-4002 | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2017-7525 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-12022 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2019-12384 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12384)-2019-12384 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14439 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2020-10672 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-11112 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-13949 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14195 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-17521 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17521)-2020-17521 | | CVE-2020-24616 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-36183 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36186 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36188 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-8908 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8908)-2020-8908 | | CVE-2021-37137 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37137)-2021-37137 | | CVE-2021-38153 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-38153)-2021-38153 | | CVE-2022-25857 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3509 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-37866 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-41966 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41966)-2022-41966 | | CVE-2022-45688 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45688)-2022-45688 | | CVE-2023-34455 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-3635 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-38647 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-38647)-2023-38647 | | CVE-2023-40167 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-40167)-2023-40167 | | CVE-2023-43642 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2023-50387 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-50387)-2023-50387 | | CVE-2024-23454 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23454)-2024-23454 | | CVE-2024-29025 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29025)-2024-29025 | | CVE-2024-36124 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36124)-2024-36124 | | CVE-2024-8184 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-8184)-2024-8184 | | CVE-2012-0881 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-0881)-2012-0881 | | CVE-2012-5783 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-5783)-2012-5783 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-5018 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2017-15095 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-10054 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10054)-2018-10054 | | CVE-2018-10237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10237)-2018-10237 | | CVE-2018-11798 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11798)-2018-11798 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-14721 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19361 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2018-7489 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12814 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12814)-2019-12814 | | CVE-2019-14540 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16869 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16869)-2019-16869 | | CVE-2019-16942 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-17267 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20444 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20444)-2019-20444 | | CVE-2019-20445 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20445)-2019-20445 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13955 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13955)-2020-13955 | | CVE-2020-13956 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13956)-2020-13956 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-15250 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15250)-2020-15250 | | CVE-2020-26939 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-26939)-2020-26939 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-8840 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-21290 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-21290)-2021-21290 | | CVE-2021-22569 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22569)-2021-22569 | | CVE-2021-28170 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28170)-2021-28170 | | CVE-2021-29425 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-29425)-2021-29425 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-36374 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36374)-2021-36374 | | CVE-2021-37533 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37533)-2021-37533 | | CVE-2021-43859 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-43859)-2021-43859 | | CVE-2022-1415 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1415)-2022-1415 | | CVE-2022-1471 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37865 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-38749 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38749)-2022-38749 | | CVE-2022-38751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38751)-2022-38751 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40151 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40151)-2022-40151 | | CVE-2022-40152 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40152)-2022-40152 | | CVE-2022-41854 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41854)-2022-41854 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42889 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42889)-2022-42889 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46337 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2023-0833 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-0833)-2023-0833 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-20863 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20863)-2023-20863 | | CVE-2023-25194 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-25194)-2023-25194 | | CVE-2023-33201 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33201)-2023-33201 | | CVE-2023-33202 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-33202)-2023-33202 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-42503 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-42503)-2023-42503 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-50868 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-50868)-2023-50868 | | CVE-2023-52428 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-52428)-2023-52428 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-21634 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-21634)-2024-21634 | | CVE-2024-23944 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-23944)-2024-23944 | | CVE-2024-29131 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29131)-2024-29131 | | CVE-2024-30171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30171)-2024-30171 | | CVE-2024-30172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-30172)-2024-30172 | | CVE-2024-34447 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-34447)-2024-34447 | | CVE-2024-35255 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-35255)-2024-35255 | | CVE-2024-36114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-36114)-2024-36114 | | CVE-2024-38808 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-38808)-2024-38808 | | CVE-2024-39676 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-39676)-2024-39676 | | CVE-2024-51504 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-51504)-2024-51504 | | CVE-2024-7254 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-7254)-2024-7254 | | CVE-2017-17485 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2018-14719 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-19362 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2020-10650 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10968 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-13936 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13936)-2020-13936 | | CVE-2020-14062 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-15522 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-15522)-2020-15522 | | CVE-2020-1945 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE-2020-1945](https://nvd.nist.gov/vuln/detail/CVE-2020-1945) | | CVE-2020-28052 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2021-36373 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36373)-2021-36373 | | CVE-2022-25647 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-38750 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38750)-2022-38750 | | CVE-2022-38752 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-38752)-2022-38752 | | CVE-2022-42004 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-46751 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-20883 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20883)-2023-20883 | | CVE-2023-26048 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-26048)-2023-26048 | | CVE-2023-2976 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-36478 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-36478)-2023-36478 | | CVE-2023-51074 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-51074)-2023-51074 | | CVE-2024-25638 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25638)-2024-25638 | | CVE-2024-25710 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-25710)-2024-25710 | | CVE-2024-26308 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-26308)-2024-26308 | | CVE-2024-29133 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29133)-2024-29133 | | CVE-2024-47554 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47554)-2024-47554 | | CVE-2024-47561 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-47561)-2024-47561 | | CVE-2024-6763 | MEDIUM | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-6763)-2024-6763 | | CVE-2012-6153 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-6153)-2012-6153 | | CVE-2020-11113 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2021-22570 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22570)-2021-22570 | | CVE-2021-27568 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-27568)-2021-27568 | | CVE-2024-29857 | RENDAH | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-29857)-2024-29857 | | CVE-2018-1313 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1313)-2018-1313 | | CVE-2020-36180 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2021-37136 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37136)-2021-37136 | | CVE-2022-24329 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE-2022-24329](https://nvd.nist.gov/vuln/detail/CVE-2022-24329) | | CVE-2022-40149 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2023-26049 | TIDAK DIUJICOBAKAN | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-26049)-2023-26049 | ## Catatan rilis 7.4.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.4.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.4.0 application upgrades include AWS SDK for Java 2.28.8, Delta 3.2.0-amzn-1, Flink 1.19.1, Hadoop 3.4.0, HBase 2.5.5, Hudi 0.15.0-amzn-1, Iceberg 1.6.1-amzn-0, Phoenix 5.2.0, Presto 0.287, Spark 3.5.2, Trino 446, and Zookeeper 3.9.2. + Rilis ini menambahkan 7 titik akhir open-source yang mendukung enkripsi in-transit melalui jaringan. Peningkatan ini mencakup kerangka kerja sumber terbuka seperti Hue, Livy, Zookeeper JupyterEnterpriseGateway, dan Ranger KMS. Jika Anda mengaktifkan enkripsi dalam perjalanan dan ingin terhubung ke titik akhir ini, Anda mungkin harus memodifikasi kode Anda untuk mendukung komunikasi TLS. Anda dapat menonaktifkan TLS untuk salah satu titik akhir ini sesuai kebutuhan. Untuk daftar lengkap titik akhir yang didukung, lihat [Memahami enkripsi dalam perjalanan](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-encryption-support-matrix.html). **Masalah yang diketahui** + `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-shuffle-data`Properti untuk Yarn ResourceManager, yang sebelumnya mendukung penangan shuffle Hive sejak emr-6.11.0, sekarang juga menerapkan penonaktifan anggun ke file yang disajikan oleh layanan shuffle eksternal Spark, saat menjalankan Spark on Yarn di emr-7.4.0. Perhatikan bahwa Perilaku default dari layanan shuffle eksternal Spark, saat menjalankan Spark on Yarn, adalah NodeManager agar Yarn menghapus file shuffle aplikasi saat aplikasi dihentikan. Ini mungkin berdampak pada kecepatan penonaktifan node dan pemanfaatan komputasi. Untuk aplikasi yang berjalan lama, pertimbangkan pengaturan `spark.shuffle.service.removeShuffle` `true` untuk menghapus file shuffle yang tidak lagi digunakan, yang memungkinkan penonaktifan node lebih cepat tanpa data acak aktif. + Ketersediaan Amazon S3 Pilih — Amazon S3 Select tidak mendukung kueri lintas wilayah untuk Presto dan Trino. Untuk informasi lebih lanjut tentang fitur spesifik yang tersedia untuk rilis Presto dan Trino, lihat [Presto](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-presto.html) dan Trino. + Apache Ranger tidak didukung oleh Amazon EMR Release 7.4. + Apache Sqoop tidak kompatibel dengan Apache Hadoop 3.4 karena masalah yang diketahui SQOOP-3485. Amazon EMR Release 7.4 termasuk tetapi tidak mendukung Apache Sqoop. Apache Sqoop akan dihapus dari Amazon EMR Release 7.5 dan rilis yang lebih tinggi. + **Saat penskalaan terkelola diaktifkan, YARN ResourceManager (RM) mengalami masalah kebuntuan kritis, menyebabkannya menjadi tidak responsif, saat beralih dari status DECOMMISSIONING ke **DECOMMISSIONED** dengan operasi simultan.** Ini terjadi terutama di lingkungan cluster besar. Ketika itu terjadi, baik transisi keadaan simpul dan transisi keadaan aplikasi gagal diproses, secara efektif melumpuhkan fungsionalitas inti dari. ResourceManager Sebagai solusinya, restart RM JVM menggunakan perintah berikut pada node utama: ``` sudo systemctl restart hadoop-yarn-resourcemanager ``` + Ketika cluster EMR dimulai dengan penjadwal YARN selain `CapacityScheduler` atau `FairScheduler` (misalnya, Penjadwal FIFO), metrik tidak didorong ke`YARNMemoryAvailablePercentage`. CloudWatch Masalah ini berdampak pada penurunan skala dalam klaster yang diaktifkan penskalaan terkelola. Ini mungkin juga memengaruhi penskalaan terkelola khusus jika bergantung pada `YARNMemoryAvailablePercentage` metrik. Sebagai solusinya, gunakan atau. `CapacityScheduler` `FairScheduler` + **HBase pembuatan tabel di katalog Hive with Glue** - Dari EMR-7.3.0 hingga EMR-7.10.0, ada bug karena integrasi Hive Iceberg, yang menyebabkan HBase pembuatan tabel di Hive gagal saat Glue Data Catalog digunakan sebagai metastore. Silakan hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **Tez UI** - Dari EMR-7.3 ke EMR-7.10, ada bug di mana mengakses UI Tez melalui UI Web Manajer Sumber Daya YARN gagal saat enkripsi dalam transit diaktifkan. Ini terjadi karena proxy YARN mencoba menggunakan protokol HTTP sementara Tez UI memerlukan HTTPS. Harap ubah `tez.tez-ui.history-url.base` konfigurasi `tez-site` dari `http` ke `https` untuk menyelesaikan masalah ini. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Amazon EMR menggunakan build TensorFlow pustaka yang berbeda tergantung pada jenis instans yang Anda pilih untuk klaster Anda. Amazon EMR juga mendukung TensorFlow cluster dengan tipe instans aarch64 (instans Graviton) dari EMR-7.5.0 ke atas. + **Mengoptimalkan Scaling Permintaan S3 untuk Beban Kerja Iceberg** — Untuk pelanggan yang menggunakan Iceberg yang dibundel dengan rilis EMR 34 v7.4, S3 telah memperbarui skema entropi default ke hash basis-2 20 karakter (misalnya 35 01010110100110110010). Skema entropi basis-2 yang baru ini mengurangi rentang karakter dan memungkinkan S3 untuk secara otomatis menskalakan kapasitas permintaan lebih cepat agar sesuai dengan tuntutan beban kerja Iceberg target. Ini juga mengurangi jumlah waktu beban kerja mengamati 503 respons throttle. + [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-740-release.html) ## 7.4.0 versi Java default Amazon EMR merilis 7.4 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.4.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Sqoop | 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 17, 11, 8 | | Pig | 8 | | Zookeeper | 8 | ## 7.4.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.2.0-amzn-1 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.13.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.17.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.17.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.34.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.13.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.1 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.65.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.19.1-amzn-0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.19.1-amzn-0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.4.0-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.4.0-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.4.0-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.4.0-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.4.0-amzn-0 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.4.0-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.4.0-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.4.0-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.4.0-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.4.0-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.4.0-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.5.5-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.5.5-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.5.5-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.5.5-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.5.5-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.5.5-amzn-0 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-13 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-13 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-13 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-13 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-13 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-13 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-13 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.15.0-amzn-1 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.15.0-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.15.0-amzn-1 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.15.0-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.6.1-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.3.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.2.0 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,287-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,287-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,287-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 446-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 446-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 446-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.2-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.5.2-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.2-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.2-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 24.08.1-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.16.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-11 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-11 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.2-amzn-0 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.2-amzn-0 | ZooKeeper klien baris perintah. | ## 7.4.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.4.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j2 | Ubah nilai dalam file log4j2.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.4.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.4.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2024-11-18 | Publikasi Docs | Catatan rilis Amazon EMR 7.4.0 pertama kali diterbitkan | | 2024-11-13 | Penerapan selesai | [Amazon EMR 7.4.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2024-10-31 | Mulai penyebaran | Amazon EMR 7.4.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.3.0 ## 7.3.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.3.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | Oktober 16, 2024 | | Dukungan standar sampai | Oktober 15, 2026 | | Akhir dari dukungan | Oktober 16, 2026 | | Akhir hidup | Oktober 16, 2027 | ## 7.3.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.3.0 | emr-7.2.0 | emr-7.1.0 | emr-7.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.25.70, 1.12.747 | 2.23.18, 1.12.705 | 2.23.18, 1.12.656 | 2.20.160-amzn-0, 1.12.569 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9 | | Skala | 2.12.18 | 2.12.17 | 2.12.17 | 2.12.17 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300031.1-amzn-0 | | Delta | 3.2.0-amzn-0 | 3.1.0 | 3.0.0 | 3.0.0 | | Flink | 1.18.1-amzn-2 | 1.18.1-amzn-1 | 1.18.1-amzn-0 | 1.18.0-amzn-0 | | Ganglia | - | - | - | - | | HBase | 2.4.17-amzn-7 | 2.4.17-amzn-6 | 2.4.17-amzn-5 | 2.4.17-amzn-4 | | HCatalog | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hadoop | 3.3.6-amzn-5 | 3.3.6-amzn-4 | 3.3.6-amzn-3 | 3.3.6-amzn-2 | | Hive | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hudi | 0.15.0-amzn-0 | 0.14.1-amzn-1 | 0.14.1-amzn-0 | 0.14.0-amzn-1 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.5.2-amzn-0 | 1.5.0-amzn-0 | 1.4.3-amzn-0 | 1.4.2-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.7.1-inkubasi | | MXNet | - | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.3 | 5.1.3 | 5.1.3 | 5.1.3 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.285-amzn-1 | 0,285-amzn-0 | 0,284-amzn-0 | 0,283-amzn-1 | | Spark | 3.5.1-amzn-1 | 3.5.1-amzn-0 | 3.5.0-amzn-1 | 3.5.0-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.16.1 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-10 | 0.10.2-amzn-9 | 0.10.2-amzn-8 | 0.10.2-amzn-7 | | Trino (PrestoSQL) | 442-amzn-0 | 436-amzn-0 | 435-amzn-0 | 426-amzn-1 | | Zeppelin | 0.11.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.9.1-amzn-1 | 3.9.1-amzn-1 | 3.9.1-amzn-0 | 3.5.10 | # Rincian komponen rilis 7.3.0 Lihat tabel berikut untuk informasi selengkapnya tentang paket *Ekstra* di Amazon EMR 7.3.0. | Aplikasi | Jenis Aplikasi | Paket | Jenis Package | Versi Package | | --- | --- | --- | --- | --- | | AmazonCloudWatchAgent | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | AmazonCloudWatchAgent | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | penjaga kebun binatang | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | AmazonCloudWatchAgent | Core | zookeper-server | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Flink | Core | hadop-client | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-km | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-benang | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Flink | Core | hudi | Ekstra | 0.15.0.amzn.0-1.amzn2023 | | Flink | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Flink | Core | hadoop | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | HBase | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | HCatalog | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | HCatalog | Core | mariadb-connector-java | Ekstra | | | Hive | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Hive | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Hive | Core | hive-hbase | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Hive | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Hive | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | Phoenix | Core | s3-dist-cp | Ekstra | 2.33.0-1.amzn2023 | | Spark | Core | spark-datanucleus | Ekstra | 3.5.1.amzn.0-1.amzn2023 | | Tez | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Tez | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Tez | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | utilitas besar | Ekstra | 1.2.0-1.amzn2023 | | Trino | Core | hadop-client | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-km | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-benang | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hive | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | hive-hcatalog-server | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Trino | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Trino | Core | penjaga kebun binatang | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Trino | Core | zookeper-server | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Trino | Core | bigtop-groovy | Ekstra | 2.5.4-1.amzn2023 | | Trino | Core | bigtop-jsvc | Ekstra | 1.2.4-1.amzn2023 | | Trino | Core | hadoop | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Trino | Core | hadoop-lzo | Ekstra | 0.4.19-1.amzn2023 | | Trino | Core | hive-hcatalog | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Trino | Core | sarang-jdbc | Ekstra | 3.1.3.amzn.12-1.amzn2023 | | Zookeeper | Core | emrfs | Ekstra | 2.64.0-1.amzn2023 | | Zookeeper | Core | hadop-client | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-km | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-benang | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.5-1.amzn2023 | | Zookeeper | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | # 7.3.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi Amazon EMR 7.3.0 yang direkomendasikan. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 3 Oktober 2024. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2016-5018 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20444 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20444)-2019-20444 | | CVE-2019-20445 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20445)-2019-20445 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-37865 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2012-0881 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-0881)-2012-0881 | | CVE-2013-4002 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2013-4002)-2013-4002 | | CVE-2015-2156 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-2156)-2015-2156 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2017-18640 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-18640)-2017-18640 | | CVE-2017-18640 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-18640)-2017-18640 | | CVE-2018-1000180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-1000180)-2018-1000180 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-16869 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16869)-2019-16869 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-13936 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13936)-2020-13936 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-28052 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28052)-2020-28052 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-35515 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35515)-2021-35515 | | CVE-2021-35516 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35516)-2021-35516 | | CVE-2021-35517 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35517)-2021-35517 | | CVE-2021-36090 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36090)-2021-36090 | | CVE-2021-37136 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37136)-2021-37136 | | CVE-2021-37137 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37137)-2021-37137 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40152 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40152)-2022-40152 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45688 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45688)-2022-45688 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-34455 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-36478 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-36478)-2023-36478 | | CVE-2023-36478 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-36478)-2023-36478 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-50387 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-50387)-2023-50387 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-21634 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-21634)-2024-21634 | ## Catatan rilis 7.3.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.3.0. Perubahan relatif terhadap 7.3.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.3.0 application upgrades include Delta 3.2.0-amzn-0, Hudi 0.15.0-amzn-0, TensorFlow 2.16.1, Trino 442, and Zeppelin 0.11.1. + Rilis ini menambahkan 22 titik akhir open-source yang mendukung enkripsi in-transit melalui jaringan. Peningkatan ini mencakup kerangka kerja sumber terbuka seperti Hadoop, Hive, Tez,, Phoenix, dan Flink. HBase Jika Anda mengaktifkan enkripsi dalam perjalanan dan ingin terhubung ke titik akhir ini, Anda mungkin harus memodifikasi kode Anda untuk mendukung komunikasi TLS. Anda dapat menonaktifkan TLS untuk salah satu titik akhir ini sesuai kebutuhan. Untuk daftar lengkap titik akhir yang didukung, lihat [Memahami enkripsi dalam perjalanan](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-encryption-support-matrix.html). + Dengan Amazon EMR 7.3.0, Apache Hive dengan Iceberg sekarang mendukung Katalog Data AWS Glue sebagai metastore, yang memberi Anda manfaat seperti repositori terpusat untuk menyimpan metadata, merayapi sumber data secara otomatis dan mengekstrak metadata, dan integrasi dengan layanan lain untuk alur kerja yang mulus. **Masalah yang diketahui** + Python 3.11 tidak didukung dengan EMR Studio. + Jika Anda menggunakan enkripsi dalam transit dan otentikasi Kerberos, Anda tidak akan dapat menggunakan aplikasi Spark yang bergantung pada metastore Hive. Masalah ini diperbaiki di [HIVE-16340](https://issues.apache.org/jira/browse/HIVE-16340) dan akan sepenuhnya diselesaikan di [SPARK-44114 ketika Spark open-source](https://issues.apache.org/jira/browse/SPARK-44114) dapat meningkatkan ke Hive 3. Sementara itu, Anda dapat mengatasi masalah ini untuk sementara dengan `hive.metastore.use.SSL` menyetelnya. `false` Untuk informasi selengkapnya, lihat [Mengkonfigurasi aplikasi](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps.html). + Jika Anda tidak menggunakan otentikasi Kerberos, Anda harus mengonfigurasi Spark untuk menggunakan SSL. Untuk melakukannya, atur konfigurasi berikut saat Anda menyediakan klaster Anda. ``` [{ "Classification": "spark-defaults", "Properties": { "spark.hadoop.hive.metastore.truststore.path": "/usr/share/aws/emr/security/conf/keystore-thrift.jks", "spark.hadoop.hive.metastore.use.SSL": "true" } }] ``` + Jika Anda menggunakan domain khusus, beberapa tautan di UI Server Riwayat Spark di AWS konsol mungkin tidak berfungsi. Unggah skrip berikut ke bucket S3, lalu [tambahkan langkah](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-add-steps-console.html) untuk menggunakan skrip shell. ``` #!/bin/bash if grep -q ":8042" /etc/nginx/nginx.conf; then sudo sed -i '=s#\^(\\/nm\\/(?.*:8042)\\/(?.*)\$)#^(\\/nm\\/(?(\\.|-|[a-zA-Z0-9])*:8042)\\/(?(node|conf|logs|stacks|jmx).*)\$)#g' /etc/nginx/nginx.conf else sudo sed -i 's#\^(\\/nm\\/(?.*:8044)\\/(?.*)\$)#^(\\/nm\\/(?(\\.|-|[a-zA-Z0-9])*:8044)\\/(?(node|conf|logs|stacks|jmx).*)\$)#g' /etc/nginx/nginx.conf fi sudo systemctl restart nginx ``` + **HBase pembuatan tabel di katalog Hive with Glue** - Dari EMR-7.3.0 hingga EMR-7.10.0, ada bug karena integrasi Hive Iceberg, yang menyebabkan HBase pembuatan tabel di Hive gagal saat Glue Data Catalog digunakan sebagai metastore. Silakan hubungi tim AWS dukungan jika Anda mengalami masalah ini. + **Tez UI** - Dari EMR-7.3 ke EMR-7.10, ada bug di mana mengakses UI Tez melalui UI Web Manajer Sumber Daya YARN gagal saat enkripsi dalam transit diaktifkan. Ini terjadi karena proxy YARN mencoba menggunakan protokol HTTP sementara Tez UI memerlukan HTTPS. Harap ubah `tez.tez-ui.history-url.base` konfigurasi `tez-site` dari `http` ke `https` untuk menyelesaikan masalah ini. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Untuk mendukung verifikasi nama host TLS untuk YARN, rilis ini mengubah `yarn.resourcemanager.hostname` konfigurasi dari alamat IP instance utama ke nama DNS pribadi instance utama. + [MXNet proyek](https://github.com/apache/mxnet) telah mencapai akhir kehidupan dan sekarang diarsipkan. [Amazon EMR rilis 7.2.0](emr-720-release.md)adalah rilis terakhir yang mencakup MXNet. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-730-release.html) ## 7.3.0 versi Java default Amazon EMR merilis 7.3 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.3.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 17, 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 17, 11, 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Sqoop | 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 8 | | Pig | 8 | | Zookeeper | 17, 11, 8 | ## 7.3.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.2.0-amzn-0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.12.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.16.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.16.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.33.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.12.0 | EMR S3Select Connector | | emr-wal-cli | 1.3.0 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.64.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.18.1-amzn-2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.18.1-amzn-2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.3.6-amzn-5 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.6-amzn-5 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.6-amzn-5 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.6-amzn-5 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.6-amzn-5 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.6-amzn-5 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.6-amzn-5 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.6-amzn-5 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.6-amzn-5 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.6-amzn-5 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.6-amzn-5 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.17-amzn-7 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.17-amzn-7 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.17-amzn-7 | HBase klien baris perintah. | | hbase-rest-server | 2.4.17-amzn-7 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.17-amzn-7 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.17-amzn-7 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-12 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-12 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-12 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-12 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-12 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-12 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-12 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.15.0-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.15.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.15.0-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.15.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.5.2-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 12.3.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.3 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.285-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.285-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.285-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 442-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 442-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 442-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.1-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 3.5.1-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.1-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.1-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 24.06.1-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.16.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-10 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-10 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.11.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.1-amzn-1 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.1-amzn-1 | ZooKeeper klien baris perintah. | ## 7.3.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.3.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.3.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.3.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2024-10-17 | Publikasi Docs | Catatan rilis Amazon EMR 7.3.0 pertama kali diterbitkan | | 2024-10-16 | Penerapan selesai | [Amazon EMR 7.3.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2024-10-14 | Rilis awal | Amazon EMR 7.3.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.2.0 ## 7.2.0 siklus hidup yang didukung Tabel berikut menjelaskan tanggal siklus hidup yang didukung untuk rilis Amazon EMR 7.2.0. | Fase Support | Date | | --- | --- | | Tanggal rilis awal | Juli 25, 2024 | | Dukungan standar sampai | Juli 24, 2026 | | Akhir dari dukungan | Juli 25, 2026 | | Akhir hidup | Juli 25, 2027 | ## 7.2.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.3.0 | emr-7.2.0 | emr-7.1.0 | emr-7.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.25.70, 1.12.747 | 2.23.18, 1.12.705 | 2.23.18, 1.12.656 | 2.20.160-amzn-0, 1.12.569 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9 | | Skala | 2.12.18 | 2.12.17 | 2.12.17 | 2.12.17 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300031.1-amzn-0 | | Delta | 3.2.0-amzn-0 | 3.1.0 | 3.0.0 | 3.0.0 | | Flink | 1.18.1-amzn-2 | 1.18.1-amzn-1 | 1.18.1-amzn-0 | 1.18.0-amzn-0 | | Ganglia | - | - | - | - | | HBase | 2.4.17-amzn-7 | 2.4.17-amzn-6 | 2.4.17-amzn-5 | 2.4.17-amzn-4 | | HCatalog | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hadoop | 3.3.6-amzn-5 | 3.3.6-amzn-4 | 3.3.6-amzn-3 | 3.3.6-amzn-2 | | Hive | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hudi | 0.15.0-amzn-0 | 0.14.1-amzn-1 | 0.14.1-amzn-0 | 0.14.0-amzn-1 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.5.2-amzn-0 | 1.5.0-amzn-0 | 1.4.3-amzn-0 | 1.4.2-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.7.1-inkubasi | | MXNet | - | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.3 | 5.1.3 | 5.1.3 | 5.1.3 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.285-amzn-1 | 0,285-amzn-0 | 0,284-amzn-0 | 0,283-amzn-1 | | Spark | 3.5.1-amzn-1 | 3.5.1-amzn-0 | 3.5.0-amzn-1 | 3.5.0-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.16.1 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-10 | 0.10.2-amzn-9 | 0.10.2-amzn-8 | 0.10.2-amzn-7 | | Trino (PrestoSQL) | 442-amzn-0 | 436-amzn-0 | 435-amzn-0 | 426-amzn-1 | | Zeppelin | 0.11.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.9.1-amzn-1 | 3.9.1-amzn-1 | 3.9.1-amzn-0 | 3.5.10 | # Rincian komponen rilis 7.2.0 Lihat tabel berikut untuk informasi selengkapnya tentang paket *Ekstra* di Amazon EMR 7.2.0. | Aplikasi | Jenis Aplikasi | Paket | Jenis Package | Versi Package | | --- | --- | --- | --- | --- | | AmazonCloudWatchAgent | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | AmazonCloudWatchAgent | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | s3-dist-cp | Ekstra | 2.32.0-1.amzn2023 | | AmazonCloudWatchAgent | Core | penjaga kebun binatang | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | AmazonCloudWatchAgent | Core | zookeper-server | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Flink | Core | hadop-client | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-km | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-benang | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Flink | Core | hudi | Ekstra | 0.14.1.amzn.1-1.amzn2023 | | Flink | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Flink | Core | hadoop | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | HBase | Core | s3-dist-cp | Ekstra | 2.32.0-1.amzn2023 | | HCatalog | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | HCatalog | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Hive | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Hive | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Hive | Core | hive-hbase | Ekstra | 3.1.3.amzn.11-1.amzn2023 | | Hive | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Hive | Core | s3-dist-cp | Ekstra | 2.32.0-1.amzn2023 | | Phoenix | Core | s3-dist-cp | Ekstra | 2.32.0-1.amzn2023 | | Spark | Core | spark-datanucleus | Ekstra | 3.5.1.amzn.0-1.amzn2023 | | Tez | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Tez | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Tez | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | utilitas besar | Ekstra | 1.2.0-1.amzn2023 | | Trino | Core | hadop-client | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-km | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-benang | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hive | Ekstra | 3.1.3.amzn.11-1.amzn2023 | | Trino | Core | hive-hcatalog-server | Ekstra | 3.1.3.amzn.11-1.amzn2023 | | Trino | Core | mariadb-connector-java | Ekstra | 2.7.2-1 | | Trino | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | | Trino | Core | penjaga kebun binatang | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Trino | Core | zookeper-server | Ekstra | 3.9.1.amzn.1-1.amzn2023 | | Trino | Core | bigtop-groovy | Ekstra | 2.5.4-1.amzn2023 | | Trino | Core | bigtop-jsvc | Ekstra | 1.2.4-1.amzn2023 | | Trino | Core | hadoop | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Trino | Core | hadoop-lzo | Ekstra | 0.4.19-1.amzn2023 | | Trino | Core | hive-hcatalog | Ekstra | 3.1.3.amzn.11-1.amzn2023 | | Trino | Core | sarang-jdbc | Ekstra | 3.1.3.amzn.11-1.amzn2023 | | Zookeeper | Core | emrfs | Ekstra | 2.63.0-1.amzn2023 | | Zookeeper | Core | hadop-client | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-datanode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-journalnode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-hdfs-namenode | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-httpfs | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-km | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-mapreduce-historyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-benang | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-nodemanager | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-proxyserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-resourcemanager | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | hadoop-yarn-timelineserver | Ekstra | 3.3.6.amzn.4-1.amzn2023 | | Zookeeper | Core | ranger-km | Ekstra | 2.0.0-1.amzn2023 | # 7.2.0 kerentanan dan eksposur umum Tabel berikut mencantumkan semua CVEs yang tidak memengaruhi kluster EMR yang berjalan pada konfigurasi Amazon EMR 7.2.0 yang direkomendasikan. Amazon EMR bergantung pada sumber terbuka hulu untuk ketersediaan perbaikan dan akan memberikan versi stabil terbaru sebagai bagian dari komponen Core Engine dalam waktu 90 hari setelah Amazon EMR memverifikasi perbaikan. Tabel ini diperbarui pada 15 September 2024. | ID CVE | Kepelikan | URL detail CVE | | --- | --- | --- | | CVE-2015-1832 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-1832)-2015-1832 | | CVE-2015-4852 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-4852)-2015-4852 | | CVE-2015-7501 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-7501)-2015-7501 | | CVE-2016-5018 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-5018)-2016-5018 | | CVE-2017-1000487 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-1000487)-2017-1000487 | | CVE-2017-12629 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2017-12629](https://nvd.nist.gov/vuln/detail/CVE-2017-12629) | | CVE-2017-15095 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2017-15095 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15095)-2017-15095 | | CVE-2017-17485 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2017-17485 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-17485)-2017-17485 | | CVE-2017-7525 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7525)-2017-7525 | | CVE-2017-7657 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7657)-2017-7657 | | CVE-2017-7658 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7658)-2017-7658 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-11307 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11307)-2018-11307 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14718 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14718)-2018-14718 | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14719 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE-2018-14719](https://nvd.nist.gov/vuln/detail/CVE-2018-14719) | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14720 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14720)-2018-14720 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-14721 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-14721)-2018-14721 | | CVE-2018-17190 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-17190)-2018-17190 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19360 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19360)-2018-19360 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19361 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19361)-2018-19361 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-19362 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-19362)-2018-19362 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2018-7489 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-7489)-2018-7489 | | CVE-2019-10202 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10202)-2019-10202 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14379 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14379)-2019-14379 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14540 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14540)-2019-14540 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14892 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14892)-2019-14892 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-14893 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14893)-2019-14893 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16335 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16335)-2019-16335 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16942 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16942)-2019-16942 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-16943 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16943)-2019-16943 | | CVE-2019-17195 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17195)-2019-17195 | | CVE-2019-17195 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17195)-2019-17195 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17267 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17267)-2019-17267 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-17531 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17531)-2019-17531 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20330 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20330)-2019-20330 | | CVE-2019-20444 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20444)-2019-20444 | | CVE-2019-20444 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20444)-2019-20444 | | CVE-2019-20445 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20445)-2019-20445 | | CVE-2019-20445 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-20445)-2019-20445 | | CVE-2020-7692 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-7692)-2020-7692 | | CVE-2020-7692 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-7692)-2020-7692 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-8840 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-8840)-2020-8840 | | CVE-2020-9480 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9480)-2020-9480 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9546 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9546)-2020-9546 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9547 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9547)-2020-9547 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2020-9548 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9548)-2020-9548 | | CVE-2021-26291 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-26291)-2021-26291 | | CVE-2021-26291 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-26291)-2021-26291 | | CVE-2021-32797 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-32797)-2021-32797 | | CVE-2021-32798 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-32798)-2021-32798 | | CVE-2021-35958 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35958)-2021-35958 | | CVE-2021-37404 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37404)-2021-37404 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-1471 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-1471)-2022-1471 | | CVE-2022-25168 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25168)-2022-25168 | | CVE-2022-26612 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-26612)-2022-26612 | | CVE-2022-32532 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-32532)-2022-32532 | | CVE-2022-33980 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-33980)-2022-33980 | | CVE-2022-37865 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37865)-2022-37865 | | CVE-2022-39135 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-39135)-2022-39135 | | CVE-2022-40664 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40664)-2022-40664 | | CVE-2022-42889 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42889)-2022-42889 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2022-46337 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46337)-2022-46337 | | CVE-2023-38647 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-38647)-2023-38647 | | CVE-2023-38647 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-38647)-2023-38647 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2023-44981 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-44981)-2023-44981 | | CVE-2024-1597 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-1597)-2024-1597 | | CVE-2024-1597 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-1597)-2024-1597 | | CVE-2024-1597 | KRITIS | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-1597)-2024-1597 | | CVE-2012-0881 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-0881)-2012-0881 | | CVE-2012-0881 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2012-0881)-2012-0881 | | CVE-2013-4002 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2013-4002)-2013-4002 | | CVE-2013-4002 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2013-4002)-2013-4002 | | CVE-2014-0114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2014-0114)-2014-0114 | | CVE-2014-0114 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2014-0114)-2014-0114 | | CVE-2015-2080 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-2080)-2015-2080 | | CVE-2015-2156 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-2156)-2015-2156 | | CVE-2015-2156 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-2156)-2015-2156 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2015-5237 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-5237)-2015-5237 | | CVE-2015-6420 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2015-6420)-2015-6420 | | CVE-2016-1000338 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-1000338)-2016-1000338 | | CVE-2016-1000340 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-1000340)-2016-1000340 | | CVE-2016-1000342 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-1000342)-2016-1000342 | | CVE-2016-1000343 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-1000343)-2016-1000343 | | CVE-2016-1000344 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-1000344)-2016-1000344 | | CVE-2016-1000352 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-1000352)-2016-1000352 | | CVE-2016-6796 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2016-6796)-2016-6796 | | CVE-2017-1000034 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-1000034)-2017-1000034 | | CVE-2017-12612 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-12612)-2017-12612 | | CVE-2017-15288 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-15288)-2017-15288 | | CVE-2017-18640 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-18640)-2017-18640 | | CVE-2017-18640 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-18640)-2017-18640 | | CVE-2017-5637 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-5637)-2017-5637 | | CVE-2017-7656 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7656)-2017-7656 | | CVE-2017-7687 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-7687)-2017-7687 | | CVE-2017-9735 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-9735)-2017-9735 | | CVE-2017-9790 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2017-9790)-2017-9790 | | CVE-2018-10054 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10054)-2018-10054 | | CVE-2018-10936 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-10936)-2018-10936 | | CVE-2018-11793 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11793)-2018-11793 | | CVE-2018-11804 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-11804)-2018-11804 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12022 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12022)-2018-12022 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-12023 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-12023)-2018-12023 | | CVE-2018-3258 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-3258)-2018-3258 | | CVE-2018-3827 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2018-3827](https://nvd.nist.gov/vuln/detail/CVE-2018-3827) | | CVE-2018-3831 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-3831)-2018-3831 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2018-5968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-5968)-2018-5968 | | CVE-2018-8012 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-8012)-2018-8012 | | CVE-2018-8768 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2018-8768)-2018-8768 | | CVE-2019-0204 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0204)-2019-0204 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-0205 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-0205)-2019-0205 | | CVE-2019-10086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10086)-2019-10086 | | CVE-2019-10086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10086)-2019-10086 | | CVE-2019-10086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10086)-2019-10086 | | CVE-2019-10086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10086)-2019-10086 | | CVE-2019-10099 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10099)-2019-10099 | | CVE-2019-10172 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-10172)-2019-10172 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-12086 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-12086)-2019-12086 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-14439 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-14439)-2019-14439 | | CVE-2019-16869 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16869)-2019-16869 | | CVE-2019-16869 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-16869)-2019-16869 | | CVE-2019-17566 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17566)-2019-17566 | | CVE-2019-17566 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-17566)-2019-17566 | | CVE-2019-7611 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2019-7611)-2019-7611 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10650 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10650)-2020-10650 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10672 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10672)-2020-10672 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10673 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10673)-2020-10673 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10968 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10968)-2020-10968 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-10969 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-10969)-2020-10969 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11111 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11111)-2020-11111 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11112 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11112)-2020-11112 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11113 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11113)-2020-11113 | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11619 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2020-11619](https://nvd.nist.gov/vuln/detail/CVE-2020-11619) | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11620 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11620)-2020-11620 | | CVE-2020-11988 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-11988)-2020-11988 | | CVE-2020-13692 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13692)-2020-13692 | | CVE-2020-13936 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13936)-2020-13936 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-13949 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-13949)-2020-13949 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14060 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14060)-2020-14060 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14061 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14061)-2020-14061 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14062 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14062)-2020-14062 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-14195 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-14195)-2020-14195 | | CVE-2020-17533 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-17533)-2020-17533 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24616 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24616)-2020-24616 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-24750 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-24750)-2020-24750 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-25649 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-25649)-2020-25649 | | CVE-2020-28491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-28491)-2020-28491 | | CVE-2020-35211 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35211)-2020-35211 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35490 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35490)-2020-35490 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35491 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35491)-2020-35491 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-35728 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-35728)-2020-35728 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36179 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36179)-2020-36179 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36180 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36180)-2020-36180 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36181 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36181)-2020-36181 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36182 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36182)-2020-36182 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36183 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36183)-2020-36183 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36184 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36184)-2020-36184 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36185 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36185)-2020-36185 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36186 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36186)-2020-36186 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36187 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36187)-2020-36187 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36188 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36188)-2020-36188 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36189 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36189)-2020-36189 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-36518 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-36518)-2020-36518 | | CVE-2020-9492 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2020-9492)-2020-9492 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-20190 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-20190)-2021-20190 | | CVE-2021-22573 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22573)-2021-22573 | | CVE-2021-22573 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22573)-2021-22573 | | CVE-2021-22573 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-22573)-2021-22573 | | CVE-2021-25646 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-25646)-2021-25646 | | CVE-2021-26919 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2021-26919](https://nvd.nist.gov/vuln/detail/CVE-2021-26919) | | CVE-2021-28165 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-28165)-2021-28165 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-31684 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-31684)-2021-31684 | | CVE-2021-33036 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-33036)-2021-33036 | | CVE-2021-33813 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-33813)-2021-33813 | | CVE-2021-33813 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-33813)-2021-33813 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-34538 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-34538)-2021-34538 | | CVE-2021-35515 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35515)-2021-35515 | | CVE-2021-35515 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35515)-2021-35515 | | CVE-2021-35515 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35515)-2021-35515 | | CVE-2021-35515 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35515)-2021-35515 | | CVE-2021-35515 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35515)-2021-35515 | | CVE-2021-35515 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35515)-2021-35515 | | CVE-2021-35515 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35515)-2021-35515 | | CVE-2021-35516 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35516)-2021-35516 | | CVE-2021-35516 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35516)-2021-35516 | | CVE-2021-35516 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35516)-2021-35516 | | CVE-2021-35516 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35516)-2021-35516 | | CVE-2021-35516 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35516)-2021-35516 | | CVE-2021-35516 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35516)-2021-35516 | | CVE-2021-35516 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35516)-2021-35516 | | CVE-2021-35517 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35517)-2021-35517 | | CVE-2021-35517 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35517)-2021-35517 | | CVE-2021-35517 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35517)-2021-35517 | | CVE-2021-35517 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35517)-2021-35517 | | CVE-2021-35517 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-35517)-2021-35517 | | CVE-2021-36090 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36090)-2021-36090 | | CVE-2021-36090 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36090)-2021-36090 | | CVE-2021-36090 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36090)-2021-36090 | | CVE-2021-36090 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36090)-2021-36090 | | CVE-2021-36090 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-36090)-2021-36090 | | CVE-2021-37136 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37136)-2021-37136 | | CVE-2021-37136 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37136)-2021-37136 | | CVE-2021-37137 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37137)-2021-37137 | | CVE-2021-37137 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37137)-2021-37137 | | CVE-2021-37714 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37714)-2021-37714 | | CVE-2021-37714 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37714)-2021-37714 | | CVE-2021-37714 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37714)-2021-37714 | | CVE-2021-37714 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-37714)-2021-37714 | | CVE-2021-46877 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2021-46877)-2021-46877 | | CVE-2022-24758 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-24758)-2022-24758 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25647 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25647)-2022-25647 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-25857 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-25857)-2022-25857 | | CVE-2022-31197 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-31197)-2022-31197 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-3171 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3171)-2022-3171 | | CVE-2022-34169 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-34169)-2022-34169 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3509 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3509)-2022-3509 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-3510 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-3510)-2022-3510 | | CVE-2022-36364 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-36364)-2022-36364 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-37866 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-37866)-2022-37866 | | CVE-2022-40146 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40146)-2022-40146 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40149 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40149)-2022-40149 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40150 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40150)-2022-40150 | | CVE-2022-40152 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40152)-2022-40152 | | CVE-2022-40152 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-40152)-2022-40152 | | CVE-2022-41704 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-41704)-2022-41704 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42003 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42003)-2022-42003 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-42004 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42004)-2022-42004 | | CVE-2022-4244 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-4244)-2022-4244 | | CVE-2022-42890 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-42890)-2022-42890 | | CVE-2022-44729 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2022-44729](https://nvd.nist.gov/vuln/detail/CVE-2022-44729) | | CVE-2022-44729 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2022-44729](https://nvd.nist.gov/vuln/detail/CVE-2022-44729) | | CVE-2022-44729 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE-2022-44729](https://nvd.nist.gov/vuln/detail/CVE-2022-44729) | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45685 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45685)-2022-45685 | | CVE-2022-45688 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45688)-2022-45688 | | CVE-2022-45688 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45688)-2022-45688 | | CVE-2022-45688 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45688)-2022-45688 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-45693 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-45693)-2022-45693 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2022-46751 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2022-46751)-2022-46751 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1370 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1370)-2023-1370 | | CVE-2023-1428 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1428)-2023-1428 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-1436 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-1436)-2023-1436 | | CVE-2023-20883 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-20883)-2023-20883 | | CVE-2023-24580 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-24580)-2023-24580 | | CVE-2023-25194 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-25194)-2023-25194 | | CVE-2023-25194 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-25194)-2023-25194 | | CVE-2023-25194 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-25194)-2023-25194 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-2976 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-2976)-2023-2976 | | CVE-2023-31418 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-31418)-2023-31418 | | CVE-2023-32731 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-32731)-2023-32731 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34453 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34453)-2023-34453 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-34454 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34454)-2023-34454 | | CVE-2023-34455 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-34455 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-34455 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-34455 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-34455 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34455)-2023-34455 | | CVE-2023-34610 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-34610)-2023-34610 | | CVE-2023-36053 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-36053)-2023-36053 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-3635 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-3635)-2023-3635 | | CVE-2023-36478 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-36478)-2023-36478 | | CVE-2023-36478 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-36478)-2023-36478 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-39410 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-39410)-2023-39410 | | CVE-2023-41164 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-41164)-2023-41164 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-43642 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43642)-2023-43642 | | CVE-2023-43665 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-43665)-2023-43665 | | CVE-2023-46120 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-46120)-2023-46120 | | CVE-2023-46695 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-46695)-2023-46695 | | CVE-2023-4759 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-4759)-2023-4759 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-5072 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-5072)-2023-5072 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6378 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6378)-2023-6378 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2023-6481 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2023-6481)-2023-6481 | | CVE-2024-21634 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-21634)-2024-21634 | | CVE-2024-24680 | TINGGI | [https://nvd.nist. gov/vuln/detail/CVE](https://nvd.nist.gov/vuln/detail/CVE-2024-24680)-2024-24680 | ## Catatan rilis 7.2.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.2.0. Perubahan relatif terhadap 7.2.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.2.0 application upgrades include Iceberg 1.5.0-amzn-0 and Delta 3.1.0. + Amazon EMR menambahkan dukungan sehingga Anda dapat menggunakan aplikasi lain seperti HBase, Flink, dan Hive dengan kelas penyimpanan Amazon S3 Express One Zone. + Rilis ini menambahkan kemampuan untuk membaca objek yang dipulihkan, sehingga Anda dapat membaca objek Glacier dari lokasi S3 dengan protokol. `S3A` Kemampuan ini bekerja dengan Spark, Flink, dan Hive. + Label node dengan penskalaan terkelola - Gunakan label node dengan instance Anda berdasarkan tipe pasar atau tipe node untuk meningkatkan penskalaan otomatis dari Amazon EMR. Untuk informasi selengkapnya, lihat [Menggunakan penskalaan terkelola di Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-scaling.html). **Masalah yang diketahui** + Python 3.11 tidak didukung dengan EMR Studio. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Rilis ini memperbaiki masalah dalam skrip instance-state on-cluster yang memantau kesehatan instance yang menghabiskan CPU dan sumber daya memori yang berlebihan ketika ada sejumlah besar utas and/or yang membuka pegangan file pada node. + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Rilis ini memperbaiki masalah kebuntuan yang dapat terjadi selama operasi pembersihan langkah internal. Operasi ini mengelola siklus hidup langkah-langkah saat mereka menyelesaikan pada cluster EMR. Masalah ini memengaruhi operasi EMR Amazon yang kritis, seperti operasi langkah dan penskalaan. + Rilis ini menyelesaikan masalah di mana cluster khusus dengan kustom AMIs yang memiliki file log tertentu yang sudah ada sebelumnya dapat menyebabkan daemon manajemen log EMR Amazon gagal. + Amazon EMR 7.2.0 memutakhirkan daemon EMR Amazon yang bertanggung jawab atas pengelolaan klaster dan aktivitas pemantauan dari SDK v1 ke v2. AWS + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-720-release.html) ## 7.2.0 versi Java default Amazon EMR merilis 7.2 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.2.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Sqoop | 8 | | Tez | 17, 11, 8 | | Trino | 21, 17 | | Zeppelin | 8 | | Pig | 8 | | Zookeeper | 8 | ## 7.2.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.1.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.4.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.11.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.15.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.16.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.32.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.11.0 | EMR S3Select Connector | | emr-wal-cli | 1.2.2 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.63.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.18.1-amzn-1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.18.1-amzn-1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.3.6-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.6-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.6-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.6-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.6-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.6-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.6-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.6-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.6-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.6-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.6-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.17-amzn-6 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.17-amzn-6 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.17-amzn-6 | HBase klien baris perintah. | | hbase-rest-server | 2.4.17-amzn-6 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.17-amzn-6 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.17-amzn-6 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-11 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-11 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-11 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-11 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-11 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-11 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-11 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.14.1-amzn-1 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.14.1-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.14.1-amzn-1 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.14.1-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.5.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.3 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.3 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,285-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,285-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,285-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 436-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 436-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 436-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.1-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.5.1-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.1-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.1-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 24.02.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-9 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-9 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.1-amzn-1 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.1-amzn-1 | ZooKeeper klien baris perintah. | ## 7.2.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.2.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.2.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.2.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-09-03 | Revisi dokumen | Catatan rilis Amazon EMR 7.2.0 ditambahkan | | 2024-07-25 | Publikasi Docs | Catatan rilis Amazon EMR 7.2.0 pertama kali diterbitkan | | 2024-07-16 | Rilis awal | Amazon EMR 7.2.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.1.0 ## 7.1.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.3.0 | emr-7.2.0 | emr-7.1.0 | emr-7.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.25.70, 1.12.747 | 2.23.18, 1.12.705 | 2.23.18, 1.12.656 | 2.20.160-amzn-0, 1.12.569 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9 | | Skala | 2.12.18 | 2.12.17 | 2.12.17 | 2.12.17 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300031.1-amzn-0 | | Delta | 3.2.0-amzn-0 | 3.1.0 | 3.0.0 | 3.0.0 | | Flink | 1.18.1-amzn-2 | 1.18.1-amzn-1 | 1.18.1-amzn-0 | 1.18.0-amzn-0 | | Ganglia | - | - | - | - | | HBase | 2.4.17-amzn-7 | 2.4.17-amzn-6 | 2.4.17-amzn-5 | 2.4.17-amzn-4 | | HCatalog | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hadoop | 3.3.6-amzn-5 | 3.3.6-amzn-4 | 3.3.6-amzn-3 | 3.3.6-amzn-2 | | Hive | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hudi | 0.15.0-amzn-0 | 0.14.1-amzn-1 | 0.14.1-amzn-0 | 0.14.0-amzn-1 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.5.2-amzn-0 | 1.5.0-amzn-0 | 1.4.3-amzn-0 | 1.4.2-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.7.1-inkubasi | | MXNet | - | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.3 | 5.1.3 | 5.1.3 | 5.1.3 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.285-amzn-1 | 0,285-amzn-0 | 0,284-amzn-0 | 0,283-amzn-1 | | Spark | 3.5.1-amzn-1 | 3.5.1-amzn-0 | 3.5.0-amzn-1 | 3.5.0-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.16.1 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-10 | 0.10.2-amzn-9 | 0.10.2-amzn-8 | 0.10.2-amzn-7 | | Trino (PrestoSQL) | 442-amzn-0 | 436-amzn-0 | 435-amzn-0 | 426-amzn-1 | | Zeppelin | 0.11.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.9.1-amzn-1 | 3.9.1-amzn-1 | 3.9.1-amzn-0 | 3.5.10 | ## Catatan rilis 7.1.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.1.0. Perubahan relatif terhadap 7.1.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.1.0 application upgrades include Livy 0.8.0, Trino 435, and ZooKeeper 3.9.1. + [https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-node-replacement.html](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-node-replacement.html) - Dengan Amazon EMR 7.1.0 dan yang lebih tinggi, penggantian node yang tidak sehat diaktifkan secara default, sehingga Amazon EMR akan dengan anggun mengganti node Anda yang tidak sehat. Agar tidak memengaruhi alur kerja yang ada di Amazon EMR rilis 7.0.0 dan yang lebih rendah, penggantian node yang tidak sehat dinonaktifkan jika Anda mengaktifkan perlindungan penghentian di klaster. + [https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-AmazonCloudWatchAgent.html](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-AmazonCloudWatchAgent.html) — Konfigurasikan CloudWatch agen untuk menggunakan metrik sistem tambahan, menambahkan metrik aplikasi, dan mengubah tujuan metrik dengan API konfigurasi Amazon EMR. **Masalah yang diketahui** + Aplikasi JupyterEnterpriseGateway (JEG) tidak mendukung Python 3.11 dalam rilis ini. + Skrip instance-state on-cluster yang memantau kesehatan instance dapat mengkonsumsi CPU dan sumber daya memori yang berlebihan ketika ada sejumlah besar thread yang and/or membuka pegangan file pada node. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Sementara Amazon EMR 7.1.0 mendukung Python 3.9 secara default, Livy 0.8.0 dan Spark di Amazon EMR 7.1.0 mendukung Python 3.11. + Rilis ini memperbaiki masalah kebutuhan untuk menjalankan setiap baris satu per satu saat menggunakan dengan PySpark Python versi 3.11. + Peningkatan **Zeppelin -** Amazon EMR 7.1.0 menyertakan peningkatan Zeppelin ke SDK for Java v2. AWS Upgrade ini memungkinkan Notebook Zeppelin S3 untuk menerima penyedia bahan enkripsi kustom. AWS SDK for Java v2 menghapus antarmuka EncryptionMaterialsProvider . Saat Anda meningkatkan ke Amazon EMR 7.1.0, Anda harus menerapkan [antarmuka Keyring](https://github.com/aws/amazon-s3-encryption-client-java/blob/main/src/main/java/software/amazon/encryption/s3/materials/Keyring.java) jika Anda ingin menggunakan enkripsi khusus. Untuk contoh cara mengimplementasikan antarmuka Keyring, lihat [ KmsKeyring.java.](https://github.com/aws/amazon-s3-encryption-client-java/blob/a5d714fe27f97793997e41745939ef7da8a22167/src/main/java/software/amazon/encryption/s3/materials/KmsKeyring.java#L36) + Saat memutakhirkan ke Amazon EMR rilis 7.1.0, ubah penyedia kunci kustom Anda untuk enkripsi disk lokal untuk menghasilkan kunci menggunakan algoritme AES. AES/GCM/NoPadding Jika Anda tidak memperbarui algoritme, pembuatan klaster mungkin gagal dengan kesalahan `Local disk encryption failed on master instance (i-123456789) due to internal error.` Untuk informasi selengkapnya tentang membuat penyedia kunci kustom, lihat [Membuat penyedia kunci kustom](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-encryption-enable.html#emr-custom-keys). + Amazon EMR 7.1.0 meningkatkan ketahanan node di bawah kondisi ruang disk rendah dengan meningkatkan logika pemotongan log untuk file dengan pegangan file terbuka. + Rilis ini meningkatkan logika encoding dan decoding untuk meminimalkan risiko korupsi data dan kegagalan node dengan daemon Amazon EMR membaca dan menulis file saat memulai ulang node. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-710-release.html) ## 7.1.0 versi Java default Amazon EMR merilis 7.1 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.1.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 17, 11, 8 | | HBase | 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Sqoop | 8 | | Tez | 17, 11, 8 | | Trino | 17 | | Zeppelin | 8 | | Pig | 8 | | Zookeeper | 8 | ## 7.1.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.0.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-amazon-cloudwatch-agent | 1.300032.2-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.10.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.14.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.31.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.10.0 | EMR S3Select Connector | | emr-wal-cli | 1.2.2 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.62.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.18.1-amzn-0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.18.1-amzn-0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.3.6-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.6-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.6-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.6-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.6-amzn-3 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.6-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.6-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.6-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.6-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.6-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.6-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.17-amzn-5 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.17-amzn-5 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.17-amzn-5 | HBase klien baris perintah. | | hbase-rest-server | 2.4.17-amzn-5 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.17-amzn-5 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.17-amzn-5 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-10 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-10 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-10 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-10 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-10 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-10 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-10 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.14.1-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.14.1-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.14.1-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.14.1-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.4.3-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.8.0-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.3 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.3 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,284-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,284-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,284-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 435-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 435-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 435-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.0-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 3.5.0-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.0-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.0-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 23.10.0-amzn-1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-8 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-8 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.9.1-amzn-0 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.9.1-amzn-0 | ZooKeeper klien baris perintah. | ## 7.1.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.1.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-logback | Ubah nilai dalam ZooKeeper file logback.xml. | Restarts Zookeeper server. | | emr-metrics | Ubah pengaturan metrik emr untuk simpul ini. | Restarts the CloudWatchAgent service. | ## 7.1.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.1.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-09-03 | Revisi dokumen | Catatan rilis Amazon EMR 7.1.0 menambahkan masalah yang diketahui | | 2024-05-10 | Publikasi Docs | Amazon EMR 7.1.0 catatan rilis pertama kali diterbitkan | | 2024-05-10 | Publikasi Docs | Amazon EMR 7.1.0 catatan rilis pertama kali diterbitkan | | 2024-05-08 | Penerapan selesai | [Amazon EMR 7.1.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2024-04-23 | Rilis awal | Amazon EMR 7.1.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 7.0.0 ## 7.0.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html](https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/Install-CloudWatch-Agent.html), [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-7.3.0 | emr-7.2.0 | emr-7.1.0 | emr-7.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.25.70, 1.12.747 | 2.23.18, 1.12.705 | 2.23.18, 1.12.656 | 2.20.160-amzn-0, 1.12.569 | | Python | 3.9, 3.11 | 3.9, 3.11 | 3.9, 3.11 | 3.9 | | Skala | 2.12.18 | 2.12.17 | 2.12.17 | 2.12.17 | | AmazonCloudWatchAgent | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300032.2-amzn-0 | 1.300031.1-amzn-0 | | Delta | 3.2.0-amzn-0 | 3.1.0 | 3.0.0 | 3.0.0 | | Flink | 1.18.1-amzn-2 | 1.18.1-amzn-1 | 1.18.1-amzn-0 | 1.18.0-amzn-0 | | Ganglia | - | - | - | - | | HBase | 2.4.17-amzn-7 | 2.4.17-amzn-6 | 2.4.17-amzn-5 | 2.4.17-amzn-4 | | HCatalog | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hadoop | 3.3.6-amzn-5 | 3.3.6-amzn-4 | 3.3.6-amzn-3 | 3.3.6-amzn-2 | | Hive | 3.1.3-amzn-12 | 3.1.3-amzn-11 | 3.1.3-amzn-10 | 3.1.3-amzn-9 | | Hudi | 0.15.0-amzn-0 | 0.14.1-amzn-1 | 0.14.1-amzn-0 | 0.14.0-amzn-1 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.5.2-amzn-0 | 1.5.0-amzn-0 | 1.4.3-amzn-0 | 1.4.2-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.5.0 | | Livy | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.8.0-inkubasi | 0.7.1-inkubasi | | MXNet | - | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.3 | 5.1.3 | 5.1.3 | 5.1.3 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.285-amzn-1 | 0,285-amzn-0 | 0,284-amzn-0 | 0,283-amzn-1 | | Spark | 3.5.1-amzn-1 | 3.5.1-amzn-0 | 3.5.0-amzn-1 | 3.5.0-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.16.1 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-10 | 0.10.2-amzn-9 | 0.10.2-amzn-8 | 0.10.2-amzn-7 | | Trino (PrestoSQL) | 442-amzn-0 | 436-amzn-0 | 435-amzn-0 | 426-amzn-1 | | Zeppelin | 0.11.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.9.1-amzn-1 | 3.9.1-amzn-1 | 3.9.1-amzn-0 | 3.5.10 | ## Catatan rilis 7.0.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 7.0.0. Perubahan relatif terhadap 6.15.0. **Fitur baru** + **Upgrade aplikasi** —Amazon EMR 7.0.0 application upgrades include Python 3.9, Spark 3.5, Flink 1.18, and Delta 3.0. Rilis ini juga menambahkan dukungan untuk [CloudWatch Agen Amazon](emr-AmazonCloudWatchAgent.md) aplikasi dan menghapus dukungan untuk Ganglia. + **Amazon Corretto 17** - Amazon EMR merilis 7.0 dan kapal yang lebih tinggi dengan Amazon Corretto 17 (dibangun di OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Untuk informasi selengkapnya tentang versi JDK yang didukung untuk aplikasi dalam rilis ini, lihat. [7.0.0 versi Java default](#emr-700-jdk) + **Amazon Linux 2023** - Dengan rilis 7.0, kluster EMR Amazon sekarang berjalan secara default. AL2023 Untuk informasi tentang bagaimana hal ini memengaruhi versi AMI default, lihat [Pertimbangan pembaruan perangkat lunak](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html#emr-default-ami-managing) di Panduan Manajemen *EMR Amazon*. Perhatikan juga bahwa Python 2.7 AL2023 dihapus, sehingga setiap komponen yang memerlukan Python sekarang harus ditulis dengan Python 3. + **S3 di Outposts** dengan `s3a` - Amazon EMR sekarang mendukung Amazon S3 pada bucket Outposts dengan sistem file. `s3a` Untuk informasi lebih lanjut tentang S3 di Outposts, [lihat Apa itu S3](https://docs.aws.amazon.com/AmazonS3/latest/userguide/S3onOutposts.html) di Outposts? di *Panduan Pengguna Layanan Penyimpanan Sederhana Amazon*. **Masalah yang diketahui** + Perhatikan bahwa Anda tidak dapat menjalankan lebih dari satu baris pada satu waktu jika Anda menggunakan PySpark dengan Python versi 3.10 atau yang lebih baru. Anda harus menjalankan setiap baris satu per satu. + Skrip instance-state on-cluster yang memantau kesehatan instance dapat mengkonsumsi CPU dan sumber daya memori yang berlebihan ketika ada sejumlah besar thread yang and/or membuka pegangan file pada node. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Untuk mempertahankan status semua instance dalam sebuah cluster, Amazon EMR terintegrasi dengan Apache YARN, Apache HDFS, dan Kerberos. Dengan 7.0, kami meningkatkan integrasi ini untuk menghapus status instance yang dihentikan secara andal karena penskalaan atau operasi lainnya. Ini sangat penting untuk cluster berumur panjang yang telah mengelola penskalaan yang diaktifkan, karena mereka sering menskalakan dan mengumpulkan ribuan instance yang dihentikan selama masa hidup mereka. + Rilis ini meningkatkan konfigurasi Kerberos untuk hanya menyertakan dukungan untuk cipher berbasis AES. Kerberos KDC dengan cipher berbasis non-AES tidak lagi didukung dengan kluster EMR yang berjalan di Amazon EMR rilis 7.0.0 dan yang lebih tinggi. Cipher berbasis AES menawarkan keamanan terkuat untuk cluster Anda. + Sebagai bagian dari migrasi AWS SDK 2.x, Amazon EMR 7.0 menyertakan pembaruan ke konektor Spark Kinesis untuk kompatibilitas. Pembaruan ini tidak tersedia di versi komunitas Apache Spark. Jika Anda menggunakan konektor Spark Kinesis dari rilis EMR Amazon yang lebih rendah dari 7.0, Anda harus memigrasikan kode aplikasi agar berjalan di SDK 2.x sebelum dapat memigrasikan beban kerja ke Amazon EMR 7.0. Untuk informasi selengkapnya, lihat [Migrasi konektor Spark Kinesis ke SDK 2.x untuk Amazon EMR 7.0](migrating-spark-kinesis.md). + `aws-sagemaker-spark-sdk`Komponen ini tidak tersedia dari Amazon EMR 7.x dan seterusnya. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-700-release.html) ## 7.0.0 versi Java default Amazon EMR merilis 7.0 dan lebih tinggi dikirimkan dengan Amazon Corretto 17 (dibangun di atas OpenJDK) secara default untuk aplikasi yang mendukung Corretto 17 (JDK 17), dengan pengecualian Apache Livy. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 7.0.0. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 11, 8 | | HBase | 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Sqoop | 8 | | Tez | 17, 11, 8 | | Trino | 17 | | Zeppelin | 8 | | Pig | 8 | | Zookeeper | 8 | ## 7.0.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | adot-java-agent | 1.31.0 | Agen Java yang mengumpulkan metrik dari daemon aplikasi. | | delta | 3.0.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | delta-standalone-connectors | 0.6.0 | Delta Connectors menyediakan runtime yang berbeda untuk mengintegrasikan Delta Lake dengan mesin seperti Flink, Hive dan Presto. | | emr-amazon-cloudwatch-agent | 1.300031.1-amzn-0 | Aplikasi yang mengumpulkan metrik tingkat sistem internal dan metrik aplikasi khusus dari instans Amazon EC2. | | emr-ddb | 5.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.9.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.13.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.30.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.9.0 | EMR S3Select Connector | | emr-wal-cli | 1.2.1 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.61.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.18.0-amzn-0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.18.0-amzn-0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | hadoop-client | 3.3.6-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.6-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.6-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.6-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.6-amzn-2 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.6-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.6-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.6-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.6-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.6-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.6-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.17-amzn-4 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.17-amzn-4 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.17-amzn-4 | HBase klien baris perintah. | | hbase-rest-server | 2.4.17-amzn-4 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.17-amzn-4 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.17-amzn-4 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-9 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-9 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-9 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-9 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-9 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-9 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-9 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.14.0-amzn-1 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.14.0-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.14.0-amzn-1 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.14.0-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.4.2-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.3 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.3 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,283-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,283-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,283-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 426-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 426-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 426-amzn-1 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.3.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.5.0-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.5.0-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.5.0-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.5.0-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 23.10.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-7 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-7 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | webserver | 2.4.58 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 7.0.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-7.0.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 7.0.0 perubahan log **Ubah log untuk catatan rilis dan rilis 7.0.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-09-03 | Revisi dokumen | Catatan rilis Amazon EMR 7.0.0 menambahkan masalah yang diketahui | | 2023-12-29 | Penerapan selesai | [Amazon EMR 7.0.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-12-28 | Publikasi Docs | Amazon EMR 7.0.0 catatan rilis pertama kali diterbitkan | | 2023-12-19 | Rilis awal | Amazon EMR 7.0.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR versi rilis 6.x Bagian ini berisi versi aplikasi, catatan rilis, versi komponen, dan klasifikasi konfigurasi yang tersedia di setiap versi rilis Amazon EMR 6.x. Saat meluncurkan klaster, Anda dapat memilih dari beberapa rilis Amazon EMR. Ini memungkinkan Anda untuk menguji dan menggunakan versi aplikasi yang sesuai dengan kebutuhan kompatibilitas Anda. Anda menentukan nomor rilis dengan *label rilis*. Label rilis ada dalam bentuk`emr-x.x.x`. Misalnya, `emr-7.12.0`. Rilis EMR Amazon baru tersedia di berbagai Wilayah selama beberapa hari, dimulai dengan Wilayah pertama pada tanggal rilis awal. Versi rilis terbaru mungkin tidak tersedia di Wilayah Anda selama periode ini. Untuk tabel lengkap versi aplikasi di setiap rilis Amazon EMR 6.x, lihat. [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) **Topics** + [ # Versi aplikasi di Amazon EMR 6.x rilis ](emr-release-app-versions-6.x.md) + [ # Amazon EMR rilis 6.15.0 ](emr-6150-release.md) + [ # Amazon EMR rilis 6.14.0 ](emr-6140-release.md) + [ # Amazon EMR rilis 6.13.0 ](emr-6130-release.md) + [ # Amazon EMR rilis 6.12.0 ](emr-6120-release.md) + [ # Amazon EMR rilis 6.11.1 ](emr-6111-release.md) + [ # Amazon EMR rilis 6.11.0 ](emr-6110-release.md) + [ # Amazon EMR rilis 6.10.1 ](emr-6101-release.md) + [ # Amazon EMR rilis 6.10.0 ](emr-6100-release.md) + [ # Amazon EMR rilis 6.9.1 ](emr-691-release.md) + [ # Amazon EMR rilis 6.9.0 ](emr-690-release.md) + [ # Amazon EMR rilis 6.8.1 ](emr-681-release.md) + [ # Amazon EMR rilis 6.8.0 ](emr-680-release.md) + [ # Amazon EMR rilis 6.7.0 ](emr-670-release.md) + [ # Amazon EMR rilis 6.6.0 ](emr-660-release.md) + [ # Amazon EMR rilis 6.5.0 ](emr-650-release.md) + [ # Amazon EMR rilis 6.4.0 ](emr-640-release.md) + [ # Amazon EMR rilis 6.3.1 ](emr-631-release.md) + [ # Amazon EMR Rilis 6.3.0 ](emr-630-release.md) + [ # Amazon EMR rilis 6.2.1 ](emr-621-release.md) + [ # Amazon EMR rilis 6.2.0 ](emr-620-release.md) + [ # Amazon EMR rilis 6.1.1 ](emr-611-release.md) + [ # Amazon EMR Rilis 6.1.0 ](emr-610-release.md) + [ # Amazon EMR rilis 6.0.1 ](emr-601-release.md) + [ # Amazon EMR Rilis 6.0.0 ](emr-600-release.md) # Versi aplikasi di Amazon EMR 6.x rilis Tabel berikut mencantumkan versi aplikasi yang tersedia di setiap rilis Amazon EMR 6.x. **Informasi versi aplikasi** | | emr-6.15.0 | emr-6.14.0 | emr-6.13.0 | emr-6.12.0 | emr-6.11.1 | emr-6.11.0 | emr-6.10.1 | emr-6.10.0 | emr-6.9.1 | emr-6.9.0 | emr-6.8.1 | emr-6.8.0 | emr-6.7.0 | emr-6.6.0 | emr-6.5.0 | emr-6.4.0 | emr-6.3.1 | emr-6.3.0 | emr-6.2.1 | emr-6.2.0 | emr-6.1.1 | emr-6.1.0 | emr-6.0.1 | emr-6.0.0 | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.20.160-amzn-0, 1.12.569 | 1.12.543 | 1.12.513 | 1.12.490 | 1.12.446 | 1.12.446 | 1.12.397 | 1.12.397 | 1.12.170 | 1.12.170 | 1.12.170 | 1.12.170 | 1.12.170 | 1.12.170 | 1.12.31 | 1.12.31 | 1.11.977 | 1.11.977 | 1.11.880 | 1.11.880 | 1.11.828 | 1.11.828 | 1.11.711 | 1.11.711 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Delta | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.1.0 | 2.1.0 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Flink | 1.17.1-amzn-1 | 1.17.1-amzn-0 | 1.17.0 | 1.17.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | 1.15.2 | 1.15.2 | 1.15.1 | 1.15.1 | 1.14.2 | 1.14.2 | 1.14.0 | 1.13.1 | 1.12.1 | 1.12.1 | 1.11.2 | 1.11.2 | 1.11.0 | 1.11.0 | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.17-amzn-3 | 2.4.17-amzn-2 | 2.4.17-amzn-1 | 2.4.17-amzn-0 | 2.4.15-amzn-1.1 | 2.4.15-amzn-1 | 2.4.15-amzn-0.1 | 2.4.15-amzn-0 | 2.4.13-amzn-0.1 | 2.4.13-amzn-0 | 2.4.12-amzn-0.1 | 2.4.12-amzn-0 | 2.4.4-amzn-3 | 2.4.4-amzn-2 | 2.4.4-amzn-1 | 2.4.4-amzn-0 | 2.2.6-amzn-1 | 2.2.6-amzn-1 | 2.2.6-amzn-0 | 2.2.6-amzn-0 | 2.2.5 | 2.2.5 | 2.2.3 | 2.2.3 | | HCatalog | 3.1.3-amzn-8 | 3.1.3-amzn-7 | 3.1.3-amzn-6 | 3.1.3-amzn-5 | 3.1.3-amzn-4.1 | 3.1.3-amzn-4 | 3.1.3-amzn-3.1 | 3.1.3-amzn-3 | 3.1.3-amzn-2.1 | 3.1.3-amzn-2 | 3.1.3-amzn-1.1 | 3.1.3-amzn-1 | 3.1.3-amzn-0 | 3.1.2-amzn-7 | 3.1.2-amzn-6 | 3.1.2-amzn-5 | 3.1.2-amzn-4 | 3.1.2-amzn-4 | Versi 3.1.2 amzn-3 | Versi 3.1.2 amzn-3 | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hadoop | 3.3.6-amzn-1 | 3.3.3-amzn-6 | 3.3.3-amzn-5 | 3.3.3-amzn-4 | 3.3.3-amzn-3.1 | 3.3.3-amzn-3 | 3.3.3-amzn-2.1 | 3.3.3-amzn-2 | 3.3.3-amzn-1.1 | 3.3.3-amzn-1 | 3.2.1-amzn-8.1 | 3.2.1-amzn-8 | 3.2.1-amzn-7 | 3.2.1-amzn-6 | 3.2.1-amzn-5 | 3.2.1-amzn-4 | 3.2.1-amzn-3.1 | 3.2.1-amzn-3 | 3.2.1-amzn-2.1 | 3.2.1-amzn-2 | 3.2.1-amzn-1.1 | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0.1 | 3.2.1-amzn-0 | | Hive | 3.1.3-amzn-8 | 3.1.3-amzn-7 | 3.1.3-amzn-6 | 3.1.3-amzn-5 | 3.1.3-amzn-4.1 | 3.1.3-amzn-4 | 3.1.3-amzn-3.1 | 3.1.3-amzn-3 | 3.1.3-amzn-2.1 | 3.1.3-amzn-2 | 3.1.3-amzn-1.1 | 3.1.3-amzn-1 | 3.1.3-amzn-0 | 3.1.2-amzn-7 | 3.1.2-amzn-6 | 3.1.2-amzn-5 | 3.1.2-amzn-4 | 3.1.2-amzn-4 | Versi 3.1.2 amzn-3 | Versi 3.1.2 amzn-3 | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hudi | 0.14.0-amzn-0 | 0.13.1-amzn-2 | 0.13.1-amzn-1 | 0.13.1-amzn-0 | 0.13.0-amzn-0 | 0.13.0-amzn-0 | 0.12.2-amzn-0 | 0.12.2-amzn-0 | 0.12.1-amzn-0 | 0.12.1-amzn-0 | 0.11.1-amzn-0 | 0.11.1-amzn-0 | 0.11.0-amzn-0 | 0.10.1-amzn-0 | 0.9.0-amzn-1 | 0.8.0-amzn-0 | 0.7.0-amzn-0 | 0.7.0-amzn-0 | 0.6.0-amzn-1 | 0.6.0-amzn-1 | 0.5.2-incubating-amzn-2 | 0.5.2-incubating-amzn-2 | 0.5.0-incubating-amzn-1 | 0.5.0-incubating-amzn-1 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | 4.9.0 | 4.9.0 | 4.9.0 | 4.9.0 | 4.8.0 | 4.8.0 | 4.7.1 | 4.7.1 | 4.4.0 | 4.4.0 | | Iceberg | 1.4.0-amzn-0 | 1.3.1-amzn-0 | 1.3.0-amzn-1 | 1.3.0-amzn-0 | 1.2.0-amzn-0 | 1.2.0-amzn-0 | 1.1.0-amzn-0 | 1.1.0-amzn-0 | 0.14.1-amzn-0 | 0.14.1-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.13.1-amzn-0 | 0.13.1 | 0.12.0 | - | - | - | - | - | - | - | - | - | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | - | - | - | - | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.4.1 | 1.4.1 | 1.4.1 | 1.5.0 | 1.5.0 | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | 1.2.2 | 1.2.2 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.0.0 | 1.0.0 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | 1.8.0 | 1.8.0 | 1.8.0 | 1.8.0 | 1.7.0 | 1.7.0 | 1.7.0 | 1.7.0 | 1.6.0 | 1.6.0 | 1.5.1 | 1.5.1 | | Mahout | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | 5.1.0 | 5.1.0 | | Phoenix | 5.1.3 | 5.1.3 | 5.1.3 | 5.1.3 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | - | - | | Presto | 0,283-amzn-0 | 0,281-amzn-2 | 0,281-amzn-1 | 0,281-amzn-0 | 0,279 amzn-0 | 0,279 amzn-0 | 0.278.1-amzn-0 | 0.278.1-amzn-0 | 0,276 amzn-0 | 0,276 amzn-0 | 0.273.3-amzn-0 | 0.273.3-amzn-0 | 0,272-amzn-0 | 0,267-amzn-0 | 0,261-amzn-0 | 0.254.1-amzn-0 | 0.245.1-amzn-0 | 0.245.1-amzn-0 | 0.238.3-amzn-1 | 0.238.3-amzn-1 | 0,232 | 0,232 | 0,230 | 0,230 | | Spark | 3.4.1-amzn-2 | 3.4.1-amzn-1 | 3.4.1-amzn-0 | 3.4.0-amzn-0 | 3.3.2-amzn-0.1 | 3.3.2-amzn-0 | 3.3.1-amzn-0.1 | 3.3.1-amzn-0 | 3.3.0-amzn-1.1 | 3.3.0-amzn-1 | 3.3.0-amzn-0.1 | 3.3.0-amzn-0 | 3.2.1-amzn-0 | 3.2.0-amzn-0 | 3.1.2-amzn-1 | 3.1.2-amzn-0 | 3.1.1-amzn-0.1 | 3.1.1-amzn-0 | 3.0.1-amzn-0.1 | 3.0.1-amzn-0 | 3.0.0-amzn-0.1 | 3.0.0-amzn-0 | 2.4.4 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | - | - | | TensorFlow | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | 2.10.0 | 2.10.0 | 2.9.1 | 2.9.1 | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | 2.3.1 | 2.3.1 | 2.1.0 | 2.1.0 | 1.14.0 | 1.14.0 | | Tez | 0.10.2-amzn-6 | 0.10.2-amzn-5 | 0.10.2-amzn-4 | 0.10.2-amzn-3 | 0.10.2-amzn-2.1 | 0.10.2-amzn-2 | 0.10.2-amzn-1.1 | 0.10.2-amzn-1 | 0.10.2-amzn-0.1 | 0.10.2-amzn-0 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 426-amzn-0 | 422-amzn-0 | 414-amzn-1 | 414-amzn-0 | 410-amzn-0 | 410-amzn-0 | 403-amzn-0 | 403-amzn-0 | 398-amzn-0 | 398-amzn-0 | 388-amzn-0 | 388-amzn-0 | 378-amzn-0 | 367-amzn-0 | 360 | 359 | 350 | 350 | 343 | 343 | 338 | 338 | - | - | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.0 | 0.10.0 | 0.10.0 | 0.9.0 | 0.9.0 | 0.9.0 | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-SNAPSHOT | 0.9.0-SNAPSHOT | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.7 | 3.5.7 | 3.5.7 | 3.5.7 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | # Amazon EMR rilis 6.15.0 ## 6.15.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.15.0 | emr-6.14.0 | emr-6.13.0 | emr-6.12.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 2.20.160-amzn-0, 1.12.569 | 1.12.543 | 1.12.513 | 1.12.490 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | | Flink | 1.17.1-amzn-1 | 1.17.1-amzn-0 | 1.17.0 | 1.17.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.17-amzn-3 | 2.4.17-amzn-2 | 2.4.17-amzn-1 | 2.4.17-amzn-0 | | HCatalog | 3.1.3-amzn-8 | 3.1.3-amzn-7 | 3.1.3-amzn-6 | 3.1.3-amzn-5 | | Hadoop | 3.3.6-amzn-1 | 3.3.3-amzn-6 | 3.3.3-amzn-5 | 3.3.3-amzn-4 | | Hive | 3.1.3-amzn-8 | 3.1.3-amzn-7 | 3.1.3-amzn-6 | 3.1.3-amzn-5 | | Hudi | 0.14.0-amzn-0 | 0.13.1-amzn-2 | 0.13.1-amzn-1 | 0.13.1-amzn-0 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.4.0-amzn-0 | 1.3.1-amzn-0 | 1.3.0-amzn-1 | 1.3.0-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.5.0 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.3 | 5.1.3 | 5.1.3 | 5.1.3 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,283-amzn-0 | 0,281-amzn-2 | 0,281-amzn-1 | 0,281-amzn-0 | | Spark | 3.4.1-amzn-2 | 3.4.1-amzn-1 | 3.4.1-amzn-0 | 3.4.0-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-6 | 0.10.2-amzn-5 | 0.10.2-amzn-4 | 0.10.2-amzn-3 | | Trino (PrestoSQL) | 426-amzn-0 | 422-amzn-0 | 414-amzn-1 | 414-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | ## Catatan terbitan 6.15.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 6.15.0. Perubahan relatif terhadap 6.14.0. Untuk informasi tentang timeline rilis, lihat. [6.15.0 perubahan log](#6150-changelog) **Fitur baru** + **Upgrade aplikasi** — Amazon EMR 6.15.0 application upgrades include Apache Hadoop 3.3.6, Apache Hudi 0.14.0-amzn-0, Iceberg 1.4.0-amzn-0, and Trino 426. + **[Peluncuran lebih cepat untuk kluster EMR yang berjalan di](https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-emr-ec2-clusters-5-minutes-less/)** EC2 - Sekarang hingga 35% lebih cepat untuk meluncurkan EMR Amazon di cluster EC2. Dengan peningkatan ini, sebagian besar pelanggan dapat meluncurkan cluster mereka dalam 5 menit atau kurang. + **[CodeWhisperer untuk EMR Studio](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-studio-codewhisperer.html)** - Anda sekarang dapat menggunakan Amazon dengan CodeWhisperer Amazon EMR Studio untuk mendapatkan rekomendasi waktu nyata saat Anda menulis kode. JupyterLab CodeWhisperer dapat menyelesaikan komentar Anda, menyelesaikan satu baris kode, membuat line-by-line rekomendasi, dan menghasilkan fungsi yang sepenuhnya terbentuk. + **[Waktu restart pekerjaan lebih cepat dengan Flink](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/flink-restart.html)** - Dengan Amazon EMR 6.15.0 dan yang lebih tinggi, beberapa mekanisme baru tersedia untuk Apache Flink untuk meningkatkan waktu restart pekerjaan selama pemulihan tugas atau operasi penskalaan. Ini mengoptimalkan kecepatan pemulihan dan memulai ulang grafik eksekusi untuk meningkatkan stabilitas pekerjaan. + **[Kontrol akses tingkat tabel dan berbutir halus untuk format tabel terbuka —](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-lf-enable.html)** Dengan Amazon EMR 6.15.0 dan yang lebih tinggi, saat Anda menjalankan pekerjaan Spark di Amazon EMR pada kluster EC2 yang mengakses data di Katalog Data Glue, Anda AWS Lake Formation dapat menggunakannya untuk menerapkan izin tabel, baris, kolom, dan tingkat sel pada tabel berbasis Hudi AWS , Iceberg, atau Delta Lake. + **Upgrade Hadoop** - Amazon EMR 6.15.0 termasuk upgrade Apache Hadoop ke versi 3.3.6. Hadoop 3.3.6 adalah versi terbaru pada saat penyebaran Amazon EMR 6.15, dirilis oleh Apache pada Juni 2023. Rilis sebelumnya Amazon EMR (6.9.0 hingga 6.14.x) menggunakan Hadoop 3.3.3. Upgrade mencakup ratusan perbaikan dan perbaikan, dan fitur yang mencakup parameter datanode yang dapat dikonfigurasi ulang, `DFSAdmin` opsi untuk memulai operasi konfigurasi ulang massal pada semua datanodes langsung, dan API vektor yang memungkinkan pembaca seek-heavy menentukan beberapa rentang untuk dibaca. Hadoop 3.3.6 juga menambahkan dukungan untuk HDFS APIs dan semantik untuk write-ahead log (WAL), sehingga dapat berjalan pada implementasi sistem penyimpanan lainnya. HBase [https://hadoop.apache.org/docs/r3.3.6/hadoop-project-dist/hadoop-common/release/3.3.6/CHANGELOG.3.3.6.html](https://hadoop.apache.org/docs/r3.3.6/hadoop-project-dist/hadoop-common/release/3.3.6/CHANGELOG.3.3.6.html) [3.3.4, 3.3.5, dan 3.3.6](https://hadoop.apache.org/docs/r3.3.4/hadoop-project-dist/hadoop-common/release/3.3.4/CHANGELOG.3.3.4.html) [dalam dokumentasi Apache Hadoop.](https://hadoop.apache.org/docs/r3.3.5/hadoop-project-dist/hadoop-common/release/3.3.5/CHANGELOG.3.3.5.html) + **Support untuk AWS SDK for Java, versi** [2 - Aplikasi Amazon EMR 6.15.0 dapat menggunakan SDK for AWS Java [versi](https://github.com/aws/aws-sdk-java/tree/1.12.569) 1.12.569 atau 2.20.160 jika aplikasi mendukung v2.](https://github.com/aws/aws-sdk-java-v2/tree/2.20.160) AWS SDK for Java 2.x adalah penulisan ulang utama dari basis kode versi 1.x. Ini dibangun di atas Java 8\$1 dan menambahkan beberapa fitur yang sering diminta. Ini termasuk dukungan untuk I/O non-pemblokiran, dan kemampuan untuk menyambungkan implementasi HTTP yang berbeda saat runtime. Untuk informasi selengkapnya, termasuk **Panduan Migrasi dari SDK for Java v1 ke** v2, lihat AWS panduan [SDK for Java](https://docs.aws.amazon.com/sdk-for-java), versi 2. **Masalah yang diketahui** + Skrip instance-state on-cluster yang memantau kesehatan instance dapat mengkonsumsi CPU dan sumber daya memori yang berlebihan ketika ada sejumlah besar thread yang and/or membuka pegangan file pada node. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Untuk meningkatkan kluster EMR ketersediaan tinggi Anda, rilis ini memungkinkan konektivitas ke daemon EMR Amazon di host lokal yang menggunakan titik akhir. IPv6 + Rilis ini memungkinkan TLS 1.2 untuk komunikasi dengan ZooKeeper disediakan di semua node utama klaster ketersediaan tinggi Anda. + Rilis ini meningkatkan pengelolaan file log ZooKeeper transaksi yang dipertahankan pada node primer untuk meminimalkan skenario di mana file log tumbuh di luar batas dan mengganggu operasi cluster. + Rilis ini membuat komunikasi intra-node lebih tangguh untuk kluster EMR ketersediaan tinggi. Peningkatan ini mengurangi kemungkinan kegagalan tindakan bootstrap atau kegagalan awal cluster. + Tez di Amazon EMR 6.15.0 memperkenalkan konfigurasi yang dapat Anda tentukan untuk membuka pemisahan input secara asinkron dalam pemisahan yang dikelompokkan Tez. Ini menghasilkan kinerja kueri baca yang lebih cepat ketika ada sejumlah besar pemisahan input dalam satu pemisahan yang dikelompokkan Tez. Untuk informasi lebih lanjut, lihat [Pembukaan split asinkron Tez](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/tez-configure.html#tez-configure-async). + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-6150-release.html) ## 6.15.0 versi Java default Amazon EMR merilis 6.12.0 dan lebih tinggi mendukung semua aplikasi dengan Amazon Corretto 8 secara default, kecuali untuk Trino. Untuk Trino, Amazon EMR mendukung Amazon Corretto 17 secara default dimulai dengan rilis Amazon EMR 6.9.0. Amazon EMR juga mendukung beberapa aplikasi dengan Amazon Corretto 11 dan 17. Aplikasi tersebut tercantum dalam tabel berikut. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. Meskipun Amazon EMR mendukung Amazon Corretto 11 dan 17 di Apache Spark, Apache Hadoop, dan Apache Hive, kinerja mungkin menurun untuk beberapa beban kerja saat Anda menggunakan versi Corretto ini. Kami menyarankan Anda menguji beban kerja Anda sebelum mengubah default. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 6.15.0: | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 11, 8 | | Ganglia | 8 | | HBase | 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | JERAM Spark | 17, 11, 8 | | Sqoop | 8 | | Tez | 17, 11, 8 | | Trino | 17 | | Zeppelin | 8 | | Pig | 8 | | Zookeeper | 8 | ## 6.15.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.4.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | delta-standalone-connectors | 0.6.0 | Delta Connectors menyediakan runtime yang berbeda untuk mengintegrasikan Delta Lake dengan mesin seperti Flink, Hive dan Presto. | | emr-ddb | 5.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.8.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.12.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.29.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.8.0 | EMR S3Select Connector | | emr-wal-cli | 1.2.0 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.60.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.17.1-amzn-1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.17.1-amzn-1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.6-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.6-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.6-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.6-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.6-amzn-1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.6-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.6-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.6-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.6-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.6-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.6-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.17-amzn-3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.17-amzn-3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.17-amzn-3 | HBase klien baris perintah. | | hbase-rest-server | 2.4.17-amzn-3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.17-amzn-3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.17-amzn-3 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-8 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-8 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-8 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-8 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-8 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-8 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-8 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.14.0-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.14.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.14.0-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.14.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.4.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.3 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.3 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,283-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,283-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,283-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 426-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 426-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 426-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.4.1-amzn-2 | Klien baris perintah Spark. | | spark-history-server | 3.4.1-amzn-2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.4.1-amzn-2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.4.1-amzn-2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 23.08.1-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-6 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-6 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.15.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.15.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.15.0 perubahan log **Ubah log untuk catatan rilis dan rilis 6.15.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-09-03 | Revisi dokumen | Catatan rilis Amazon EMR 6.15.0 menambahkan masalah yang diketahui | | 2023-11-17 | Publikasi Docs | Amazon EMR 6.15.0 catatan rilis pertama kali diterbitkan | | 2023-11-17 | Penerapan selesai | [Amazon EMR 6.15.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-11-13 | Rilis awal | Amazon EMR 6.15.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 6.14.0 ## 6.14.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.14.0 | emr-6.13.0 | emr-6.12.0 | emr-6.11.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.543 | 1.12.513 | 1.12.490 | 1.12.446 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.4.0 | 2.4.0 | 2.4.0 | 2.2.0 | | Flink | 1.17.1-amzn-0 | 1.17.0 | 1.17.0 | 1.16.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.17-amzn-2 | 2.4.17-amzn-1 | 2.4.17-amzn-0 | 2.4.15-amzn-1.1 | | HCatalog | 3.1.3-amzn-7 | 3.1.3-amzn-6 | 3.1.3-amzn-5 | 3.1.3-amzn-4.1 | | Hadoop | 3.3.3-amzn-6 | 3.3.3-amzn-5 | 3.3.3-amzn-4 | 3.3.3-amzn-3.1 | | Hive | 3.1.3-amzn-7 | 3.1.3-amzn-6 | 3.1.3-amzn-5 | 3.1.3-amzn-4.1 | | Hudi | 0.13.1-amzn-2 | 0.13.1-amzn-1 | 0.13.1-amzn-0 | 0.13.0-amzn-0 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.3.1-amzn-0 | 1.3.0-amzn-1 | 1.3.0-amzn-0 | 1.2.0-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.3 | 5.1.3 | 5.1.3 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,281-amzn-2 | 0,281-amzn-1 | 0,281-amzn-0 | 0,279 amzn-0 | | Spark | 3.4.1-amzn-1 | 3.4.1-amzn-0 | 3.4.0-amzn-0 | 3.3.2-amzn-0.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-5 | 0.10.2-amzn-4 | 0.10.2-amzn-3 | 0.10.2-amzn-2.1 | | Trino (PrestoSQL) | 422-amzn-0 | 414-amzn-1 | 414-amzn-0 | 410-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | ## Catatan terbitan 6.14.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 6.14.0. Perubahan relatif terhadap 6.13.0. Untuk informasi tentang timeline rilis, lihat. [6.14.0 perubahan log](#6140-changelog) **Fitur baru** + Amazon EMR 6.14.0 supports Apache Spark 3.4.1, Apache Spark RAPIDS 23.06.0-amzn-2, Flink 1.17.1, Iceberg 1.3.1, and Trino 422. + [Penskalaan terkelola Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-scaling.html) sekarang tersedia di Wilayah `ap-southeast-3` Asia Pasifik (Jakarta) untuk klaster yang Anda buat dengan Amazon EMR 6.14.0 dan lebih tinggi. **Masalah yang diketahui** + Skrip instance-state on-cluster yang memantau kesehatan instance dapat mengkonsumsi CPU dan sumber daya memori yang berlebihan ketika ada sejumlah besar thread yang and/or membuka pegangan file pada node. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Rilis 6.14.0 mengoptimalkan manajemen log dengan Amazon EMR yang berjalan di Amazon EC2. Akibatnya, Anda mungkin melihat sedikit pengurangan biaya penyimpanan untuk log cluster Anda. + Rilis 6.14.0 meningkatkan alur kerja penskalaan untuk memperhitungkan instans inti berbeda yang memiliki variasi ukuran substansif untuk volume Amazon EBS mereka. Peningkatan ini hanya berlaku untuk node inti; operasi scale-down untuk node tugas tidak terpengaruh. + Rilis 6.14.0 meningkatkan cara Amazon EMR berinteraksi dengan aplikasi sumber terbuka seperti. Apache Hadoop YARN ResourceManager and HDFS NameNode Peningkatan ini mengurangi risiko keterlambatan operasional dengan penskalaan cluster, dan mengurangi kegagalan startup yang terjadi karena masalah konektivitas dengan aplikasi open-source. + Rilis 6.14.0 mengoptimalkan instalasi aplikasi pada peluncuran cluster. Ini meningkatkan waktu startup cluster untuk kombinasi tertentu dari aplikasi Amazon EMR. + Rilis 6.14.0 memperbaiki masalah di mana operasi penskalaan klaster mungkin terhenti saat cluster yang berjalan di VPC dengan domain khusus menghadapi inti atau node tugas dimulai ulang. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-6140-release.html) ## 6.14.0 versi Java default Amazon EMR merilis 6.12.0 dan lebih tinggi mendukung semua aplikasi dengan Amazon Corretto 8 secara default, kecuali untuk Trino. Untuk Trino, Amazon EMR mendukung Amazon Corretto 17 secara default dimulai dengan rilis Amazon EMR 6.9.0. Amazon EMR juga mendukung beberapa aplikasi dengan Amazon Corretto 11 dan 17. Aplikasi tersebut tercantum dalam tabel berikut. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. Meskipun Amazon EMR mendukung Amazon Corretto 11 dan 17 di Apache Spark, Apache Hadoop, dan Apache Hive, kinerja mungkin menurun untuk beberapa beban kerja saat Anda menggunakan versi Corretto ini. Kami menyarankan Anda menguji beban kerja Anda sebelum mengubah default. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 6.14.0: | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 11, 8 | | Ganglia | 8 | | HBase | 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Sqoop | 8 | | Tez | 17, 11, 8 | | Trino | 17 | | Zeppelin | 8 | | Pig | 8 | | Zookeeper | 8 | ## 6.14.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.4.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | delta-standalone-connectors | 0.6.0 | Delta Connectors menyediakan runtime yang berbeda untuk mengintegrasikan Delta Lake dengan mesin seperti Flink, Hive dan Presto. | | emr-ddb | 5.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.7.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.11.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.28.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.7.0 | EMR S3Select Connector | | emr-wal-cli | 1.1.0 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.59.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.17.1-amzn-0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.17.1-amzn-0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.3-amzn-6 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.3-amzn-6 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.3-amzn-6 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.3-amzn-6 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.3-amzn-6 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.3-amzn-6 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.3-amzn-6 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.3-amzn-6 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.3-amzn-6 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.3-amzn-6 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.3-amzn-6 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.17-amzn-2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.17-amzn-2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.17-amzn-2 | HBase klien baris perintah. | | hbase-rest-server | 2.4.17-amzn-2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.17-amzn-2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.17-amzn-2 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-7 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-7 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-7 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-7 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-7 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-7 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-7 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.13.1-amzn-2 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.13.1-amzn-2 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.13.1-amzn-2 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.13.1-amzn-2 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.3.1-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.3 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.3 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,281-amzn-2 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,281-amzn-2 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,281-amzn-2 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 422-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 422-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 422-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.4.1-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 3.4.1-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.4.1-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.4.1-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 23.06.0-amzn-2 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-5 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-5 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.14.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.14.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.14.0 perubahan log **Ubah log untuk catatan rilis dan rilis 6.14.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-09-03 | Revisi dokumen | Catatan rilis Amazon EMR 6.14.0 menambahkan masalah yang diketahui | | *2023-11-02* | Penerapan selesai | [Amazon EMR 6.14.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-10-10 | Publikasi Docs | Amazon EMR 6.14.0 catatan rilis pertama kali diterbitkan | | 2023-10-04 | Rilis awal | Amazon EMR 6.14.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 6.13.0 ## 6.13.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.13.0 | emr-6.12.0 | emr-6.11.1 | emr-6.11.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.513 | 1.12.490 | 1.12.446 | 1.12.446 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.4.0 | 2.4.0 | 2.2.0 | 2.2.0 | | Flink | 1.17.0 | 1.17.0 | 1.16.0 | 1.16.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.17-amzn-1 | 2.4.17-amzn-0 | 2.4.15-amzn-1.1 | 2.4.15-amzn-1 | | HCatalog | 3.1.3-amzn-6 | 3.1.3-amzn-5 | 3.1.3-amzn-4.1 | 3.1.3-amzn-4 | | Hadoop | 3.3.3-amzn-5 | 3.3.3-amzn-4 | 3.3.3-amzn-3.1 | 3.3.3-amzn-3 | | Hive | 3.1.3-amzn-6 | 3.1.3-amzn-5 | 3.1.3-amzn-4.1 | 3.1.3-amzn-4 | | Hudi | 0.13.1-amzn-1 | 0.13.1-amzn-0 | 0.13.0-amzn-0 | 0.13.0-amzn-0 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.11.0 | | Iceberg | 1.3.0-amzn-1 | 1.3.0-amzn-0 | 1.2.0-amzn-0 | 1.2.0-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.4.1 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.3 | 5.1.3 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,281-amzn-1 | 0,281-amzn-0 | 0,279 amzn-0 | 0,279 amzn-0 | | Spark | 3.4.1-amzn-0 | 3.4.0-amzn-0 | 3.3.2-amzn-0.1 | 3.3.2-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-4 | 0.10.2-amzn-3 | 0.10.2-amzn-2.1 | 0.10.2-amzn-2 | | Trino (PrestoSQL) | 414-amzn-1 | 414-amzn-0 | 410-amzn-0 | 410-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | ## Catatan rilis 6.13.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.13.0. Perubahan relatif terhadap 6.12.0. Untuk informasi tentang timeline rilis, lihat. [6.13.0 perubahan log](#6130-changelog) **Fitur baru** + Amazon EMR 6.13.0 supports Apache Spark 3.4.1, Apache Spark RAPIDS 23.06.0-amzn-1, CUDA Toolkit 11.8.0, and JupyterHub 1.5.0. **Masalah yang diketahui** + Skrip instance-state on-cluster yang memantau kesehatan instance dapat mengkonsumsi CPU dan sumber daya memori yang berlebihan ketika ada sejumlah besar thread yang and/or membuka pegangan file pada node. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Rilis 6.13.0 meningkatkan daemon manajemen log EMR Amazon untuk memastikan bahwa semua log diunggah dengan irama reguler ke Amazon S3 saat perintah penghentian klaster dikeluarkan. Ini memfasilitasi penghentian cluster yang lebih cepat. + Rilis 6.13.0 meningkatkan kemampuan manajemen log EMR Amazon untuk memastikan pengunggahan semua file log yang konsisten dan tepat waktu ke Amazon S3. Ini terutama menguntungkan cluster EMR yang berjalan lama. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-6130-release.html) ## 6.13.0 versi Java default Amazon EMR merilis 6.12.0 dan lebih tinggi mendukung semua aplikasi dengan Amazon Corretto 8 secara default, kecuali untuk Trino. Untuk Trino, Amazon EMR mendukung Amazon Corretto 17 secara default dimulai dengan rilis Amazon EMR 6.9.0. Amazon EMR juga mendukung beberapa aplikasi dengan Amazon Corretto 11 dan 17. Aplikasi tersebut tercantum dalam tabel berikut. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. Meskipun Amazon EMR mendukung Amazon Corretto 11 dan 17 di Apache Spark, Apache Hadoop, dan Apache Hive, kinerja mungkin menurun untuk beberapa beban kerja saat Anda menggunakan versi Corretto ini. Kami menyarankan Anda menguji beban kerja Anda sebelum mengubah default. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 6.13.0: | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 11, 8 | | Ganglia | 8 | | HBase | 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Sqoop | 8 | | Tez | 17, 11, 8 | | Trino | 17 | | Zeppelin | 8 | | Pig | 8 | | Zookeeper | 8 | ## 6.13.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.4.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | delta-standalone-connectors | 0.6.0 | Delta Connectors menyediakan runtime yang berbeda untuk mengintegrasikan Delta Lake dengan mesin seperti Flink, Hive dan Presto. | | emr-ddb | 5.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.6.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.10.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.27.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.6.0 | EMR S3Select Connector | | emr-wal-cli | 1.1.0 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.58.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.17.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.17.0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.3-amzn-5 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.3-amzn-5 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.3-amzn-5 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.3-amzn-5 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.3-amzn-5 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.3-amzn-5 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.3-amzn-5 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.3-amzn-5 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.3-amzn-5 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.3-amzn-5 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.3-amzn-5 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.17-amzn-1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.17-amzn-1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.17-amzn-1 | HBase klien baris perintah. | | hbase-rest-server | 2.4.17-amzn-1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.17-amzn-1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.17-amzn-1 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-6 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-6 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-6 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-6 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-6 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-6 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-6 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.13.1-amzn-1 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.13.1-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.13.1-amzn-1 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.13.1-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.3.0-amzn-1 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.3 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.3 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,281-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,281-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,281-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 414-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 414-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 414-amzn-1 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.4.1-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.4.1-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.4.1-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.4.1-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 23.06.0-amzn-1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-4 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-4 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.13.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.13.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.13.0 perubahan log **Ubah log untuk catatan rilis dan rilis 6.13.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-09-03 | Revisi dokumen | Catatan rilis Amazon EMR 6.13.0 menambahkan masalah yang diketahui | | *2023-09-23* | Penerapan selesai | [Amazon EMR 6.13.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-09-12 | Publikasi Docs | Amazon EMR 6.13.0 catatan rilis pertama kali diterbitkan | | 2023-09-01 | Rilis awal | Amazon EMR 6.13.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 6.12.0 ## 6.12.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.12.0 | emr-6.11.1 | emr-6.11.0 | emr-6.10.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.490 | 1.12.446 | 1.12.446 | 1.12.397 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.4.0 | 2.2.0 | 2.2.0 | 2.2.0 | | Flink | 1.17.0 | 1.16.0 | 1.16.0 | 1.16.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.17-amzn-0 | 2.4.15-amzn-1.1 | 2.4.15-amzn-1 | 2.4.15-amzn-0.1 | | HCatalog | 3.1.3-amzn-5 | 3.1.3-amzn-4.1 | 3.1.3-amzn-4 | 3.1.3-amzn-3.1 | | Hadoop | 3.3.3-amzn-4 | 3.3.3-amzn-3.1 | 3.3.3-amzn-3 | 3.3.3-amzn-2.1 | | Hive | 3.1.3-amzn-5 | 3.1.3-amzn-4.1 | 3.1.3-amzn-4 | 3.1.3-amzn-3.1 | | Hudi | 0.13.1-amzn-0 | 0.13.0-amzn-0 | 0.13.0-amzn-0 | 0.12.2-amzn-0 | | Hue | 4.11.0 | 4.11.0 | 4.11.0 | 4.10.0 | | Iceberg | 1.3.0-amzn-0 | 1.2.0-amzn-0 | 1.2.0-amzn-0 | 1.1.0-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.5.0 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.3 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,281-amzn-0 | 0,279 amzn-0 | 0,279 amzn-0 | 0.278.1-amzn-0 | | Spark | 3.4.0-amzn-0 | 3.3.2-amzn-0.1 | 3.3.2-amzn-0 | 3.3.1-amzn-0.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-3 | 0.10.2-amzn-2.1 | 0.10.2-amzn-2 | 0.10.2-amzn-1.1 | | Trino (PrestoSQL) | 414-amzn-0 | 410-amzn-0 | 410-amzn-0 | 403-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | ## Catatan terbitan 6.12.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.12.0. Perubahan relatif terhadap 6.11.0. Untuk informasi tentang timeline rilis, lihat. [6.12.0 perubahan log](#6120-changelog) **Fitur baru** + Amazon EMR 6.12.0 supports Apache Spark 3.4.0, Apache Spark RAPIDS 23.06.0-amzn-0, CUDA 11.8.0, Apache Hudi 0.13.1-amzn-0, Apache Iceberg 1.3.0-amzn-0, Trino 414, and PrestoDB 0.281. + Amazon EMR merilis 6.12.0 dan lebih tinggi mendukung integrasi LDAP dengan Apache Livy, Apache Hive hingga HiveServer 2 ()HS2, Trino, Presto, dan Hue. Anda juga dapat menginstal Apache Spark dan Apache Hadoop pada cluster EMR yang menggunakan 6.12.0 atau lebih tinggi dan mengkonfigurasinya untuk menggunakan LDAP. Untuk informasi selengkapnya, lihat [Menggunakan Active Directory atau server LDAP untuk autentikasi dengan Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/ldap.html). **Masalah yang diketahui** + Skrip instance-state on-cluster yang memantau kesehatan instance dapat mengkonsumsi CPU dan sumber daya memori yang berlebihan ketika ada sejumlah besar thread yang and/or membuka pegangan file pada node. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Amazon EMR merilis 6.12.0 dan yang lebih tinggi memberikan dukungan runtime Java 11 untuk Flink. Untuk informasi selengkapnya, lihat [Konfigurasikan Flink untuk dijalankan dengan Java 11](flink-configure.md#flink-configure-java11). + Rilis 6.12.0 menambahkan mekanisme coba lagi baru ke alur kerja penskalaan cluster untuk kluster EMR yang menjalankan Presto atau Trino. Peningkatan ini mengurangi risiko bahwa pengubahan ukuran cluster akan terhenti tanpa batas karena satu operasi pengubahan ukuran yang gagal. Ini juga meningkatkan pemanfaatan cluster, karena kluster Anda naik dan turun lebih cepat. + Rilis 6.12.0 memperbaiki masalah di mana operasi penskalaan klaster mungkin terhenti ketika node inti yang mengalami penonaktifan yang anggun berubah tidak sehat karena alasan apa pun sebelum sepenuhnya dinonaktifkan. + Rilis 6.12.0 meningkatkan logika scale-down cluster sehingga cluster Anda tidak mencoba menurunkan skala node inti di bawah pengaturan faktor replikasi HDFS untuk cluster. Ini sejalan dengan persyaratan redundansi data Anda, dan mengurangi kemungkinan operasi penskalaan mungkin terhenti. + Rilis 6.12.0 meningkatkan kinerja dan efisiensi layanan pemantauan kesehatan untuk Amazon EMR dengan meningkatkan kecepatan pencatatan perubahan status untuk instans. Peningkatan ini mengurangi kemungkinan penurunan kinerja untuk node cluster yang menjalankan beberapa alat klien khusus atau aplikasi pihak ketiga. + Rilis 6.12.0 meningkatkan kinerja daemon manajemen log on-cluster untuk Amazon EMR. Akibatnya, ada sedikit peluang untuk kinerja yang menurun dengan cluster EMR yang menjalankan langkah-langkah dengan konkurensi tinggi. + Dengan Amazon EMR rilis 6.12.0, daemon manajemen log telah ditingkatkan untuk mengidentifikasi semua log yang digunakan secara aktif dengan pegangan file terbuka pada penyimpanan instans lokal, dan proses terkait. Peningkatan ini memastikan bahwa Amazon EMR menghapus file dengan benar dan merebut kembali ruang penyimpanan setelah log diarsipkan ke Amazon S3. + Rilis 6.12.0 mencakup peningkatan daemon manajemen log yang menghapus direktori langkah kosong dan tidak terpakai di sistem file cluster lokal. Sejumlah besar direktori kosong dapat menurunkan kinerja daemon EMR Amazon dan mengakibatkan pemanfaatan disk yang berlebihan. + Rilis 6.12.0 memungkinkan rotasi log untuk log YARN Timeline Server. Ini meminimalkan skenario pemanfaatan disk yang berlebihan, terutama untuk cluster yang berjalan lama. + Ukuran volume root default telah meningkat menjadi 15 GB di Amazon EMR 6.10.0 dan lebih tinggi. Rilis sebelumnya memiliki ukuran volume root default 10 GB. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-6120-release.html) ## 6.12.0 versi Java default Amazon EMR merilis 6.12.0 dan lebih tinggi mendukung semua aplikasi dengan Amazon Corretto 8 secara default, kecuali untuk Trino. Untuk Trino, Amazon EMR mendukung Amazon Corretto 17 secara default dimulai dengan rilis Amazon EMR 6.9.0. Amazon EMR juga mendukung beberapa aplikasi dengan Amazon Corretto 11 dan 17. Aplikasi tersebut tercantum dalam tabel berikut. Jika Anda ingin mengubah JVM default pada cluster Anda, ikuti instruksi [Konfigurasikan aplikasi untuk menggunakan Java Virtual Machine tertentu](configuring-java8.md) untuk setiap aplikasi yang berjalan di cluster. Anda hanya dapat menggunakan satu versi runtime Java untuk sebuah cluster. Amazon EMR tidak mendukung menjalankan node atau aplikasi yang berbeda pada versi runtime yang berbeda pada cluster yang sama. Meskipun Amazon EMR mendukung Amazon Corretto 11 dan 17 di Apache Spark, Apache Hadoop, dan Apache Hive, kinerja mungkin menurun untuk beberapa beban kerja saat Anda menggunakan versi Corretto ini. Kami menyarankan Anda menguji beban kerja Anda sebelum mengubah default. Tabel berikut menunjukkan versi Java default untuk aplikasi di Amazon EMR 6.12.0: | Aplikasi | Versi Java/Amazon Corretto (defaultnya tebal) | | --- | --- | | kuala | 17, 11, 8 | | Flink | 11, 8 | | Ganglia | 8 | | HBase | 11, 8 | | HCatalog | 17, 11, 8 | | Hadoop | 17, 11, 8 | | Hive | 17, 11, 8 | | Hudi | 17, 11, 8 | | Gunung es | 17, 11, 8 | | Livy | 17, 11, 8 | | Oozie | 17, 11, 8 | | Phoenix | 8 | | PrestoDB | 8 | | Spark | 17, 11, 8 | | Spark RAPIDS | 17, 11, 8 | | Sqoop | 8 | | Tez | 17, 11, 8 | | Trino | 17 | | Zeppelin | 8 | | Pig | 8 | | Zookeeper | 8 | ## 6.12.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.4.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | delta-standalone-connectors | 0.6.0 | Delta Connectors menyediakan runtime yang berbeda untuk mengintegrasikan Delta Lake dengan mesin seperti Flink, Hive dan Presto. | | emr-ddb | 5.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.5.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.9.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.26.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.5.0 | EMR S3Select Connector | | emr-wal-cli | 1.1.0 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.57.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.17.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.17.0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.3-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.3-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.3-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.3-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.3-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.3-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.3-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.3-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.3-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.3-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.3-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.17-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.17-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.17-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.4.17-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.17-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.17-amzn-0 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-5 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-5 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-5 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-5 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-5 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-5 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-5 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.13.1-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.13.1-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.13.1-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.13.1-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.3.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.7.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.3 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.3 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,281-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,281-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,281-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 414-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 414-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 414-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.4.0-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.4.0-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.4.0-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.4.0-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 23.06.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-3 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-3 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.12.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.12.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-java-home | Ubah rumah java KMS Hadoop | Not available. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.12.0 perubahan log **Ubah log untuk catatan rilis dan rilis 6.12.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2025-09-03 | Revisi dokumen | Catatan rilis Amazon EMR 6.12.0 menambahkan masalah yang diketahui | | 2023-07-27 | Perbarui dokumentasi | Perbarui opsi Java untuk 6.12 dan tambahkan tutorial Oozie untuk memperbarui JVM | | 2023-07-21 | Penerapan selesai | [Amazon EMR 6.12.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-07-21 | Publikasi Docs | Amazon EMR 6.12.0 catatan rilis pertama kali diterbitkan | | 2023-07-12 | Rilis awal | Amazon EMR 6.12.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 6.11.1 ## 6.11.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.11.1 | emr-6.11.0 | emr-6.10.1 | emr-6.10.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.446 | 1.12.446 | 1.12.397 | 1.12.397 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | | Flink | 1.16.0 | 1.16.0 | 1.16.0 | 1.16.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.15-amzn-1.1 | 2.4.15-amzn-1 | 2.4.15-amzn-0.1 | 2.4.15-amzn-0 | | HCatalog | 3.1.3-amzn-4.1 | 3.1.3-amzn-4 | 3.1.3-amzn-3.1 | 3.1.3-amzn-3 | | Hadoop | 3.3.3-amzn-3.1 | 3.3.3-amzn-3 | 3.3.3-amzn-2.1 | 3.3.3-amzn-2 | | Hive | 3.1.3-amzn-4.1 | 3.1.3-amzn-4 | 3.1.3-amzn-3.1 | 3.1.3-amzn-3 | | Hudi | 0.13.0-amzn-0 | 0.13.0-amzn-0 | 0.12.2-amzn-0 | 0.12.2-amzn-0 | | Hue | 4.11.0 | 4.11.0 | 4.10.0 | 4.10.0 | | Iceberg | 1.2.0-amzn-0 | 1.2.0-amzn-0 | 1.1.0-amzn-0 | 1.1.0-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.5.0 | 1.5.0 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,279 amzn-0 | 0,279 amzn-0 | 0.278.1-amzn-0 | 0.278.1-amzn-0 | | Spark | 3.3.2-amzn-0.1 | 3.3.2-amzn-0 | 3.3.1-amzn-0.1 | 3.3.1-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.11.0 | 2.11.0 | 2.11.0 | 2.11.0 | | Tez | 0.10.2-amzn-2.1 | 0.10.2-amzn-2 | 0.10.2-amzn-1.1 | 0.10.2-amzn-1 | | Trino (PrestoSQL) | 410-amzn-0 | 410-amzn-0 | 403-amzn-0 | 403-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | ## Catatan terbitan 6.11.1 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 6.11.1. Perubahan relatif terhadap 6.11.0. Untuk informasi tentang timeline rilis, lihat. [6.11.1 perubahan log](#6111-changelog) **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Karena pertikaian kunci, sebuah node dapat masuk ke dalam kebuntuan jika ditambahkan atau dihapus pada saat yang sama ketika ia mencoba untuk menonaktifkan. Akibatnya, Hadoop Resource Manager (YARN) menjadi tidak responsif, dan memengaruhi semua kontainer yang masuk dan saat ini berjalan. + Rilis ini mencakup perubahan yang memungkinkan cluster ketersediaan tinggi pulih dari status gagal setelah restart. + Rilis ini mencakup perbaikan keamanan untuk Hue dan. HBase + Rilis ini memperbaiki masalah di mana cluster yang menjalankan beban kerja di Spark dengan Amazon EMR mungkin diam-diam menerima hasil yang salah dengan,,, dan. `contains` `startsWith` `endsWith` `like` Masalah ini terjadi saat Anda menggunakan ekspresi pada bidang yang dipartisi yang memiliki metadata di Amazon EMR Hive3 Metastore Server (HMS). + Rilis ini memperbaiki masalah dengan pelambatan di sisi Glue ketika tidak ada fungsi yang ditentukan pengguna (UDF). + Rilis ini memperbaiki masalah yang menghapus log kontainer oleh layanan agregasi log node sebelum pendorong log dapat mendorongnya ke S3 jika terjadi penonaktifan YARN. + Rilis ini memperbaiki masalah dengan metrik FairShare Scheduler saat Node Label diaktifkan untuk Hadoop. + Rilis ini memperbaiki masalah yang memengaruhi kinerja Spark saat Anda menetapkan `true` nilai default untuk konfigurasi. `spark.yarn.heterogeneousExecutors.enabled` `spark-defaults.conf` + Rilis ini memperbaiki masalah dengan Mengurangi Tugas yang gagal membaca data acak. Masalah ini menyebabkan kegagalan kueri Hive dengan kesalahan memori yang rusak. + Rilis ini menambahkan mekanisme coba lagi baru ke alur kerja penskalaan cluster untuk kluster EMR yang menjalankan Presto atau Trino. Peningkatan ini mengurangi risiko bahwa pengubahan ukuran cluster akan terhenti tanpa batas karena satu operasi pengubahan ukuran yang gagal. Ini juga meningkatkan pemanfaatan cluster, karena kluster Anda naik dan turun lebih cepat. + Rilis ini meningkatkan logika penskalaan klaster sehingga klaster Anda tidak mencoba menurunkan skala node inti di bawah pengaturan faktor replikasi HDFS untuk cluster. Ini sejalan dengan persyaratan redundansi data Anda, dan mengurangi kemungkinan operasi penskalaan mungkin terhenti. + Daemon manajemen log telah ditingkatkan untuk mengidentifikasi semua log yang digunakan secara aktif dengan pegangan file terbuka pada penyimpanan instance lokal, dan proses terkait. Peningkatan ini memastikan bahwa Amazon EMR menghapus file dengan benar dan merebut kembali ruang penyimpanan setelah log diarsipkan ke Amazon S3. + Rilis ini mencakup peningkatan daemon manajemen log yang menghapus direktori langkah kosong dan tidak terpakai di sistem file cluster lokal. Sejumlah besar direktori kosong dapat menurunkan kinerja daemon EMR Amazon dan mengakibatkan pemanfaatan disk yang berlebihan. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-6111-release.html) ## 6.11.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.2.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | delta-standalone-connectors | 0.6.0 | Delta Connectors menyediakan runtime yang berbeda untuk mengintegrasikan Delta Lake dengan mesin seperti Flink, Hive dan Presto. | | emr-ddb | 5.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.8.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.25.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.4.0 | EMR S3Select Connector | | emr-wal-cli | 1.1.0 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.56.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.16.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.16.0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.3-amzn-3.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.3-amzn-3.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.3-amzn-3.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.3-amzn-3.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.3-amzn-3.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.3-amzn-3.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.3-amzn-3.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.3-amzn-3.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.3-amzn-3.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.3-amzn-3.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.3-amzn-3.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.15-amzn-1.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.15-amzn-1.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.15-amzn-1.1 | HBase klien baris perintah. | | hbase-rest-server | 2.4.15-amzn-1.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.15-amzn-1.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.15-amzn-1.1 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-4.1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-4.1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-4.1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-4.1 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-4.1 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-4.1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-4.1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.13.0-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.13.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.13.0-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.13.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.2.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.2 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,279 amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,279 amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,279 amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 410-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 410-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 410-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.3.2-amzn-0.1 | Klien baris perintah Spark. | | spark-history-server | 3.3.2-amzn-0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.3.2-amzn-0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.3.2-amzn-0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 23.02.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-2.1 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-2.1 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.11.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.11.1** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.11.1 perubahan log **Ubah log untuk catatan rilis dan rilis 6.11.1** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2023-08-30 | Perbarui catatan rilis | Menambahkan beberapa perbaikan terkait bidang kontrol ke catatan rilis | | 2023-08-21 | Publikasi Docs | Amazon EMR 6.11.1 catatan rilis pertama kali diterbitkan | | 2023-08-16 | Penerapan selesai | [Amazon EMR 6.11.1 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-08-04 | Rilis awal | Amazon EMR 6.11.1 pertama kali dikerahkan ke Wilayah komersial terbatas | # Amazon EMR rilis 6.11.0 ## 6.11.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.11.0 | emr-6.10.1 | emr-6.10.0 | emr-6.9.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.446 | 1.12.397 | 1.12.397 | 1.12.170 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.2.0 | 2.2.0 | 2.2.0 | 2.1.0 | | Flink | 1.16.0 | 1.16.0 | 1.16.0 | 1.15.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.15-amzn-1 | 2.4.15-amzn-0.1 | 2.4.15-amzn-0 | 2.4.13-amzn-0.1 | | HCatalog | 3.1.3-amzn-4 | 3.1.3-amzn-3.1 | 3.1.3-amzn-3 | 3.1.3-amzn-2.1 | | Hadoop | 3.3.3-amzn-3 | 3.3.3-amzn-2.1 | 3.3.3-amzn-2 | 3.3.3-amzn-1.1 | | Hive | 3.1.3-amzn-4 | 3.1.3-amzn-3.1 | 3.1.3-amzn-3 | 3.1.3-amzn-2.1 | | Hudi | 0.13.0-amzn-0 | 0.12.2-amzn-0 | 0.12.2-amzn-0 | 0.12.1-amzn-0 | | Hue | 4.11.0 | 4.10.0 | 4.10.0 | 4.10.0 | | Iceberg | 1.2.0-amzn-0 | 1.1.0-amzn-0 | 1.1.0-amzn-0 | 0.14.1-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.4.1 | 1.5.0 | 1.5.0 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,279 amzn-0 | 0.278.1-amzn-0 | 0.278.1-amzn-0 | 0,276 amzn-0 | | Spark | 3.3.2-amzn-0 | 3.3.1-amzn-0.1 | 3.3.1-amzn-0 | 3.3.0-amzn-1.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.11.0 | 2.11.0 | 2.11.0 | 2.10.0 | | Tez | 0.10.2-amzn-2 | 0.10.2-amzn-1.1 | 0.10.2-amzn-1 | 0.10.2-amzn-0.1 | | Trino (PrestoSQL) | 410-amzn-0 | 403-amzn-0 | 403-amzn-0 | 398-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | ## Catatan terbitan 6.11.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 6.11.0. Perubahan relatif terhadap 6.10.0. Untuk informasi tentang timeline rilis, lihat [log perubahan](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-6110-release.html#6110-changelog). **Fitur baru** + Amazon EMR 6.11.0 mendukung Apache Spark 3.3.2-amzn-0, Apache Spark RAPIDS 23.02.0-amzn-0, CUDA 11.8.0, Apache Hudi 0.13.0-amzn-0, Apache Iceberg 1.2.0-amzn-0, Trino 410-amzn-0, dan PrestoDB 0.279-amzn-0. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. + Dengan Amazon EMR 6.11.0, konektor DynamoDB telah ditingkatkan ke versi 5.0.0. Versi 5.0.0 menggunakan. AWS SDK for Java 2.x Rilis sebelumnya menggunakan AWS SDK untuk Java 1.x. Sebagai hasil dari peningkatan ini, kami sangat menyarankan Anda untuk menguji kode Anda sebelum Anda menggunakan konektor DynamoDB dengan Amazon EMR 6.11. + Ketika konektor DynamoDB untuk Amazon EMR 6.11.0 memanggil layanan DynamoDB, ia menggunakan nilai Wilayah yang Anda berikan untuk properti. `dynamodb.endpoint` Kami menyarankan Anda juga mengonfigurasi `dynamodb.region` saat Anda menggunakan`dynamodb.endpoint`, dan kedua properti menargetkan hal yang sama Wilayah AWS. Jika Anda menggunakan `dynamodb.endpoint` dan tidak mengonfigurasi`dynamodb.region`, konektor DynamoDB untuk Amazon EMR 6.11.0 akan menampilkan pengecualian Wilayah yang tidak valid dan mencoba merekonsiliasi informasi Anda Wilayah AWS dari layanan metadata instans Amazon EC2 (IMDS). Jika konektor tidak dapat mengambil Region dari IMDS, itu default ke US East (N. Virginia) (). `us-east-1` Kesalahan berikut adalah contoh pengecualian Wilayah tidak valid yang mungkin Anda dapatkan jika Anda tidak mengonfigurasi `dynamodb.region` properti dengan benar: `error software.amazon.awssdk.services.dynamodb.model.DynamoDbException: Credential should be scoped to a valid region.` Untuk informasi selengkapnya tentang kelas yang terpengaruh oleh AWS SDK untuk Java pemutakhiran ke 2.x, lihat Komit [Upgrade AWS SDK untuk Java dari 1.x ke 2.x (\$1175) di GitHub repo untuk](https://github.com/awslabs/emr-dynamodb-connector/commit/1dec9d1972d3673c3fae6c6ea51f19f295147ccf) konektor Amazon EMR - DynamoDB. + Rilis ini memperbaiki masalah di mana data kolom menjadi `NULL` ketika Anda menggunakan Delta Lake untuk menyimpan data tabel Delta di Amazon S3 setelah operasi penggantian nama kolom. Untuk informasi lebih lanjut tentang fitur eksperimental ini di Danau Delta, lihat [Operasi ganti nama kolom di Panduan](https://docs.delta.io/latest/delta-batch.html#rename-columns) Pengguna Danau Delta. + Rilis 6.11.0 memperbaiki masalah yang mungkin terjadi saat Anda membuat simpul tepi dengan mereplikasi salah satu node utama dari cluster dengan beberapa node primer. Node tepi yang direplikasi dapat menyebabkan penundaan dengan operasi penskalaan, atau mengakibatkan pemanfaatan memori yang tinggi pada node utama. Untuk informasi selengkapnya tentang cara membuat simpul tepi untuk berkomunikasi dengan cluster EMR Anda, lihat [Edge Node Creator](https://github.com/aws-samples/aws-emr-utilities/tree/main/utilities/emr-edge-node-creator) di `aws-samples` repo. GitHub + Rilis 6.11.0 meningkatkan proses otomatisasi yang digunakan Amazon EMR untuk memasang kembali volume Amazon EBS ke instance setelah reboot. + Rilis 6.11.0 memperbaiki masalah yang mengakibatkan celah intermiten dalam metrik Hadoop yang diterbitkan Amazon EMR ke Amazon. CloudWatch + Rilis 6.11.0 memperbaiki masalah dengan kluster EMR di mana pembaruan ke file konfigurasi YARN yang berisi daftar pengecualian node untuk cluster terganggu karena pemanfaatan disk yang berlebihan. Pembaruan yang tidak lengkap menghalangi operasi penskalaan klaster masa depan. Rilis ini memastikan bahwa klaster Anda tetap sehat, dan operasi penskalaan berfungsi seperti yang diharapkan. + Ukuran volume root default telah meningkat menjadi 15 GB di Amazon EMR 6.10.0 dan lebih tinggi. Rilis sebelumnya memiliki ukuran volume root default 10 GB. + Hadoop 3.3.3 memperkenalkan perubahan pada YARN ([YARN-9608](https://issues.apache.org/jira/browse/YARN-9608)) yang membuat node tempat kontainer berjalan dalam keadaan dekomisioning hingga aplikasi selesai. Perubahan ini memastikan bahwa data lokal seperti data acak tidak hilang, dan Anda tidak perlu menjalankan kembali pekerjaan. Pendekatan ini juga dapat menyebabkan kurangnya pemanfaatan sumber daya pada cluster dengan atau tanpa penskalaan terkelola diaktifkan. Dengan Amazon EMR merilis 6.11.0 dan yang lebih tinggi serta 6.8.1, 6.9.1, dan 6.10.1, nilai ditetapkan untuk mengatasi masalah ini. `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-applications` `false` `yarn-site.xml` Sementara perbaikan mengatasi masalah yang diperkenalkan oleh YARN-9608, hal itu dapat menyebabkan pekerjaan Hive gagal karena kehilangan data acak pada cluster yang telah mengelola penskalaan diaktifkan. Kami telah mengurangi risiko itu dalam rilis ini dengan juga menyetel `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-shuffle-data` beban kerja Hive. Konfigurasi ini hanya tersedia dengan rilis Amazon EMR 6.11.0 dan yang lebih tinggi. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). **catatan** Rilis ini tidak lagi mendapatkan pembaruan AMI otomatis karena telah digantikan oleh 1 rilis patch lagi. Rilis patch dilambangkan dengan angka setelah titik desimal kedua (). `6.8.1` Untuk melihat apakah Anda menggunakan rilis patch terbaru, periksa rilis yang tersedia di [https://docs.aws.amazon.com/emr/latest/ReleaseGuide](https://docs.aws.amazon.com/emr/latest/ReleaseGuide), atau periksa dropdown **rilis Amazon EMR** saat Anda membuat klaster di konsol, atau gunakan tindakan API [https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html](https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html)atau CLI. [https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html](https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html) Untuk mendapatkan pembaruan tentang rilis baru, berlangganan umpan RSS di [Apa yang baru?](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html) halaman. [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-6110-release.html) ## 6.11.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.2.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | delta-standalone-connectors | 0.6.0 | Delta Connectors menyediakan runtime yang berbeda untuk mengintegrasikan Delta Lake dengan mesin seperti Flink, Hive dan Presto. | | emr-ddb | 5.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.8.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.25.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.4.0 | EMR S3Select Connector | | emr-wal-cli | 1.1.0 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.56.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.16.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.16.0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.3-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.3-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.3-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.3-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.3-amzn-3 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.3-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.3-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.3-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.3-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.3-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.3-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.15-amzn-1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.15-amzn-1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.15-amzn-1 | HBase klien baris perintah. | | hbase-rest-server | 2.4.15-amzn-1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.15-amzn-1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.15-amzn-1 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-4 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-4 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-4 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-4 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-4 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-4 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-4 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.13.0-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.13.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.13.0-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.13.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.2.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.2 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,279 amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,279 amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,279 amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 410-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 410-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 410-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.3.2-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.3.2-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.3.2-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.3.2-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 23.02.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-2 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-2 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.11.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.11.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.11.0 perubahan log **Ubah log untuk catatan rilis dan rilis 6.11.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2023-08-21 | Perbarui | Masalah tetap diperkenalkan dengan Hadoop 3.3.3. | | 2023-07-26 | Perbarui | Label rilis OS baru 2.0.20230612.0 dan2.0.20230628.0. | | 2023-06-09 | Penerapan selesai | [Amazon EMR 6.11.0 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-06-09 | Publikasi Docs | Amazon EMR 6.11.0 catatan rilis pertama kali diterbitkan | | 2023-06-08 | Rilis awal | Amazon EMR 6.11.0 pertama kali dikerahkan ke Wilayah komersial awal | # Amazon EMR rilis 6.10.1 ## 6.10.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.10.1 | emr-6.10.0 | emr-6.9.1 | emr-6.9.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.397 | 1.12.397 | 1.12.170 | 1.12.170 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.2.0 | 2.2.0 | 2.1.0 | 2.1.0 | | Flink | 1.16.0 | 1.16.0 | 1.15.2 | 1.15.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.15-amzn-0.1 | 2.4.15-amzn-0 | 2.4.13-amzn-0.1 | 2.4.13-amzn-0 | | HCatalog | 3.1.3-amzn-3.1 | 3.1.3-amzn-3 | 3.1.3-amzn-2.1 | 3.1.3-amzn-2 | | Hadoop | 3.3.3-amzn-2.1 | 3.3.3-amzn-2 | 3.3.3-amzn-1.1 | 3.3.3-amzn-1 | | Hive | 3.1.3-amzn-3.1 | 3.1.3-amzn-3 | 3.1.3-amzn-2.1 | 3.1.3-amzn-2 | | Hudi | 0.12.2-amzn-0 | 0.12.2-amzn-0 | 0.12.1-amzn-0 | 0.12.1-amzn-0 | | Hue | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | | Iceberg | 1.1.0-amzn-0 | 1.1.0-amzn-0 | 0.14.1-amzn-0 | 0.14.1-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.6.0 | | JupyterHub | 1.5.0 | 1.5.0 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.278.1-amzn-0 | 0.278.1-amzn-0 | 0,276 amzn-0 | 0,276 amzn-0 | | Spark | 3.3.1-amzn-0.1 | 3.3.1-amzn-0 | 3.3.0-amzn-1.1 | 3.3.0-amzn-1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.11.0 | 2.11.0 | 2.10.0 | 2.10.0 | | Tez | 0.10.2-amzn-1.1 | 0.10.2-amzn-1 | 0.10.2-amzn-0.1 | 0.10.2-amzn-0 | | Trino (PrestoSQL) | 403-amzn-0 | 403-amzn-0 | 398-amzn-0 | 398-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | ## 6.10.1 Catatan terbitan Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 6.10.1. Perubahan relatif terhadap 6.10.0. Untuk informasi tentang timeline rilis, lihat. [6.10.1 perubahan log](#6101-changelog) **Masalah yang Diketahui** + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Karena pertikaian kunci, sebuah node dapat masuk ke dalam kebuntuan jika ditambahkan atau dihapus pada saat yang sama ketika ia mencoba untuk menonaktifkan. Akibatnya, Hadoop Resource Manager (YARN) menjadi tidak responsif, dan memengaruhi semua kontainer yang masuk dan saat ini berjalan. + Hadoop 3.3.3 memperkenalkan perubahan pada YARN ([YARN-9608](https://issues.apache.org/jira/browse/YARN-9608)) yang membuat node tempat kontainer berjalan dalam keadaan dekomisioning hingga aplikasi selesai. Perubahan ini memastikan bahwa data lokal seperti data acak tidak hilang, dan Anda tidak perlu menjalankan kembali pekerjaan. Pendekatan ini juga dapat menyebabkan kurangnya pemanfaatan sumber daya pada cluster dengan atau tanpa penskalaan terkelola diaktifkan. Dengan Amazon EMR merilis 6.11.0 dan yang lebih tinggi serta 6.8.1, 6.9.1, dan 6.10.1, nilai ditetapkan untuk mengatasi masalah ini. `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-applications` `false` `yarn-site.xml` Sementara perbaikan mengatasi masalah yang diperkenalkan oleh YARN-9608, hal itu dapat menyebabkan pekerjaan Hive gagal karena kehilangan data acak pada cluster yang telah mengelola penskalaan diaktifkan. Kami telah mengurangi risiko itu dalam rilis ini dengan juga menyetel `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-shuffle-data` beban kerja Hive. Konfigurasi ini hanya tersedia dengan rilis Amazon EMR 6.11.0 dan yang lebih tinggi. + Kolektor metrik tidak akan mengirim metrik apa pun ke bidang kontrol setelah failover node primer dalam cluster dengan konfigurasi grup instance. + Rilis ini mencakup perubahan yang memungkinkan cluster ketersediaan tinggi pulih dari status gagal setelah restart. + Rilis ini mencakup perbaikan keamanan untuk Hue dan. HBase + Rilis ini memperbaiki masalah di mana cluster yang menjalankan beban kerja di Spark dengan Amazon EMR mungkin diam-diam menerima hasil yang salah dengan,,, dan. `contains` `startsWith` `endsWith` `like` Masalah ini terjadi saat Anda menggunakan ekspresi pada bidang yang dipartisi yang memiliki metadata di Amazon EMR Hive3 Metastore Server (HMS). + Rilis ini memperbaiki masalah dengan pelambatan di sisi Glue ketika tidak ada fungsi yang ditentukan pengguna (UDF). + Rilis ini memperbaiki masalah yang menghapus log kontainer oleh layanan agregasi log node sebelum pendorong log dapat mendorongnya ke S3 jika terjadi penonaktifan YARN. + Rilis ini memperbaiki masalah dengan metrik FairShare Scheduler saat Node Label diaktifkan untuk Hadoop. + Rilis ini memperbaiki masalah yang memengaruhi kinerja Spark saat Anda menetapkan `true` nilai default untuk konfigurasi. `spark.yarn.heterogeneousExecutors.enabled` `spark-defaults.conf` + Rilis ini memperbaiki masalah dengan Mengurangi Tugas yang gagal membaca data acak. Masalah ini menyebabkan kegagalan kueri Hive dengan kesalahan memori yang rusak. + Rilis ini menambahkan mekanisme coba lagi baru ke alur kerja penskalaan cluster untuk kluster EMR yang menjalankan Presto atau Trino. Peningkatan ini mengurangi risiko bahwa pengubahan ukuran cluster akan terhenti tanpa batas karena satu operasi pengubahan ukuran yang gagal. Ini juga meningkatkan pemanfaatan cluster, karena kluster Anda naik dan turun lebih cepat. + Rilis ini meningkatkan logika penskalaan klaster sehingga klaster Anda tidak mencoba menurunkan skala node inti di bawah pengaturan faktor replikasi HDFS untuk cluster. Ini sejalan dengan persyaratan redundansi data Anda, dan mengurangi kemungkinan operasi penskalaan mungkin terhenti. + Daemon manajemen log telah ditingkatkan untuk mengidentifikasi semua log yang digunakan secara aktif dengan pegangan file terbuka pada penyimpanan instance lokal, dan proses terkait. Peningkatan ini memastikan bahwa Amazon EMR menghapus file dengan benar dan merebut kembali ruang penyimpanan setelah log diarsipkan ke Amazon S3. + Rilis ini mencakup peningkatan daemon manajemen log yang menghapus direktori langkah kosong dan tidak terpakai di sistem file cluster lokal. Sejumlah besar direktori kosong dapat menurunkan kinerja daemon EMR Amazon dan mengakibatkan pemanfaatan disk yang berlebihan. + Rilis ini memperbaiki masalah yang mungkin terjadi saat Anda membuat simpul tepi dengan mereplikasi salah satu node utama dari cluster dengan beberapa node primer. Node tepi yang direplikasi dapat menyebabkan penundaan dengan operasi penskalaan, atau mengakibatkan pemanfaatan memori yang tinggi pada node utama. Untuk informasi selengkapnya tentang cara membuat simpul tepi untuk berkomunikasi dengan cluster EMR Anda, lihat [Edge Node Creator](https://github.com/aws-samples/aws-emr-utilities/tree/main/utilities/emr-edge-node-creator) di `aws-samples` repo. GitHub + Rilis ini meningkatkan proses otomatisasi yang digunakan Amazon EMR untuk memasang kembali volume Amazon EBS ke instance setelah reboot. + Rilis ini memperbaiki masalah yang mengakibatkan celah intermiten dalam metrik Hadoop yang diterbitkan Amazon EMR ke Amazon. CloudWatch + Rilis ini memperbaiki masalah dengan kluster EMR di mana pembaruan ke file konfigurasi YARN yang berisi daftar pengecualian node untuk cluster terganggu karena pemanfaatan disk yang berlebihan. Pembaruan yang tidak lengkap menghalangi operasi penskalaan klaster masa depan. Rilis ini memastikan bahwa klaster Anda tetap sehat, dan operasi penskalaan berfungsi seperti yang diharapkan. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-6101-release.html) ## 6.10.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.2.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.7.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.24.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.3.0 | EMR S3Select Connector | | emr-wal-cli | 1.0.0 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.55.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.16.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.16.0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.3-amzn-2.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.3-amzn-2.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.3-amzn-2.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.3-amzn-2.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.3-amzn-2.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.3-amzn-2.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.3-amzn-2.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.3-amzn-2.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.3-amzn-2.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.3-amzn-2.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.3-amzn-2.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.15-amzn-0.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.15-amzn-0.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.15-amzn-0.1 | HBase klien baris perintah. | | hbase-rest-server | 2.4.15-amzn-0.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.15-amzn-0.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.15-amzn-0.1 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-3.1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-3.1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-3.1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-3.1 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-3.1 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-3.1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-3.1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.12.2-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.12.2-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.12.2-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.12.2-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.1.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0-SNAPSHOT | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.278.1-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.278.1-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.278.1-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 403-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 403-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 403-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.3.1-amzn-0.1 | Klien baris perintah Spark. | | spark-history-server | 3.3.1-amzn-0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.3.1-amzn-0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.3.1-amzn-0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 22.12.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-1.1 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-1.1 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.10.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.10.1** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.10.1 perubahan log **Ubah log untuk catatan rilis dan rilis 6.10.1** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2023-08-30 | Perbarui catatan rilis | Menambahkan beberapa perbaikan terkait bidang kontrol ke catatan rilis | | 2023-08-21 | Publikasi Docs | Amazon EMR 6.10.1 catatan rilis pertama kali diterbitkan | | 2023-08-16 | Penerapan selesai | [Amazon EMR 6.10.1 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-08-04 | Rilis awal | Amazon EMR 6.10.1 pertama kali dikerahkan ke Wilayah komersial terbatas | # Amazon EMR rilis 6.10.0 ## 6.10.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.10.0 | emr-6.9.1 | emr-6.9.0 | emr-6.8.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.397 | 1.12.170 | 1.12.170 | 1.12.170 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.2.0 | 2.1.0 | 2.1.0 | - | | Flink | 1.16.0 | 1.15.2 | 1.15.2 | 1.15.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.15-amzn-0 | 2.4.13-amzn-0.1 | 2.4.13-amzn-0 | 2.4.12-amzn-0.1 | | HCatalog | 3.1.3-amzn-3 | 3.1.3-amzn-2.1 | 3.1.3-amzn-2 | 3.1.3-amzn-1.1 | | Hadoop | 3.3.3-amzn-2 | 3.3.3-amzn-1.1 | 3.3.3-amzn-1 | 3.2.1-amzn-8.1 | | Hive | 3.1.3-amzn-3 | 3.1.3-amzn-2.1 | 3.1.3-amzn-2 | 3.1.3-amzn-1.1 | | Hudi | 0.12.2-amzn-0 | 0.12.1-amzn-0 | 0.12.1-amzn-0 | 0.11.1-amzn-0 | | Hue | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | | Iceberg | 1.1.0-amzn-0 | 0.14.1-amzn-0 | 0.14.1-amzn-0 | 0.14.0-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.6.0 | 2.1.0 | | JupyterHub | 1.5.0 | 1.4.1 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.278.1-amzn-0 | 0,276 amzn-0 | 0,276 amzn-0 | 0.273.3-amzn-0 | | Spark | 3.3.1-amzn-0 | 3.3.0-amzn-1.1 | 3.3.0-amzn-1 | 3.3.0-amzn-0.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.11.0 | 2.10.0 | 2.10.0 | 2.9.1 | | Tez | 0.10.2-amzn-1 | 0.10.2-amzn-0.1 | 0.10.2-amzn-0 | 0.9.2 | | Trino (PrestoSQL) | 403-amzn-0 | 398-amzn-0 | 398-amzn-0 | 388-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | ## Catatan terbitan 6.10.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 6.10.0. Perubahan relatif terhadap 6.9.0. Untuk informasi tentang timeline rilis, lihat [log perubahan](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-6100-release.html#6100-changelog). **Fitur baru** + Amazon EMR 6.10.0 mendukung Apache Spark 3.3.1, Apache Spark RAPIDS 22.12.0, CUDA 11.8.0, Apache Hudi 0.12.2-amzn-0, Apache Iceberg 1.1.0-amzn-0, Trino 403, dan PrestoDB 0.278.1. + Amazon EMR 6.10.0 menyertakan konektor Trino-Hudi asli yang menyediakan akses baca ke data dalam tabel Hudi. Anda dapat mengaktifkan konektor dengan`trino-cli --catalog hudi`, dan mengkonfigurasi konektor untuk kebutuhan Anda`trino-connector-hudi`. Integrasi asli dengan Amazon EMR berarti Anda tidak perlu lagi menggunakan `trino-connector-hive` untuk menanyakan tabel Hudi. Untuk daftar konfigurasi yang didukung dengan konektor baru, lihat halaman [konektor Hudi](https://trino.io/docs/current/connector/hudi.html) dari dokumentasi Trino. + Amazon EMR merilis 6.10.0 dan lebih tinggi mendukung integrasi Apache Zeppelin dengan Apache Flink. Untuk informasi selengkapnya, lihat [Bekerja dengan pekerjaan Flink dari Zeppelin di Amazon EMR](flink-zeppelin.md). **Masalah yang Diketahui** + Hadoop 3.3.3 memperkenalkan perubahan pada YARN ([YARN-9608](https://issues.apache.org/jira/browse/YARN-9608)) yang membuat node tempat kontainer berjalan dalam keadaan dekomisioning hingga aplikasi selesai. Perubahan ini memastikan bahwa data lokal seperti data acak tidak hilang, dan Anda tidak perlu menjalankan kembali pekerjaan. Pendekatan ini juga dapat menyebabkan kurangnya pemanfaatan sumber daya pada cluster dengan atau tanpa penskalaan terkelola diaktifkan. Untuk mengatasi masalah ini di Amazon EMR 6.10.0, Anda dapat mengatur nilai ke in. `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-applications` `false` `yarn-site.xml` Di Amazon EMR merilis 6.11.0 dan yang lebih tinggi serta 6.8.1, 6.9.1, dan 6.10.1, konfigurasi disetel ke default untuk menyelesaikan masalah ini. `false` + *Dimulai dengan Spark 3.3.1 (didukung dalam EMR versi 6.10 dan yang lebih baru), semua pelaksana dalam host dekomisioning diatur ke yang baru, yang disebut status DECOMMISSIONING. `ExecutorState`* Pelaksana yang dinonaktifkan tidak dapat digunakan oleh Yarn untuk mengalokasikan tugas dan dengan demikian akan meminta pelaksana baru, jika diperlukan, untuk tugas yang sedang dijalankan. Jadi, jika Anda menonaktifkan Spark DRA saat menggunakan EMR Managed Scaling, EMR Auto Scaling, atau mekanisme penskalaan khusus apa pun pada cluster EMR-EC2, maka Yarn dapat meminta pelaksana maksimum yang diizinkan untuk setiap pekerjaan. Untuk menghindari masalah ini, biarkan `spark.dynamicAllocation.enabled` properti disetel ke `TRUE` (yang merupakan default) saat Anda menggunakan kombinasi fitur di atas. Selain itu, Anda juga dapat mengatur batasan pelaksana minimum dan maksimum dengan menetapkan nilai untuk `spark.dynamicAllocation.maxExecutors` dan `spark.dynamicAllocation.minExecutors` properti untuk pekerjaan Spark Anda, untuk membatasi jumlah pelaksana yang dialokasikan selama eksekusi pekerjaan. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Amazon EMR 6.10.0 menghapus dependensi [untuk integrasi `minimal-json.jar` Amazon Redshift untuk Apache Spark, dan secara otomatis menambahkan stoples terkait Spark-Redshift](emr-spark-redshift-launch.md) yang diperlukan ke jalur kelas pelaksana untuk Spark:,, dan. `spark-redshift.jar` `spark-avro.jar` `RedshiftJDBC.jar` + Rilis 6.10.0 meningkatkan daemon manajemen log on-cluster untuk memantau folder log tambahan di cluster EMR Anda. Peningkatan ini meminimalkan skenario pemanfaatan disk yang berlebihan. + Rilis 6.10.0 secara otomatis memulai ulang daemon manajemen log on-cluster saat berhenti. Peningkatan ini mengurangi risiko node tampak tidak sehat karena pemanfaatan disk yang berlebihan. + Amazon EMR 6.10.0 mendukung titik akhir regional untuk pemetaan pengguna EMRFS. + Ukuran volume root default telah meningkat menjadi 15 GB di Amazon EMR 6.10.0 dan lebih tinggi. Rilis sebelumnya memiliki ukuran volume root default 10 GB. + Rilis 6.10.0 memperbaiki masalah yang menyebabkan pekerjaan Spark terhenti saat semua pelaksana Spark yang tersisa berada di host penonaktifan dengan manajer sumber daya YARN. + Dengan Amazon EMR 6.6.0 hingga 6.9.x, kueri INSERT dengan partisi dinamis dan klausa ORDER BY atau SORT BY akan selalu memiliki dua reduksi. Masalah ini disebabkan oleh perubahan OSS [HIVE-20703](https://issues.apache.org/jira/browse/HIVE-20703), yang menempatkan optimasi partisi pengurutan dinamis di bawah keputusan berbasis biaya. Jika beban kerja Anda tidak memerlukan penyortiran partisi dinamis, kami sarankan Anda mengatur `hive.optimize.sort.dynamic.partition.threshold` properti `-1` untuk menonaktifkan fitur baru dan mendapatkan jumlah reduksi yang dihitung dengan benar. Masalah ini diperbaiki di OSS Hive sebagai bagian dari [HIVE-22269 dan](https://issues.apache.org/jira/browse/HIVE-22269) diperbaiki di Amazon EMR 6.10.0. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). **catatan** Rilis ini tidak lagi mendapatkan pembaruan AMI otomatis karena telah digantikan oleh 1 rilis patch lagi. Rilis patch dilambangkan dengan angka setelah titik desimal kedua (). `6.8.1` Untuk melihat apakah Anda menggunakan rilis patch terbaru, periksa rilis yang tersedia di [https://docs.aws.amazon.com/emr/latest/ReleaseGuide](https://docs.aws.amazon.com/emr/latest/ReleaseGuide), atau periksa dropdown **rilis Amazon EMR** saat Anda membuat klaster di konsol, atau gunakan tindakan API [https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html](https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html)atau CLI. [https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html](https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html) Untuk mendapatkan pembaruan tentang rilis baru, berlangganan umpan RSS di [Apa yang baru?](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html) halaman. [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-6100-release.html) ## 6.10.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.2.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.7.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.24.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.3.0 | EMR S3Select Connector | | emr-wal-cli | 1.0.0 | Cli digunakan untuk daftar emrwal/penghapusan. | | emrfs | 2.55.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.16.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.16.0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.3-amzn-2 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.15-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.15-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.15-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.4.15-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.15-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.15-amzn-0 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-3 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-3 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-3 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-3 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-3 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-3 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-3 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.12.2-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.12.2-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.12.2-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.12.2-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 1.1.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.5.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.8.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0-SNAPSHOT | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.278.1-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.278.1-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.278.1-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 403-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 403-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 403-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.3.1-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.3.1-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.3.1-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.3.1-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 22.12.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-1 | Aplikasi dan perpustakaan tez YARN. | | tez-on-worker | 0.10.2-amzn-1 | Aplikasi dan pustaka YARN tez untuk node pekerja. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.10.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.10.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hudi | Ubah nilai dalam file hudi.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-logback | Ubah nilai dalam file kms-logback.xml dari Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.10.0 perubahan log **Ubah log untuk catatan rilis dan rilis 6.10.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2023-08-21 | Perbarui | Menambahkan masalah yang diketahui diperkenalkan dengan Hadoop 3.3.3. | | 2023-07-26 | Perbarui | Label rilis OS baru 2.0.20230612.0 dan2.0.20230628.0. | | 2023-03-02 | Penerapan selesai | [Amazon EMR 6.10 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-03-02 | Publikasi Docs | Amazon EMR 6.10 catatan rilis pertama kali diterbitkan | | 2023-02-27 | Rilis awal | Amazon EMR 6.10 dikerahkan ke Wilayah komersial terbatas | # Amazon EMR rilis 6.9.1 ## 6.9.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.9.1 | emr-6.9.0 | emr-6.8.1 | emr-6.8.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.170 | 1.12.170 | 1.12.170 | 1.12.170 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.1.0 | 2.1.0 | - | - | | Flink | 1.15.2 | 1.15.2 | 1.15.1 | 1.15.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.13-amzn-0.1 | 2.4.13-amzn-0 | 2.4.12-amzn-0.1 | 2.4.12-amzn-0 | | HCatalog | 3.1.3-amzn-2.1 | 3.1.3-amzn-2 | 3.1.3-amzn-1.1 | 3.1.3-amzn-1 | | Hadoop | 3.3.3-amzn-1.1 | 3.3.3-amzn-1 | 3.2.1-amzn-8.1 | 3.2.1-amzn-8 | | Hive | 3.1.3-amzn-2.1 | 3.1.3-amzn-2 | 3.1.3-amzn-1.1 | 3.1.3-amzn-1 | | Hudi | 0.12.1-amzn-0 | 0.12.1-amzn-0 | 0.11.1-amzn-0 | 0.11.1-amzn-0 | | Hue | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | | Iceberg | 0.14.1-amzn-0 | 0.14.1-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.9.1 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,276 amzn-0 | 0,276 amzn-0 | 0.273.3-amzn-0 | 0.273.3-amzn-0 | | Spark | 3.3.0-amzn-1.1 | 3.3.0-amzn-1 | 3.3.0-amzn-0.1 | 3.3.0-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.10.0 | 2.10.0 | 2.9.1 | 2.9.1 | | Tez | 0.10.2-amzn-0.1 | 0.10.2-amzn-0 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 398-amzn-0 | 398-amzn-0 | 388-amzn-0 | 388-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.1 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.10 | ## 6.9.1 Catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.9.1. Perubahan relatif terhadap 6.9.0. Untuk informasi tentang timeline rilis, lihat. [6.9.1 perubahan log](#691-changelog) **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Hadoop 3.3.3 memperkenalkan perubahan pada YARN ([YARN-9608](https://issues.apache.org/jira/browse/YARN-9608)) yang membuat node tempat kontainer berjalan dalam keadaan dekomisioning hingga aplikasi selesai. Perubahan ini memastikan bahwa data lokal seperti data acak tidak hilang, dan Anda tidak perlu menjalankan kembali pekerjaan. Pendekatan ini juga dapat menyebabkan kurangnya pemanfaatan sumber daya pada cluster dengan atau tanpa penskalaan terkelola diaktifkan. Dengan Amazon EMR merilis 6.11.0 dan yang lebih tinggi serta 6.8.1, 6.9.1, dan 6.10.1, nilai ditetapkan untuk mengatasi masalah ini. `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-applications` `false` `yarn-site.xml` Sementara perbaikan mengatasi masalah yang diperkenalkan oleh YARN-9608, hal itu dapat menyebabkan pekerjaan Hive gagal karena kehilangan data acak pada cluster yang telah mengelola penskalaan diaktifkan. Kami telah mengurangi risiko itu dalam rilis ini dengan juga menyetel `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-shuffle-data` beban kerja Hive. Konfigurasi ini hanya tersedia dengan rilis Amazon EMR 6.11.0 dan yang lebih tinggi. + Kolektor metrik tidak akan mengirim metrik apa pun ke bidang kontrol setelah failover node primer dalam cluster dengan konfigurasi grup instance. + Rilis ini menghilangkan percobaan ulang pada permintaan HTTP yang gagal ke titik akhir kolektor metrik. + Rilis ini mencakup perubahan yang memungkinkan cluster ketersediaan tinggi pulih dari status gagal setelah restart. + Rilis ini memperbaiki masalah di mana pengguna besar yang dibuat UIDs menyebabkan pengecualian overflow. + Rilis ini memperbaiki masalah batas waktu dengan proses konfigurasi ulang Amazon EMR. + Rilis ini mencakup perbaikan keamanan. + Rilis ini memperbaiki masalah di mana cluster yang menjalankan beban kerja di Spark dengan Amazon EMR mungkin diam-diam menerima hasil yang salah dengan,,, dan. `contains` `startsWith` `endsWith` `like` Masalah ini terjadi saat Anda menggunakan ekspresi pada bidang yang dipartisi yang memiliki metadata di Amazon EMR Hive3 Metastore Server (HMS). + Dengan Amazon EMR 6.6.0 hingga 6.9.x, kueri INSERT dengan partisi dinamis dan klausa ORDER BY atau SORT BY akan selalu memiliki dua reduksi. Masalah ini disebabkan oleh perubahan OSS [HIVE-20703](https://issues.apache.org/jira/browse/HIVE-20703), yang menempatkan optimasi partisi pengurutan dinamis di bawah keputusan berbasis biaya. Jika beban kerja Anda tidak memerlukan penyortiran partisi dinamis, kami sarankan Anda mengatur `hive.optimize.sort.dynamic.partition.threshold` properti `-1` untuk menonaktifkan fitur baru dan mendapatkan jumlah reduksi yang dihitung dengan benar. Masalah ini diperbaiki di OSS Hive sebagai bagian dari [HIVE-22269 dan](https://issues.apache.org/jira/browse/HIVE-22269) diperbaiki di Amazon EMR 6.10.0. + Hive mungkin mengalami kehilangan data ketika Anda menggunakan HDFS sebagai direktori awal dan Anda telah mengaktifkan menggabungkan file kecil, dan tabel berisi jalur partisi statis. + Rilis ini memperbaiki masalah kinerja dengan Hive jika menggabungkan file kecil (dinonaktifkan secara default) diaktifkan di akhir pekerjaan ETL. + Rilis ini memperbaiki masalah dengan pelambatan di sisi Glue ketika tidak ada fungsi yang ditentukan pengguna (UDF). + Rilis ini memperbaiki masalah yang menghapus log kontainer oleh layanan agregasi log node sebelum pendorong log dapat mendorongnya ke S3 jika terjadi penonaktifan YARN. + Rilis ini memperbaiki penanganan file yang dipadat/diarsipkan dengan pelacakan file penyimpanan persisten untuk. HBase + Rilis ini memperbaiki masalah yang memengaruhi kinerja Spark saat Anda menetapkan `true` nilai default untuk konfigurasi. `spark.yarn.heterogeneousExecutors.enabled` `spark-defaults.conf` + Rilis ini memperbaiki masalah dengan Mengurangi Tugas yang gagal membaca data acak. Masalah ini menyebabkan kegagalan kueri Hive dengan kesalahan memori yang rusak. + Rilis ini memperbaiki masalah yang menyebabkan penyedia node gagal jika layanan HDFS NameNode (NN) macet di safemode selama penggantian node. + Rilis ini menambahkan mekanisme coba lagi baru ke alur kerja penskalaan cluster untuk kluster EMR yang menjalankan Presto atau Trino. Peningkatan ini mengurangi risiko bahwa pengubahan ukuran cluster akan terhenti tanpa batas karena satu operasi pengubahan ukuran yang gagal. Ini juga meningkatkan pemanfaatan cluster, karena kluster Anda naik dan turun lebih cepat. + Rilis ini meningkatkan logika penskalaan klaster sehingga klaster Anda tidak mencoba menurunkan skala node inti di bawah pengaturan faktor replikasi HDFS untuk cluster. Ini sejalan dengan persyaratan redundansi data Anda, dan mengurangi kemungkinan operasi penskalaan mungkin terhenti. + Daemon manajemen log telah ditingkatkan untuk mengidentifikasi semua log yang digunakan secara aktif dengan pegangan file terbuka pada penyimpanan instance lokal, dan proses terkait. Peningkatan ini memastikan bahwa Amazon EMR menghapus file dengan benar dan merebut kembali ruang penyimpanan setelah log diarsipkan ke Amazon S3. + Rilis ini mencakup peningkatan daemon manajemen log yang menghapus direktori langkah kosong dan tidak terpakai di sistem file cluster lokal. Sejumlah besar direktori kosong dapat menurunkan kinerja daemon EMR Amazon dan mengakibatkan pemanfaatan disk yang berlebihan. + Rilis ini memperbaiki masalah yang mungkin terjadi saat Anda membuat simpul tepi dengan mereplikasi salah satu node utama dari cluster dengan beberapa node primer. Node tepi yang direplikasi dapat menyebabkan penundaan dengan operasi penskalaan, atau mengakibatkan pemanfaatan memori yang tinggi pada node utama. Untuk informasi selengkapnya tentang cara membuat simpul tepi untuk berkomunikasi dengan cluster EMR Anda, lihat [Edge Node Creator](https://github.com/aws-samples/aws-emr-utilities/tree/main/utilities/emr-edge-node-creator) di `aws-samples` repo. GitHub + Rilis ini meningkatkan proses otomatisasi yang digunakan Amazon EMR untuk memasang kembali volume Amazon EBS ke instance setelah reboot. + Rilis ini memperbaiki masalah yang mengakibatkan celah intermiten dalam metrik Hadoop yang diterbitkan Amazon EMR ke Amazon. CloudWatch + Rilis ini memperbaiki masalah dengan kluster EMR di mana pembaruan ke file konfigurasi YARN yang berisi daftar pengecualian node untuk cluster terganggu karena pemanfaatan disk yang berlebihan. Pembaruan yang tidak lengkap menghalangi operasi penskalaan klaster masa depan. Rilis ini memastikan bahwa klaster Anda tetap sehat, dan operasi penskalaan berfungsi seperti yang diharapkan. + Rilis ini meningkatkan daemon manajemen log on-cluster untuk memantau folder log tambahan di kluster EMR Anda. Peningkatan ini meminimalkan skenario pemanfaatan disk yang berlebihan. + Rilis ini secara otomatis me-restart daemon manajemen log on-cluster ketika berhenti. Peningkatan ini mengurangi risiko node tampak tidak sehat karena pemanfaatan disk yang berlebihan. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-691-release.html) ## 6.9.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.1.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.6.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.23.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.2.0 | EMR S3Select Connector | | emrfs | 2.54.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.15.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.15.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.3-amzn-1.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.3-amzn-1.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.3-amzn-1.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.3-amzn-1.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.3-amzn-1.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.3-amzn-1.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.3-amzn-1.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.3-amzn-1.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.3-amzn-1.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.3-amzn-1.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.3-amzn-1.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.13-amzn-0.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.13-amzn-0.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.13-amzn-0.1 | HBase klien baris perintah. | | hbase-rest-server | 2.4.13-amzn-0.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.13-amzn-0.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.13-amzn-0.1 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-2.1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-2.1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-2.1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-2.1 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-2.1 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-2.1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-2.1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.12.1-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.12.1-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.12.1-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.12.1-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 0.14.1-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.7.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0-SNAPSHOT | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,276 amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,276 amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,276 amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 398-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 398-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 398-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.3.0-amzn-1.1 | Klien baris perintah Spark. | | spark-history-server | 3.3.0-amzn-1.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.3.0-amzn-1.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.3.0-amzn-1.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 22.08.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.10.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-0.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.9.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.9.1** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.9.1 perubahan log **Ubah log untuk catatan rilis dan rilis 6.9.1** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2023-08-30 | Perbarui catatan rilis | Menambahkan beberapa perbaikan terkait bidang kontrol ke catatan rilis | | 2023-08-21 | Publikasi Docs | Amazon EMR 6.9.1 catatan rilis pertama kali diterbitkan | | 2023-08-16 | Penerapan selesai | [Amazon EMR 6.9.1 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-08-04 | Rilis awal | Amazon EMR 6.9.1 pertama kali dikerahkan ke Wilayah komersial terbatas | # Amazon EMR rilis 6.9.0 ## 6.9.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://delta.io/](https://delta.io/), [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.9.0 | emr-6.8.1 | emr-6.8.0 | emr-6.7.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.170 | 1.12.170 | 1.12.170 | 1.12.170 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.15 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | 2.1.0 | - | - | - | | Flink | 1.15.2 | 1.15.1 | 1.15.1 | 1.14.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.13-amzn-0 | 2.4.12-amzn-0.1 | 2.4.12-amzn-0 | 2.4.4-amzn-3 | | HCatalog | 3.1.3-amzn-2 | 3.1.3-amzn-1.1 | 3.1.3-amzn-1 | 3.1.3-amzn-0 | | Hadoop | 3.3.3-amzn-1 | 3.2.1-amzn-8.1 | 3.2.1-amzn-8 | 3.2.1-amzn-7 | | Hive | 3.1.3-amzn-2 | 3.1.3-amzn-1.1 | 3.1.3-amzn-1 | 3.1.3-amzn-0 | | Hudi | 0.12.1-amzn-0 | 0.11.1-amzn-0 | 0.11.1-amzn-0 | 0.11.0-amzn-0 | | Hue | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | | Iceberg | 0.14.1-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.13.1-amzn-0 | | JupyterEnterpriseGateway | 2.6.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.9.1 | 1.8.0 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,276 amzn-0 | 0.273.3-amzn-0 | 0.273.3-amzn-0 | 0,272-amzn-0 | | Spark | 3.3.0-amzn-1 | 3.3.0-amzn-0.1 | 3.3.0-amzn-0 | 3.2.1-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.10.0 | 2.9.1 | 2.9.1 | 2.4.1 | | Tez | 0.10.2-amzn-0 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 398-amzn-0 | 388-amzn-0 | 388-amzn-0 | 378-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.1 | 0.10.0 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.10 | 3.5.7 | ## Catatan rilis 6.9.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.9.0. Perubahan relatif terhadap Amazon EMR rilis 6.8.0. Untuk informasi tentang timeline rilis, lihat [log perubahan](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-690-release.html#690-changelog). **Fitur Baru** + Amazon EMR rilis 6.9.0 mendukung Apache Spark RAPIDS 22.08.0, Apache Hudi 0.12.1, Apache Iceberg 0.14.1, Trino 398, dan Tez 0.10.2. + Amazon EMR rilis 6.9.0 menyertakan aplikasi open-source baru, 2.1.0. [Danau Delta](emr-delta.md) + Integrasi Amazon Redshift untuk Apache Spark disertakan dalam rilis Amazon EMR 6.9.0 dan yang lebih baru. Sebelumnya alat open-source, integrasi asli adalah konektor Spark yang dapat Anda gunakan untuk membangun aplikasi Apache Spark yang membaca dan menulis ke data di Amazon Redshift dan Amazon Redshift Serverless. Untuk informasi selengkapnya, lihat [Menggunakan integrasi Amazon Redshift untuk Apache Spark dengan Amazon EMR](emr-spark-redshift.md). + Amazon EMR rilis 6.9.0 menambahkan dukungan untuk pengarsipan log ke Amazon S3 selama penskalaan klaster turun. Sebelumnya, Anda hanya dapat mengarsipkan file log ke Amazon S3 selama penghentian klaster. Kemampuan baru memastikan bahwa file log yang dihasilkan di cluster tetap ada di Amazon S3 bahkan setelah node dihentikan. Untuk informasi selengkapnya, lihat [Mengkonfigurasi logging dan debug klaster](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-debugging.html). + Untuk mendukung kueri yang berjalan lama, Trino sekarang menyertakan mekanisme eksekusi yang toleran terhadap kesalahan. Eksekusi toleran kesalahan mengurangi kegagalan kueri dengan mencoba kembali kueri yang gagal atau tugas komponennya. + Anda dapat menggunakan Apache Flink di Amazon EMR untuk menyatukan `BATCH` dan `STREAM` memproses Tabel Apache Hive atau metadata dari semua sumber meja Flink seperti Gunung Es, Kinesis, atau Kafka. Anda dapat menentukan Katalog Data AWS Glue sebagai metastore untuk Flink menggunakan Konsol Manajemen AWS,, AWS CLI atau Amazon EMR API. Untuk informasi selengkapnya, lihat [Mengkonfigurasi Flink di Amazon EMR](flink-configure.md). + Sekarang Anda dapat menentukan peran runtime AWS Identity and Access Management (IAM) dan kontrol akses AWS Lake Formation berbasis untuk kueri Apache Spark, Apache Hive, dan Presto di Amazon EMR pada kluster EC2 dengan Amazon AI Studio. SageMaker Untuk informasi selengkapnya, lihat [Mengonfigurasi peran runtime untuk langkah-langkah EMR Amazon](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-steps-runtime-roles.html). **Masalah yang Diketahui** + Untuk Amazon EMR rilis 6.9.0, Trino tidak bekerja pada cluster yang diaktifkan untuk Apache Ranger. Jika Anda perlu menggunakan Trino dengan Ranger, hubungi. [Dukungan](https://console.aws.amazon.com/support/home#/) + Jika Anda menggunakan integrasi Amazon Redshift untuk Apache Spark dan memiliki waktu, jadwal, stempel waktu, atau timestamptz dengan presisi mikrodetik dalam format Parket, konektor membulatkan nilai waktu ke nilai milidetik terdekat. Sebagai solusinya, gunakan parameter format pembongkaran teks. `unload_s3_format` + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` + **Koneksi ke kluster EMR Amazon dari Amazon SageMaker AI Studio mungkin sebentar-sebentar gagal dengan kode respons 403 Forbidden.** Kesalahan ini terjadi ketika pengaturan peran IAM di cluster membutuhkan waktu lebih dari 60 detik. Sebagai solusinya, Anda dapat menginstal patch EMR Amazon untuk mengaktifkan percobaan ulang dan meningkatkan batas waktu hingga minimal 300 detik. Gunakan langkah-langkah berikut untuk menerapkan tindakan bootstrap saat Anda meluncurkan cluster Anda. 1. Unduh skrip bootstrap dan file RPM dari Amazon URIs S3 berikut. ``` s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/gcsc/replace-rpms.sh s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/gcsc/emr-secret-agent-1.18.0-SNAPSHOT20221121212949.noarch.rpm ``` 1. Unggah file dari langkah sebelumnya ke bucket Amazon S3 yang Anda miliki. Ember harus berada di tempat yang sama Wilayah AWS di mana Anda berencana untuk meluncurkan cluster. 1. Sertakan tindakan bootstrap berikut saat Anda meluncurkan cluster EMR Anda. Ganti *bootstrap\$1URI* dan *RPM\$1URI* dengan yang sesuai URIs dari Amazon S3. ``` --bootstrap-actions "Path=bootstrap_URI,Args=[RPM_URI]" ``` + Dengan Amazon EMR merilis 5.36.0 dan 6.6.0 hingga 6.9.0, `SecretAgent` dan komponen `RecordServer` layanan mungkin mengalami kehilangan data log karena konfigurasi pola nama file yang salah di properti Log4j2. Konfigurasi yang salah menyebabkan komponen menghasilkan hanya satu file log per hari. Ketika strategi rotasi terjadi, ia menimpa file yang ada alih-alih menghasilkan file log baru seperti yang diharapkan. Sebagai solusinya, gunakan tindakan bootstrap untuk menghasilkan file log setiap jam dan tambahkan bilangan bulat kenaikan otomatis dalam nama file untuk menangani rotasi. Untuk Amazon EMR 6.6.0 hingga 6.9.0 rilis, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-6x/replace-puppet.sh,Args=[]" ``` Untuk Amazon EMR 5.36.0, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-5x/replace-puppet.sh,Args=[]" ``` + Apache Flink menyediakan Native S3 FileSystem dan Hadoop FileSystem Connectors, yang memungkinkan aplikasi membuat FileSink dan menulis data ke Amazon S3. Ini FileSink gagal dengan salah satu dari dua pengecualian berikut. ``` java.lang.UnsupportedOperationException: Recoverable writers on Hadoop are only supported for HDFS ``` ``` Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.io.retry.RetryPolicies.retryOtherThanRemoteAndSaslException(Lorg/apache/hadoop/io/retry/RetryPolicy;Ljava/util/Map;)Lorg/apache/hadoop/io/retry/RetryPolicy; at org.apache.hadoop.yarn.client.RMProxy.createRetryPolicy(RMProxy.java:302) ~[hadoop-yarn-common-3.3.3-amzn-0.jar:?] ``` Sebagai solusinya, Anda dapat menginstal patch EMR Amazon, yang memperbaiki masalah di atas di Flink. Untuk menerapkan tindakan bootstrap saat Anda meluncurkan cluster Anda, selesaikan langkah-langkah berikut. 1. Unduh flink-rpm ke bucket Amazon S3 Anda. Jalur RPM Anda adalah`s3://DOC-EXAMPLE-BUCKET/rpms/flink/`. 1. Unduh skrip bootstrap dan file RPM dari Amazon S3 menggunakan URI berikut. Ganti `regionName` dengan Wilayah AWS tempat Anda berencana untuk meluncurkan cluster. ``` s3://emr-data-access-control-regionName/customer-bootstrap-actions/gcsc/replace-rpms.sh ``` 1. Hadoop 3.3.3 memperkenalkan perubahan pada YARN ([YARN-9608](https://issues.apache.org/jira/browse/YARN-9608)) yang membuat node tempat kontainer berjalan dalam keadaan dekomisioning hingga aplikasi selesai. Perubahan ini memastikan bahwa data lokal seperti data acak tidak hilang, dan Anda tidak perlu menjalankan kembali pekerjaan. Di Amazon EMR 6.8.0 dan 6.9.0, pendekatan ini juga dapat menyebabkan kurangnya pemanfaatan sumber daya pada cluster dengan atau tanpa penskalaan terkelola diaktifkan. Dengan [Amazon EMR 6.10.0](emr-6100-release.md#emr-6100-relnotes), ada solusi untuk masalah ini untuk menetapkan nilai ke in. `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-applications` `false` `yarn-site.xml` Di Amazon EMR merilis 6.11.0 dan yang lebih tinggi serta 6.8.1, 6.9.1, dan 6.10.1, konfigurasi disetel ke default untuk menyelesaikan masalah ini. `false` **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Untuk Amazon EMR rilis 6.9.0 dan yang lebih baru, semua komponen yang diinstal oleh Amazon EMR yang menggunakan pustaka Log4j menggunakan Log4j versi 2.17.1 atau yang lebih baru. + Saat Anda menggunakan konektor DynamoDB dengan Spark di Amazon EMR versi 6.6.0, 6.7.0, dan 6.8.0, semua pembacaan dari tabel Anda mengembalikan hasil kosong, meskipun pemisahan input mereferensikan data yang tidak kosong. Amazon EMR rilis 6.9.0 memperbaiki masalah ini. + Amazon EMR 6.9.0 menambahkan dukungan terbatas untuk kontrol akses berbasis Lake Formation dengan Apache Hudi saat membaca data menggunakan Spark SQL. Dukungan ini untuk kueri SELECT menggunakan Spark SQL dan terbatas pada kontrol akses tingkat kolom. Untuk informasi lebih lanjut, lihat [Hudi dan Lake Formation](https://docs.aws.amazon.com/emr/latest/ManagementGuide/hudi-with-lake-formation.html). + Bila Anda menggunakan Amazon EMR 6.9.0 untuk membuat klaster Hadoop dengan [Node Labels](https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeLabel.html) diaktifkan, [API metrik YARN](https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Metrics_API) mengembalikan informasi agregat di semua partisi, bukan partisi default. Untuk informasi lebih lanjut, lihat [YARN-11414](https://issues.apache.org/jira/browse/YARN-11414). + Dengan Amazon EMR rilis 6.9.0, kami telah memperbarui Trino ke versi 398, yang menggunakan Java 17. Versi Trino yang didukung sebelumnya untuk Amazon EMR 6.8.0 adalah Trino 388 yang berjalan di Java 11. Untuk informasi lebih lanjut tentang perubahan ini, lihat [pembaruan Trino ke Java 17](https://trino.io/blog/2022/07/14/trino-updates-to-java-17.html) di blog Trino. + Rilis ini memperbaiki masalah ketidakcocokan urutan waktu antara Apache BigTop dan Amazon EMR pada urutan startup cluster EC2. Ketidakcocokan urutan waktu ini terjadi ketika sistem mencoba melakukan dua atau lebih operasi pada saat yang sama alih-alih melakukannya dalam urutan yang tepat. Akibatnya, konfigurasi cluster tertentu mengalami timeout startup instance dan waktu startup cluster yang lebih lambat. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). **catatan** Rilis ini tidak lagi mendapatkan pembaruan AMI otomatis karena telah digantikan oleh 1 rilis patch lagi. Rilis patch dilambangkan dengan angka setelah titik desimal kedua (). `6.8.1` Untuk melihat apakah Anda menggunakan rilis patch terbaru, periksa rilis yang tersedia di [https://docs.aws.amazon.com/emr/latest/ReleaseGuide](https://docs.aws.amazon.com/emr/latest/ReleaseGuide), atau periksa dropdown **rilis Amazon EMR** saat Anda membuat klaster di konsol, atau gunakan tindakan API [https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html](https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html)atau CLI. [https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html](https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html) Untuk mendapatkan pembaruan tentang rilis baru, berlangganan umpan RSS di [Apa yang baru?](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html) halaman. [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-690-release.html) ## 6.9.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | delta | 2.1.0 | Danau Delta adalah format tabel terbuka untuk kumpulan data analitik yang sangat besar | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.6.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.23.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.2.0 | EMR S3Select Connector | | emrfs | 2.54.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.15.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.15.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.3.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.3.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.3.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.3.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.3.3-amzn-1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.3.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.3.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.3.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.3.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.3.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.3.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.13-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.13-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.13-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.4.13-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.13-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.13-amzn-0 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.12.1-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.12.1-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.12.1-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.12.1-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 0.14.1-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.7.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 6.0.0-SNAPSHOT | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 6.0.0 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,276 amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,276 amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,276 amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 398-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 398-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 398-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.3.0-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 3.3.0-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.3.0-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.3.0-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 22.08.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.10.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.10.2-amzn-0 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.9.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.9.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | delta-defaults | Ubah nilai dalam file delta-defaults.conf Delta. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j2 | Ubah pengaturan Livy log4j2.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-lakeformation | Ubah nilai dalam file lakeformation.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-delta | Ubah nilai dalam file delta.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-exchange-manager | Ubah nilai dalam file exchange-manager.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.9.0 perubahan log **Ubah log untuk catatan rilis dan rilis 6.9.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2023-08-30 | Perbarui catatan rilis | Menambahkan perbaikan untuk masalah ketidakcocokan urutan waktu | | 2023-08-21 | Perbarui catatan rilis | Menambahkan masalah yang diketahui dengan Hadoop 3.3.3. | | 2023-07-26 | Perbarui | Label rilis OS baru 2.0.20230612.0 dan2.0.20230628.0. | | 2022-12-13 | Catatan rilis diperbarui | Menambahkan fitur dan masalah yang diketahui untuk runtime dengan AI SageMaker | | 2022-11-29 | Catatan rilis dan dokumentasi diperbarui | Menambahkan fitur untuk integrasi Amazon Redshift untuk Apache Spark | | 2022-11-23 | Catatan rilis diperbarui | Dihapus entri Log4j | | 2022-11-18 | Penerapan selesai | [Amazon EMR 6.9 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2022-11-18 | Publikasi Docs | Amazon EMR 6.9 catatan rilis pertama kali diterbitkan | | 2022-11-14 | Rilis awal | Amazon EMR 6.9 dikerahkan ke Wilayah komersial terbatas | # Amazon EMR rilis 6.8.1 ## 6.8.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.8.1 | emr-6.8.0 | emr-6.7.0 | emr-6.6.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.170 | 1.12.170 | 1.12.170 | 1.12.170 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.15 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.15.1 | 1.15.1 | 1.14.2 | 1.14.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.12-amzn-0.1 | 2.4.12-amzn-0 | 2.4.4-amzn-3 | 2.4.4-amzn-2 | | HCatalog | 3.1.3-amzn-1.1 | 3.1.3-amzn-1 | 3.1.3-amzn-0 | 3.1.2-amzn-7 | | Hadoop | 3.2.1-amzn-8.1 | 3.2.1-amzn-8 | 3.2.1-amzn-7 | 3.2.1-amzn-6 | | Hive | 3.1.3-amzn-1.1 | 3.1.3-amzn-1 | 3.1.3-amzn-0 | 3.1.2-amzn-7 | | Hudi | 0.11.1-amzn-0 | 0.11.1-amzn-0 | 0.11.0-amzn-0 | 0.10.1-amzn-0 | | Hue | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | | Iceberg | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.13.1-amzn-0 | 0.13.1 | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.9.1 | 1.8.0 | 1.8.0 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.273.3-amzn-0 | 0.273.3-amzn-0 | 0,272-amzn-0 | 0,267-amzn-0 | | Spark | 3.3.0-amzn-0.1 | 3.3.0-amzn-0 | 3.2.1-amzn-0 | 3.2.0-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.9.1 | 2.9.1 | 2.4.1 | 2.4.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 388-amzn-0 | 388-amzn-0 | 378-amzn-0 | 367-amzn-0 | | Zeppelin | 0.10.1 | 0.10.1 | 0.10.0 | 0.10.0 | | ZooKeeper | 3.5.10 | 3.5.10 | 3.5.7 | 3.5.7 | ## 6.8.1 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.8.1. Perubahan relatif terhadap 6.8.0. Untuk informasi tentang timeline rilis, lihat. [6.8.1 perubahan log](#681-changelog) **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Hadoop 3.3.3 memperkenalkan perubahan pada YARN ([YARN-9608](https://issues.apache.org/jira/browse/YARN-9608)) yang membuat node tempat kontainer berjalan dalam keadaan dekomisioning hingga aplikasi selesai. Perubahan ini memastikan bahwa data lokal seperti data acak tidak hilang, dan Anda tidak perlu menjalankan kembali pekerjaan. Pendekatan ini juga dapat menyebabkan kurangnya pemanfaatan sumber daya pada cluster dengan atau tanpa penskalaan terkelola diaktifkan. Dengan Amazon EMR merilis 6.11.0 dan yang lebih tinggi serta 6.8.1, 6.9.1, dan 6.10.1, nilai ditetapkan untuk mengatasi masalah ini. `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-applications` `false` `yarn-site.xml` Sementara perbaikan mengatasi masalah yang diperkenalkan oleh YARN-9608, hal itu dapat menyebabkan pekerjaan Hive gagal karena kehilangan data acak pada cluster yang telah mengelola penskalaan diaktifkan. Kami telah mengurangi risiko itu dalam rilis ini dengan juga menyetel `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-shuffle-data` beban kerja Hive. Konfigurasi ini hanya tersedia dengan rilis Amazon EMR 6.11.0 dan yang lebih tinggi. + Kolektor metrik tidak akan mengirim metrik apa pun ke bidang kontrol setelah failover node primer dalam cluster dengan konfigurasi grup instance. + Rilis ini menghilangkan percobaan ulang pada permintaan HTTP yang gagal ke titik akhir kolektor metrik. + Rilis ini mencakup perubahan yang memungkinkan cluster ketersediaan tinggi pulih dari status gagal setelah restart. + Rilis ini memperbaiki masalah di mana pengguna besar yang dibuat UIDs menyebabkan pengecualian overflow. + Rilis ini memperbaiki masalah batas waktu dengan proses konfigurasi ulang Amazon EMR. + Rilis ini mencegah masalah di mana konfigurasi ulang yang gagal dapat merusak proses lain yang tidak terkait. + Rilis ini mencakup perbaikan keamanan. + Rilis ini memperbaiki masalah di mana cluster yang menjalankan beban kerja di Spark dengan Amazon EMR mungkin diam-diam menerima hasil yang salah dengan,,, dan. `contains` `startsWith` `endsWith` `like` Masalah ini terjadi saat Anda menggunakan ekspresi pada bidang yang dipartisi yang memiliki metadata di Amazon EMR Hive3 Metastore Server (HMS). + Dengan Amazon EMR 6.6.0 hingga 6.9.x, kueri INSERT dengan partisi dinamis dan klausa ORDER BY atau SORT BY akan selalu memiliki dua reduksi. Masalah ini disebabkan oleh perubahan OSS [HIVE-20703](https://issues.apache.org/jira/browse/HIVE-20703), yang menempatkan optimasi partisi pengurutan dinamis di bawah keputusan berbasis biaya. Jika beban kerja Anda tidak memerlukan penyortiran partisi dinamis, kami sarankan Anda mengatur `hive.optimize.sort.dynamic.partition.threshold` properti `-1` untuk menonaktifkan fitur baru dan mendapatkan jumlah reduksi yang dihitung dengan benar. Masalah ini diperbaiki di OSS Hive sebagai bagian dari [HIVE-22269 dan](https://issues.apache.org/jira/browse/HIVE-22269) diperbaiki di Amazon EMR 6.10.0. + Hive mungkin mengalami kehilangan data ketika Anda menggunakan HDFS sebagai direktori awal dan Anda telah mengaktifkan menggabungkan file kecil, dan tabel berisi jalur partisi statis. + Rilis ini memperbaiki masalah kinerja dengan Hive jika menggabungkan file kecil (dinonaktifkan secara default) diaktifkan di akhir pekerjaan ETL. + Rilis ini memperbaiki masalah dengan pelambatan di sisi Glue ketika tidak ada fungsi yang ditentukan pengguna (UDF). + Rilis ini memperbaiki masalah yang menghapus log kontainer oleh layanan agregasi log node sebelum pendorong log dapat mendorongnya ke S3 jika terjadi penonaktifan YARN. + Rilis ini memperbaiki penanganan file yang dipadat/diarsipkan dengan pelacakan file penyimpanan persisten untuk. HBase + Rilis ini memperbaiki masalah yang memengaruhi kinerja Spark saat Anda menetapkan `true` nilai default untuk konfigurasi. `spark.yarn.heterogeneousExecutors.enabled` `spark-defaults.conf` + Rilis ini memperbaiki masalah dengan Mengurangi Tugas yang gagal membaca data acak. Masalah ini menyebabkan kegagalan kueri Hive dengan kesalahan memori yang rusak. + Rilis ini memperbaiki masalah yang menyebabkan penyedia node gagal jika layanan HDFS NameNode (NN) macet di safemode selama penggantian node. + Rilis ini menambahkan mekanisme coba lagi baru ke alur kerja penskalaan klaster untuk kluster EMR yang menjalankan Presto atau Trino. Peningkatan ini mengurangi risiko bahwa pengubahan ukuran cluster akan terhenti tanpa batas karena satu operasi pengubahan ukuran yang gagal. Ini juga meningkatkan pemanfaatan cluster, karena kluster Anda naik dan turun lebih cepat. + Rilis ini meningkatkan logika penskalaan klaster sehingga klaster Anda tidak mencoba menurunkan skala node inti di bawah pengaturan faktor replikasi HDFS untuk cluster. Ini sejalan dengan persyaratan redundansi data Anda, dan mengurangi kemungkinan operasi penskalaan mungkin terhenti. + Daemon manajemen log telah ditingkatkan untuk mengidentifikasi semua log yang digunakan secara aktif dengan pegangan file terbuka pada penyimpanan instance lokal, dan proses terkait. Peningkatan ini memastikan bahwa Amazon EMR menghapus file dengan benar dan merebut kembali ruang penyimpanan setelah log diarsipkan ke Amazon S3. + Rilis ini mencakup peningkatan daemon manajemen log yang menghapus direktori langkah kosong dan tidak terpakai di sistem file cluster lokal. Sejumlah besar direktori kosong dapat menurunkan kinerja daemon EMR Amazon dan mengakibatkan pemanfaatan disk yang berlebihan. + Rilis ini memperbaiki masalah yang mungkin terjadi saat Anda membuat simpul tepi dengan mereplikasi salah satu node utama dari cluster dengan beberapa node primer. Node tepi yang direplikasi dapat menyebabkan penundaan dengan operasi penskalaan, atau mengakibatkan pemanfaatan memori yang tinggi pada node utama. Untuk informasi selengkapnya tentang cara membuat simpul tepi untuk berkomunikasi dengan cluster EMR Anda, lihat [Edge Node Creator](https://github.com/aws-samples/aws-emr-utilities/tree/main/utilities/emr-edge-node-creator) di `aws-samples` repo. GitHub + Rilis ini meningkatkan proses otomatisasi yang digunakan Amazon EMR untuk memasang kembali volume Amazon EBS ke instance setelah reboot. + Rilis ini memperbaiki masalah yang mengakibatkan celah intermiten dalam metrik Hadoop yang diterbitkan Amazon EMR ke Amazon. CloudWatch + Rilis ini memperbaiki masalah dengan kluster EMR di mana pembaruan ke file konfigurasi YARN yang berisi daftar pengecualian node untuk cluster terganggu karena pemanfaatan disk yang berlebihan. Pembaruan yang tidak lengkap menghalangi operasi penskalaan klaster masa depan. Rilis ini memastikan bahwa klaster Anda tetap sehat, dan operasi penskalaan berfungsi seperti yang diharapkan. + Rilis ini meningkatkan daemon manajemen log on-cluster untuk memantau folder log tambahan di kluster EMR Anda. Peningkatan ini meminimalkan skenario pemanfaatan disk yang berlebihan. + Rilis ini secara otomatis me-restart daemon manajemen log on-cluster ketika berhenti. Peningkatan ini mengurangi risiko node tampak tidak sehat karena pemanfaatan disk yang berlebihan. + Rilis ini menambahkan dukungan untuk pengarsipan log ke Amazon S3 selama penskalaan klaster turun. Sebelumnya, Anda hanya dapat mengarsipkan file log ke Amazon S3 selama penghentian klaster. Kemampuan baru memastikan bahwa file log yang dihasilkan di cluster tetap ada di Amazon S3 bahkan setelah node dihentikan. Untuk informasi selengkapnya, lihat [Mengkonfigurasi logging dan debug klaster](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-debugging.html). + Rilis ini memperbaiki masalah yang terjadi saat URI Amazon S3 untuk tindakan bootstrap diakhiri dengan nomor port, misalnya:. `a.b.c.d:4345` Amazon EMR salah menguraikan ini URIs, jadi tindakan bootstrap terkait apa pun akan gagal. + Rilis ini memperbaiki masalah ketidakcocokan urutan waktu antara Apache BigTop dan Amazon EMR pada urutan startup cluster EC2. Ketidakcocokan urutan waktu ini terjadi ketika sistem mencoba melakukan dua atau lebih operasi pada saat yang sama alih-alih melakukannya dalam urutan yang tepat. Akibatnya, konfigurasi cluster tertentu mengalami timeout startup instance dan waktu startup cluster yang lebih lambat. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-681-release.html) ## 6.8.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.22.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.1.0 | EMR S3Select Connector | | emrfs | 2.53.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.15.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.15.1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-8.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-8.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-8.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-8.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-8.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-8.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-8.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-8.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-8.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-8.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-8.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.12-amzn-0.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.12-amzn-0.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.12-amzn-0.1 | HBase klien baris perintah. | | hbase-rest-server | 2.4.12-amzn-0.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.12-amzn-0.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.12-amzn-0.1 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-1.1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-1.1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-1.1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-1.1 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-1.1 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-1.1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-1.1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.11.1-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.11.1-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.11.1-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.11.1-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 0.14.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.7.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.2 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 5.1.2 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.273.3-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.273.3-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.273.3-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 388-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 388-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 388-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.3.0-amzn-0.1 | Klien baris perintah Spark. | | spark-history-server | 3.3.0-amzn-0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.3.0-amzn-0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.3.0-amzn-0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 22.06.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.9.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.8.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.8.1** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.8.1 perubahan log **Ubah log untuk catatan rilis dan rilis 6.8.1** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2023-08-30 | Perbarui catatan rilis | Menambahkan beberapa perbaikan terkait bidang kontrol ke catatan rilis | | 2023-08-21 | Publikasi Docs | Amazon EMR 6.8.1 catatan rilis pertama kali diterbitkan | | 2023-08-16 | Penerapan selesai | [Amazon EMR 6.8.1 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-08-04 | Rilis awal | Amazon EMR 6.8.1 pertama kali dikerahkan ke Wilayah komersial terbatas | # Amazon EMR rilis 6.8.0 ## 6.8.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.8.0 | emr-6.7.0 | emr-6.6.0 | emr-6.5.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.170 | 1.12.170 | 1.12.170 | 1.12.31 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.15 | 2.12.10 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.15.1 | 1.14.2 | 1.14.2 | 1.14.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.12-amzn-0 | 2.4.4-amzn-3 | 2.4.4-amzn-2 | 2.4.4-amzn-1 | | HCatalog | 3.1.3-amzn-1 | 3.1.3-amzn-0 | 3.1.2-amzn-7 | 3.1.2-amzn-6 | | Hadoop | 3.2.1-amzn-8 | 3.2.1-amzn-7 | 3.2.1-amzn-6 | 3.2.1-amzn-5 | | Hive | 3.1.3-amzn-1 | 3.1.3-amzn-0 | 3.1.2-amzn-7 | 3.1.2-amzn-6 | | Hudi | 0.11.1-amzn-0 | 0.11.0-amzn-0 | 0.10.1-amzn-0 | 0.9.0-amzn-1 | | Hue | 4.10.0 | 4.10.0 | 4.10.0 | 4.9.0 | | Iceberg | 0.14.0-amzn-0 | 0.13.1-amzn-0 | 0.13.1 | 0.12.0 | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.9.1 | 1.8.0 | 1.8.0 | 1.8.0 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.273.3-amzn-0 | 0,272-amzn-0 | 0,267-amzn-0 | 0,261-amzn-0 | | Spark | 3.3.0-amzn-0 | 3.2.1-amzn-0 | 3.2.0-amzn-0 | 3.1.2-amzn-1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.9.1 | 2.4.1 | 2.4.1 | 2.4.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 388-amzn-0 | 378-amzn-0 | 367-amzn-0 | 360 | | Zeppelin | 0.10.1 | 0.10.0 | 0.10.0 | 0.10.0 | | ZooKeeper | 3.5.10 | 3.5.7 | 3.5.7 | 3.5.7 | ## Catatan rilis 6.8.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 6.8.0. Perubahan relatif terhadap 6.7.0. **Fitur Baru** + Fitur langkah EMR Amazon sekarang mendukung titik akhir dan klien Apache Livy. JDBC/ODBC Untuk informasi selengkapnya, lihat [Mengonfigurasi peran runtime untuk langkah-langkah EMR Amazon](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-steps-runtime-roles.html). + Amazon EMR rilis 6.8.0 hadir dengan rilis Apache 2.4.12. HBase Dengan HBase rilis ini, Anda dapat mengarsipkan dan menghapus HBase tabel Anda. Proses arsip Amazon S3 mengganti nama semua file tabel ke direktori arsip. Ini bisa menjadi proses yang mahal dan panjang. Sekarang, Anda dapat melewati proses arsip dan dengan cepat menjatuhkan dan menghapus tabel besar. Untuk informasi selengkapnya, lihat [Menggunakan HBase shell](emr-hbase-connect.md). **Masalah yang Diketahui** + Hadoop 3.3.3 memperkenalkan perubahan pada YARN ([YARN-9608](https://issues.apache.org/jira/browse/YARN-9608)) yang membuat node tempat kontainer berjalan dalam keadaan dekomisioning hingga aplikasi selesai. Perubahan ini memastikan bahwa data lokal seperti data acak tidak hilang, dan Anda tidak perlu menjalankan kembali pekerjaan. Di Amazon EMR 6.8.0 dan 6.9.0, pendekatan ini juga dapat menyebabkan kurangnya pemanfaatan sumber daya pada cluster dengan atau tanpa penskalaan terkelola diaktifkan. Dengan [Amazon EMR 6.10.0](emr-6100-release.md#emr-6100-relnotes), ada solusi untuk masalah ini untuk menetapkan nilai ke in. `yarn.resourcemanager.decommissioning-nodes-watcher.wait-for-applications` `false` `yarn-site.xml` Di Amazon EMR merilis 6.11.0 dan yang lebih tinggi serta 6.8.1, 6.9.1, dan 6.10.1, konfigurasi disetel ke default untuk menyelesaikan masalah ini. `false` **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Ketika Amazon EMR merilis 6.5.0, 6.6.0, atau 6.7.0 membaca tabel Apache Phoenix melalui shell Apache Spark, Amazon EMR menghasilkan file. `NoSuchMethodError` Amazon EMR rilis 6.8.0 memperbaiki masalah ini. + Amazon EMR rilis 6.8.0 hadir dengan [Apache Hudi 0.11.1](https://hudi.apache.org/); Namun, Amazon EMR 6.8.0 cluster juga kompatibel dengan open-source dari Hudi 0.12.0. `hudi-spark3.3-bundle_2.12` + Amazon EMR rilis 6.8.0 hadir dengan Apache Spark 3.3.0. Rilis Spark ini menggunakan Apache Log4j 2 dan `log4j2.properties` file untuk mengkonfigurasi Log4j dalam proses Spark. Jika Anda menggunakan Spark di cluster atau membuat kluster EMR dengan parameter konfigurasi kustom, dan Anda ingin meningkatkan ke Amazon EMR rilis 6.8.0, Anda harus bermigrasi ke klasifikasi konfigurasi `spark-log4j2` baru dan format kunci untuk Apache Log4j 2. Untuk informasi selengkapnya, lihat [Migrasi dari Apache Log4j 1.x ke Log4j 2.x](emr-spark-configure.md#spark-migrate-logj42). + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). **catatan** Rilis ini tidak lagi mendapatkan pembaruan AMI otomatis karena telah digantikan oleh 1 rilis patch lagi. Rilis patch dilambangkan dengan angka setelah titik desimal kedua (). `6.8.1` Untuk melihat apakah Anda menggunakan rilis patch terbaru, periksa rilis yang tersedia di [https://docs.aws.amazon.com/emr/latest/ReleaseGuide](https://docs.aws.amazon.com/emr/latest/ReleaseGuide), atau periksa dropdown **rilis Amazon EMR** saat Anda membuat klaster di konsol, atau gunakan tindakan API [https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html](https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html)atau CLI. [https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html](https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html) Untuk mendapatkan pembaruan tentang rilis baru, berlangganan umpan RSS di [Apa yang baru?](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html) halaman. [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-680-release.html) **Masalah yang Diketahui** + Saat Anda menggunakan konektor DynamoDB dengan Spark di Amazon EMR versi 6.6.0, 6.7.0, dan 6.8.0, semua pembacaan dari tabel Anda mengembalikan hasil kosong, meskipun pemisahan input mereferensikan data yang tidak kosong. Ini karena Spark 3.2.0 disetel `spark.hadoopRDD.ignoreEmptySplits` ke `true` default. Sebagai solusinya, setel secara eksplisit ke. `spark.hadoopRDD.ignoreEmptySplits` `false` Amazon EMR rilis 6.9.0 memperbaiki masalah ini. + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, setel `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` + Dengan Amazon EMR merilis 5.36.0 dan 6.6.0 hingga 6.9.0, `SecretAgent` dan komponen `RecordServer` layanan mungkin mengalami kehilangan data log karena konfigurasi pola nama file yang salah di properti Log4j2. Konfigurasi yang salah menyebabkan komponen menghasilkan hanya satu file log per hari. Ketika strategi rotasi terjadi, ia menimpa file yang ada alih-alih menghasilkan file log baru seperti yang diharapkan. Sebagai solusinya, gunakan tindakan bootstrap untuk menghasilkan file log setiap jam dan tambahkan bilangan bulat kenaikan otomatis dalam nama file untuk menangani rotasi. Untuk Amazon EMR 6.6.0 hingga 6.9.0 rilis, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-6x/replace-puppet.sh,Args=[]" ``` Untuk Amazon EMR 5.36.0, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-5x/replace-puppet.sh,Args=[]" ``` Untuk informasi selengkapnya tentang timeline rilis, lihat [log perubahan](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-680-release.html#680-changelog). ## 6.8.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.2 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.7.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.22.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.1.0 | EMR S3Select Connector | | emrfs | 2.53.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.15.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.15.1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-8 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-8 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-8 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-8 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-8 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-8 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-8 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-8 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-8 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-8 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-8 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.12-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.12-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.12-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.4.12-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.12-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.12-amzn-0 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.11.1-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.11.1-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.11.1-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.11.1-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 0.14.0-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.9.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.7.0 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.2 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 5.1.2 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.273.3-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.273.3-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.273.3-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 388-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 388-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 388-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.3.0-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.3.0-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.3.0-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.3.0-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 22.06.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.9.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.10 | ZooKeeper klien baris perintah. | ## 6.8.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.8.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j2 | Ubah nilai dalam file log4j2.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 6.8.0 perubahan log **Ubah log untuk catatan rilis dan rilis 6.8.0** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2023-08-21 | Perbarui | Menambahkan masalah yang diketahui dengan Hadoop 3.3.3. | | 2023-07-26 | Perbarui | Label rilis OS baru 2.0.20230612.0 dan2.0.20230628.0. | | 2022-09-06 | Penerapan selesai | [Amazon EMR 6.8 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2022-09-06 | Publikasi awal | Amazon EMR 6.8 catatan rilis pertama kali diterbitkan | | 2022-08-31 | Rilis awal | Amazon EMR 6.8 dirilis ke Wilayah komersial terbatas | # Amazon EMR rilis 6.7.0 ## 6.7.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.7.0 | emr-6.6.0 | emr-6.5.0 | emr-6.4.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.170 | 1.12.170 | 1.12.31 | 1.12.31 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.15 | 2.12.10 | 2.12.10 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.14.2 | 1.14.2 | 1.14.0 | 1.13.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.4-amzn-3 | 2.4.4-amzn-2 | 2.4.4-amzn-1 | 2.4.4-amzn-0 | | HCatalog | 3.1.3-amzn-0 | 3.1.2-amzn-7 | 3.1.2-amzn-6 | 3.1.2-amzn-5 | | Hadoop | 3.2.1-amzn-7 | 3.2.1-amzn-6 | 3.2.1-amzn-5 | 3.2.1-amzn-4 | | Hive | 3.1.3-amzn-0 | 3.1.2-amzn-7 | 3.1.2-amzn-6 | 3.1.2-amzn-5 | | Hudi | 0.11.0-amzn-0 | 0.10.1-amzn-0 | 0.9.0-amzn-1 | 0.8.0-amzn-0 | | Hue | 4.10.0 | 4.10.0 | 4.9.0 | 4.9.0 | | Iceberg | 0.13.1-amzn-0 | 0.13.1 | 0.12.0 | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.8.0 | 1.8.0 | 1.8.0 | 1.8.0 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.1.2 | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,272-amzn-0 | 0,267-amzn-0 | 0,261-amzn-0 | 0.254.1-amzn-0 | | Spark | 3.2.1-amzn-0 | 3.2.0-amzn-0 | 3.1.2-amzn-1 | 3.1.2-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 378-amzn-0 | 367-amzn-0 | 360 | 359 | | Zeppelin | 0.10.0 | 0.10.0 | 0.10.0 | 0.9.0 | | ZooKeeper | 3.5.7 | 3.5.7 | 3.5.7 | 3.5.7 | ## Catatan rilis 6.7.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 6.7.0. Perubahan relatif terhadap 6.6.0. Tanggal rilis awal: 15 Juli 2022 **Fitur Baru** + Amazon EMR sekarang mendukung Apache Spark 3.2.1, Apache Hive 3.1.3, HUDI 0.11, PrestoDB 0.272, dan Trino 0.378. + Mendukung kontrol akses berbasis Peran IAM dan Lake Formation dengan langkah-langkah EMR (Spark, Hive) untuk Amazon EMR pada kluster EC2. + Mendukung pernyataan definisi data Apache Spark pada cluster yang diaktifkan Apache Ranger. Ini sekarang termasuk dukungan untuk aplikasi Trino membaca dan menulis metadata Apache Hive pada kluster yang diaktifkan Apache Ranger. Untuk informasi selengkapnya, lihat [Mengaktifkan tata kelola federasi menggunakan Trino dan Apache Ranger di](https://aws.amazon.com/blogs/big-data/enable-federated-governance-using-trino-and-apache-ranger-on-amazon-emr/) Amazon EMR. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-670-release.html) **Masalah yang Diketahui** + Ketika Amazon EMR merilis 6.5.0, 6.6.0, atau 6.7.0 membaca tabel Apache Phoenix melalui shell Apache Spark, terjadi karena Amazon EMR menggunakan yang `NoSuchMethodError` salah. `Hbase.compat.version` Amazon EMR rilis 6.8.0 memperbaiki masalah ini. + Saat Anda menggunakan konektor DynamoDB dengan Spark di Amazon EMR versi 6.6.0, 6.7.0, dan 6.8.0, semua pembacaan dari tabel Anda mengembalikan hasil kosong, meskipun pemisahan input mereferensikan data yang tidak kosong. Ini karena Spark 3.2.0 disetel `spark.hadoopRDD.ignoreEmptySplits` ke `true` default. Sebagai solusinya, setel secara eksplisit ke. `spark.hadoopRDD.ignoreEmptySplits` `false` Amazon EMR rilis 6.9.0 memperbaiki masalah ini. + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, setel `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` + Dengan Amazon EMR merilis 5.36.0 dan 6.6.0 hingga 6.9.0, `SecretAgent` dan komponen `RecordServer` layanan mungkin mengalami kehilangan data log karena konfigurasi pola nama file yang salah di properti Log4j2. Konfigurasi yang salah menyebabkan komponen menghasilkan hanya satu file log per hari. Ketika strategi rotasi terjadi, ia menimpa file yang ada alih-alih menghasilkan file log baru seperti yang diharapkan. Sebagai solusinya, gunakan tindakan bootstrap untuk menghasilkan file log setiap jam dan tambahkan bilangan bulat kenaikan otomatis dalam nama file untuk menangani rotasi. Untuk Amazon EMR 6.6.0 hingga 6.9.0 rilis, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-6x/replace-puppet.sh,Args=[]" ``` Untuk Amazon EMR 5.36.0, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-5x/replace-puppet.sh,Args=[]" ``` + `GetClusterSessionCredentials`API tidak didukung dengan cluster yang berjalan di Amazon EMR 6.7 atau lebih rendah. + Komit Hadoop berikut di-backport. - [[HADOOP-16080]](https://issues.apache.org/jira/browse/HADOOP-16080) Perbaiki masalah jika tidak berfungsi. `hadoop-aws` `hadoop-client-api` - [[HADOOP-18237]](https://issues.apache.org/jira/browse/HADOOP-18237) Tingkatkan Apache Xerces Java ke 2.12.2. - [[YARN-11092]](https://issues.apache.org/jira/browse/YARN-11092) Tingkatkan jquery ke ui ke 1.13.1. - [[YARN-10720]](https://issues.apache.org/jira/browse/YARN-10720) YARN WebAppProxyServlet harus mendukung batas waktu koneksi untuk mencegah server proxy macet. ## 6.7.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.6.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.22.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.1.0 | EMR S3Select Connector | | emrfs | 2.52.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.14.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.14.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-7 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-7 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-7 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-7 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-7 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-7 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-7 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-7 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-7 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-7 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-7 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.4-amzn-3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.4-amzn-3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.4-amzn-3 | HBase klien baris perintah. | | hbase-rest-server | 2.4.4-amzn-3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.4-amzn-3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.4-amzn-3 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.3-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.3-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.3-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.3-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 3.1.3-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 3.1.3-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.3-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.11.0-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.11.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.11.0-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.11.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 0.13.1-amzn-0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.8.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.0.194 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.2 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 5.1.2 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,272-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,272-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,272-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 378-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 378-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 378-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.2.1-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.2.1-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.2.1-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.2.1-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 22.02.0-amzn-1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.7 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.7 | ZooKeeper klien baris perintah. | ## 6.7.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.7.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 6.6.0 ## 6.6.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.6.0 | emr-6.5.0 | emr-6.4.0 | emr-6.3.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.170 | 1.12.31 | 1.12.31 | 1.11.977 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.14.2 | 1.14.0 | 1.13.1 | 1.12.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.4-amzn-2 | 2.4.4-amzn-1 | 2.4.4-amzn-0 | 2.2.6-amzn-1 | | HCatalog | 3.1.2-amzn-7 | 3.1.2-amzn-6 | 3.1.2-amzn-5 | 3.1.2-amzn-4 | | Hadoop | 3.2.1-amzn-6 | 3.2.1-amzn-5 | 3.2.1-amzn-4 | 3.2.1-amzn-3.1 | | Hive | 3.1.2-amzn-7 | 3.1.2-amzn-6 | 3.1.2-amzn-5 | 3.1.2-amzn-4 | | Hudi | 0.10.1-amzn-0 | 0.9.0-amzn-1 | 0.8.0-amzn-0 | 0.7.0-amzn-0 | | Hue | 4.10.0 | 4.9.0 | 4.9.0 | 4.9.0 | | Iceberg | 0.13.1 | 0.12.0 | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.2.2 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.0-incubating | | MXNet | 1.8.0 | 1.8.0 | 1.8.0 | 1.7.0 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.1.2 | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,267-amzn-0 | 0,261-amzn-0 | 0.254.1-amzn-0 | 0.245.1-amzn-0 | | Spark | 3.2.0-amzn-0 | 3.1.2-amzn-1 | 3.1.2-amzn-0 | 3.1.1-amzn-0.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 367-amzn-0 | 360 | 359 | 350 | | Zeppelin | 0.10.0 | 0.10.0 | 0.9.0 | 0.9.0 | | ZooKeeper | 3.5.7 | 3.5.7 | 3.5.7 | 3.4.14 | ## 6.6.0 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.6.0. Perubahan relatif terhadap 6.5.0. Tanggal rilis awal: 9 Mei 2022 Tanggal dokumentasi yang diperbarui: Juni 15, 2022 **Fitur Baru** + Amazon EMR 6.6 sekarang mendukung Apache Spark 3.2, Apache Spark RAPIDS 22.02, CUDA 11, Apache Hudi 0.10.1, Apache Iceberg 0.13, Trino 0.367 dan PrestODB 0.267. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-660-release.html) + [Dengan Amazon EMR 6.6 dan yang lebih baru, aplikasi yang menggunakan Log4j 1.x dan Log4j 2.x ditingkatkan untuk menggunakan Log4j 1.2.17 (atau lebih tinggi) dan Log4j 2.17.1 (atau lebih tinggi) masing-masing, dan tidak perlu menggunakan tindakan bootstrap yang disediakan untuk mengurangi masalah CVE.](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-log4j-vulnerability.html) + **[Penskalaan terkelola] Pengoptimalan penskalaan terkelola data acak percikan -** Untuk Amazon EMR versi 5.34.0 dan yang lebih baru, dan EMR versi 6.4.0 dan yang lebih baru, penskalaan terkelola sekarang sadar data acak Spark (data yang didistribusikan ulang Spark di seluruh partisi untuk melakukan operasi tertentu). [Untuk informasi selengkapnya tentang operasi shuffle, lihat [Menggunakan penskalaan terkelola EMR di Amazon](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-scaling.html) EMR di Panduan Manajemen *EMR Amazon* dan Panduan Pemrograman Spark.](https://spark.apache.org/docs/latest/rdd-programming-guide.html#shuffle-operations) + Dimulai dengan Amazon EMR 5.32.0 dan 6.5.0, ukuran pelaksana dinamis untuk Apache Spark diaktifkan secara default. Untuk mengaktifkan atau menonaktifkan fitur ini, Anda dapat menggunakan parameter `spark.yarn.heterogeneousExecutors.enabled` konfigurasi. **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Amazon EMR mengurangi waktu startup cluster hingga 80 detik rata-rata untuk cluster yang menggunakan opsi AMI default EMR dan hanya menginstal aplikasi umum, seperti Apache Hadoop, Apache Spark dan Apache Hive. **Masalah yang Diketahui** + Ketika Amazon EMR merilis 6.5.0, 6.6.0, atau 6.7.0 membaca tabel Apache Phoenix melalui shell Apache Spark, terjadi karena Amazon EMR menggunakan yang `NoSuchMethodError` salah. `Hbase.compat.version` Amazon EMR rilis 6.8.0 memperbaiki masalah ini. + Saat Anda menggunakan konektor DynamoDB dengan Spark di Amazon EMR versi 6.6.0, 6.7.0, dan 6.8.0, semua pembacaan dari tabel Anda mengembalikan hasil kosong, meskipun pemisahan input mereferensikan data yang tidak kosong. Ini karena Spark 3.2.0 disetel `spark.hadoopRDD.ignoreEmptySplits` ke `true` default. Sebagai solusinya, setel secara eksplisit ke. `spark.hadoopRDD.ignoreEmptySplits` `false` Amazon EMR rilis 6.9.0 memperbaiki masalah ini. + Pada klaster Trino yang sudah berjalan lama, Amazon EMR 6.6.0 memungkinkan parameter logging Pengumpulan Sampah di Trino jvm.config untuk mendapatkan wawasan yang lebih baik dari log Pengumpulan Sampah. Perubahan ini menambahkan banyak log Pengumpulan Sampah ke file launcher.log (/var/log/trino/launcher.log). Jika Anda menjalankan klaster Trino di Amazon EMR 6.6.0, Anda mungkin menemukan node kehabisan ruang disk setelah cluster berjalan selama beberapa hari karena log yang ditambahkan. Solusi untuk masalah ini adalah menjalankan skrip di bawah ini sebagai Tindakan Bootstrap untuk menonaktifkan parameter logging Pengumpulan Sampah di jvm.config saat membuat atau mengkloning cluster untuk Amazon EMR 6.6.0. ``` #!/bin/bash set -ex PRESTO_PUPPET_DIR='/var/aws/emr/bigtop-deploy/puppet/modules/trino' sudo bash -c "sed -i '/-Xlog/d' ${PRESTO_PUPPET_DIR}/templates/jvm.config" ``` + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, setel `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` + Dengan Amazon EMR merilis 5.36.0 dan 6.6.0 hingga 6.9.0, `SecretAgent` dan komponen `RecordServer` layanan mungkin mengalami kehilangan data log karena konfigurasi pola nama file yang salah di properti Log4j2. Konfigurasi yang salah menyebabkan komponen menghasilkan hanya satu file log per hari. Ketika strategi rotasi terjadi, ia menimpa file yang ada alih-alih menghasilkan file log baru seperti yang diharapkan. Sebagai solusinya, gunakan tindakan bootstrap untuk menghasilkan file log setiap jam dan tambahkan bilangan bulat kenaikan otomatis dalam nama file untuk menangani rotasi. Untuk Amazon EMR 6.6.0 hingga 6.9.0 rilis, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-6x/replace-puppet.sh,Args=[]" ``` Untuk Amazon EMR 5.36.0, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-5x/replace-puppet.sh,Args=[]" ``` ## 6.6.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.5.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.20.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.1.0 | EMR S3Select Connector | | emrfs | 2.50.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.14.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.14.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-6 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-6 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-6 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-6 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-6 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-6 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-6 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-6 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-6 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-6 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-6 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.4-amzn-2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.4-amzn-2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.4-amzn-2 | HBase klien baris perintah. | | hbase-rest-server | 2.4.4-amzn-2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.4-amzn-2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hbase-operator-tools | 2.4.4-amzn-2 | Alat perbaikan untuk HBase cluster Apache. | | hcatalog-client | 3.1.2-amzn-7 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.2-amzn-7 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.2-amzn-7 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.2-amzn-7 | Klien baris perintah Hive. | | hive-hbase | 3.1.2-amzn-7 | Klien Hive-hbase. | | hive-metastore-server | 3.1.2-amzn-7 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.2-amzn-7 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.10.1-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.10.1-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.10.1-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.10.1-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 0.13.1 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.8.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 11.0.194 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-connectors | 5.1.2 | Konektor Apache Phoenix untuk Spark-3 | | phoenix-query-server | 5.1.2 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,267-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,267-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,267-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 367-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 367-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 367-amzn-0 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.2.0-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.2.0-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.2.0-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.2.0-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 22.02.0-amzn-0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.7 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.7 | ZooKeeper klien baris perintah. | ## 6.6.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.6.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-iceberg | Ubah nilai dalam file iceberg.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 6.5.0 ## 6.5.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://iceberg.apache.org/](https://iceberg.apache.org/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.5.0 | emr-6.4.0 | emr-6.3.1 | emr-6.3.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.31 | 1.12.31 | 1.11.977 | 1.11.977 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.14.0 | 1.13.1 | 1.12.1 | 1.12.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.4-amzn-1 | 2.4.4-amzn-0 | 2.2.6-amzn-1 | 2.2.6-amzn-1 | | HCatalog | 3.1.2-amzn-6 | 3.1.2-amzn-5 | 3.1.2-amzn-4 | 3.1.2-amzn-4 | | Hadoop | 3.2.1-amzn-5 | 3.2.1-amzn-4 | 3.2.1-amzn-3.1 | 3.2.1-amzn-3 | | Hive | 3.1.2-amzn-6 | 3.1.2-amzn-5 | 3.1.2-amzn-4 | 3.1.2-amzn-4 | | Hudi | 0.9.0-amzn-1 | 0.8.0-amzn-0 | 0.7.0-amzn-0 | 0.7.0-amzn-0 | | Hue | 4.9.0 | 4.9.0 | 4.9.0 | 4.9.0 | | Iceberg | 0.12.0 | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.2.2 | 1.2.2 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.8.0 | 1.8.0 | 1.7.0 | 1.7.0 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 5.1.2 | 5.1.2 | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,261-amzn-0 | 0.254.1-amzn-0 | 0.245.1-amzn-0 | 0.245.1-amzn-0 | | Spark | 3.1.2-amzn-1 | 3.1.2-amzn-0 | 3.1.1-amzn-0.1 | 3.1.1-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 360 | 359 | 350 | 350 | | Zeppelin | 0.10.0 | 0.9.0 | 0.9.0 | 0.9.0 | | ZooKeeper | 3.5.7 | 3.5.7 | 3.4.14 | 3.4.14 | ## 6.5.0 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.5.0. Perubahan relatif terhadap 6.4.0. Tanggal rilis awal: 20 Januari 2022 Tanggal rilis diperbarui: 21 Maret 2022 **Fitur Baru** + **[Penskalaan terkelola] Pengoptimalan penskalaan terkelola data acak percikan -** Untuk Amazon EMR versi 5.34.0 dan yang lebih baru, dan EMR versi 6.4.0 dan yang lebih baru, penskalaan terkelola sekarang sadar data acak Spark (data yang didistribusikan ulang Spark di seluruh partisi untuk melakukan operasi tertentu). [Untuk informasi selengkapnya tentang operasi shuffle, lihat [Menggunakan penskalaan terkelola EMR di Amazon](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-scaling.html) EMR di Panduan Manajemen *EMR Amazon* dan Panduan Pemrograman Spark.](https://spark.apache.org/docs/latest/rdd-programming-guide.html#shuffle-operations) + Dimulai dengan Amazon EMR 5.32.0 dan 6.5.0, ukuran pelaksana dinamis untuk Apache Spark diaktifkan secara default. Untuk mengaktifkan atau menonaktifkan fitur ini, Anda dapat menggunakan parameter `spark.yarn.heterogeneousExecutors.enabled` konfigurasi. + Support untuk format tabel terbuka Apache Iceberg untuk kumpulan data analitik yang sangat besar. + Support untuk ranger-trino-plugin 2.0.1-amzn-1 + Support untuk toree 0.5.0 **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Amazon EMR 6.5 versi rilis sekarang mendukung Apache Iceberg 0.12.0, dan menyediakan peningkatan runtime dengan Amazon EMR Runtime untuk Apache Spark, Amazon EMR Runtime untuk Presto, dan Amazon EMR Runtime untuk Apache Hive. + [Apache Iceberg](https://iceberg.apache.org/) adalah format tabel terbuka untuk kumpulan data besar di Amazon S3 dan memberikan kinerja kueri cepat pada tabel besar, komit atom, penulisan bersamaan, dan evolusi tabel yang kompatibel dengan SQL. Dengan EMR 6.5, Anda dapat menggunakan Apache Spark 3.1.2 dengan format tabel Iceberg. + Apache Hudi 0.9 menambahkan Spark SQL DDL dan dukungan DHTML. Hal ini memungkinkan Anda untuk membuat, meningkatkan tabel Hudi hanya menggunakan pernyataan SQL. Apache Hudi 0.9 juga mencakup sisi kueri dan peningkatan kinerja sisi penulis. + Amazon EMR Runtime untuk Apache Hive meningkatkan kinerja Apache Hive di Amazon S3 dengan menghapus operasi ganti nama selama operasi pementasan, dan meningkatkan kinerja untuk perintah metastore check (MSCK) yang digunakan untuk memperbaiki tabel. **Masalah yang Diketahui** + Ketika Amazon EMR merilis 6.5.0, 6.6.0, atau 6.7.0 membaca tabel Apache Phoenix melalui shell Apache Spark, terjadi karena Amazon EMR menggunakan yang `NoSuchMethodError` salah. `Hbase.compat.version` Amazon EMR rilis 6.8.0 memperbaiki masalah ini. + Cluster bundel Hbase dalam ketersediaan tinggi (HA) gagal menyediakan ukuran volume default dan tipe instance. Solusi untuk masalah ini adalah dengan meningkatkan ukuran volume root. + Untuk menggunakan tindakan Spark dengan Apache Oozie, Anda harus menambahkan konfigurasi berikut ke file Oozie Anda. `workflow.xml` Jika tidak, beberapa perpustakaan penting seperti Hadoop dan EMRFS akan hilang dari classpath dari pelaksana Spark yang diluncurkan Oozie. ``` --conf spark.yarn.populateHadoopClasspath=true ``` + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, setel `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 6.5.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.4.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.19.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.1.0 | EMR S3Select Connector | | emrfs | 2.48.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.14.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.14.0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-5 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-5 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-5 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-5 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-5 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-5 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-5 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-5 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-5 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-5 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-5 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.4-amzn-1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.4-amzn-1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.4-amzn-1 | HBase klien baris perintah. | | hbase-rest-server | 2.4.4-amzn-1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.4-amzn-1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 3.1.2-amzn-6 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.2-amzn-6 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.2-amzn-6 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.2-amzn-6 | Klien baris perintah Hive. | | hive-hbase | 3.1.2-amzn-6 | Klien Hive-hbase. | | hive-metastore-server | 3.1.2-amzn-6 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.2-amzn-6 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.9.0-amzn-1 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.9.0-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.9.0-amzn-1 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.9.0-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.9.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | iceberg | 0.12.0 | Apache Iceberg adalah format tabel terbuka untuk kumpulan data analitik besar | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.8.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.1.2 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,261-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,261-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,261-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 360 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 360 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 360 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.1.2-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 3.1.2-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.1.2-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.1.2-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 0.4.1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.7 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.7 | ZooKeeper klien baris perintah. | ## 6.5.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.5.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | iceberg-defaults | Ubah nilai dalam file iceberg-defaults.conf Iceberg. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 6.4.0 ## 6.4.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://trino.io/](https://trino.io/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.4.0 | emr-6.3.1 | emr-6.3.0 | emr-6.2.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.31 | 1.11.977 | 1.11.977 | 1.11.880 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.13.1 | 1.12.1 | 1.12.1 | 1.11.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.4.4-amzn-0 | 2.2.6-amzn-1 | 2.2.6-amzn-1 | 2.2.6-amzn-0 | | HCatalog | 3.1.2-amzn-5 | 3.1.2-amzn-4 | 3.1.2-amzn-4 | Versi 3.1.2 amzn-3 | | Hadoop | 3.2.1-amzn-4 | 3.2.1-amzn-3.1 | 3.2.1-amzn-3 | 3.2.1-amzn-2.1 | | Hive | 3.1.2-amzn-5 | 3.1.2-amzn-4 | 3.1.2-amzn-4 | Versi 3.1.2 amzn-3 | | Hudi | 0.8.0-amzn-0 | 0.7.0-amzn-0 | 0.7.0-amzn-0 | 0.6.0-amzn-1 | | Hue | 4.9.0 | 4.9.0 | 4.9.0 | 4.8.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.2.2 | 1.2.2 | 1.1.0 | | Livy | 0.7.1-inkubasi | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.8.0 | 1.7.0 | 1.7.0 | 1.7.0 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.0 | | Phoenix | 5.1.2 | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.254.1-amzn-0 | 0.245.1-amzn-0 | 0.245.1-amzn-0 | 0.238.3-amzn-1 | | Spark | 3.1.2-amzn-0 | 3.1.1-amzn-0.1 | 3.1.1-amzn-0 | 3.0.1-amzn-0.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.3.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 359 | 350 | 350 | 343 | | Zeppelin | 0.9.0 | 0.9.0 | 0.9.0 | 0.9.0-preview1 | | ZooKeeper | 3.5.7 | 3.4.14 | 3.4.14 | 3.4.14 | ## 6.4.0 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.4.0. Perubahan relatif terhadap 6.3.0. Tanggal rilis awal: 20 September 2021 Tanggal rilis diperbarui: 21 Maret 2022 **Aplikasi-aplikasi yang didukung** + AWS SDK untuk Java versi 1.12.31 + CloudWatch Wastafel versi 2.2.0 + DynamoDB Connector versi 4.16.0 + EMRFS versi 2.47.0 + Amazon EMR Goodies versi 3.2.0 + Amazon EMR Kinesis Connector versi 3.5.0 + Server Rekam EMR Amazon versi 2.1.0 + Amazon EMR Scripts versi 2.5.0 + Flink versi 1.13.1 + Ganglia versi 3.7.2 + AWS Glue Hive Metastore Client versi 3.3.0 + Hadoop versi 3.2.1-amzn-4 + HBase versi 2.4.4-amzn-0 + HBase-operator-tools 1.1.0 + HCatalog versi 3.1.2-amzn-5 + Sarang versi 3.1.2-amzn-5 + Hudi versi 0.8.0-amzn-0 + Hue versi 4.9.0 + Java JDK versi Corretto-8.302.08.1 (build 1.8.0\$1302-b08) + JupyterHub versi 1.4.1 + Livy versi 0.7.1-inkubasi + MXNet versi 1.8.0 + Oozie versi 5.2.1 + Phoenix versi 5.1.2 + Pig versi 0.17.0 + Presto versi 0.254.1-amzn-0 + Trino versi 359 + Apache Ranger KMS (enkripsi transparan multi-utama) versi 2.0.0 + ranger-plugin 2.0.1-amzn-0 + ranger-s3-plugin 1.2.0 + SageMaker Spark SDK versi 1.4.1 + Scala versi 2.12.10 (OpenJDK 64-Bit Server VM, Java 1.8.0\$1282) + Spark versi 3.1.2-amzn-0 + spark-rapids 0.4.1 + Sqoop versi 1.4.7 + TensorFlow versi 2.4.1 + tez versi 0.9.2 + Zeppelin versi 0.9.0 + Zookeeper versi 3.5.7 + Konektor dan driver: DynamoDB Connector 4.16.0 **Fitur baru** + **[Penskalaan terkelola] Pengoptimalan penskalaan terkelola data acak percikan -** Untuk Amazon EMR versi 5.34.0 dan yang lebih baru, dan EMR versi 6.4.0 dan yang lebih baru, penskalaan terkelola sekarang sadar data acak Spark (data yang didistribusikan ulang Spark di seluruh partisi untuk melakukan operasi tertentu). [Untuk informasi selengkapnya tentang operasi shuffle, lihat [Menggunakan penskalaan terkelola EMR di Amazon](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-scaling.html) EMR di Panduan Manajemen *EMR Amazon* dan Panduan Pemrograman Spark.](https://spark.apache.org/docs/latest/rdd-programming-guide.html#shuffle-operations) + Pada kluster EMR Amazon yang mendukung Apache Ranger, Anda dapat menggunakan Apache Spark SQL untuk memasukkan data ke dalam atau memperbarui tabel metastore Apache Hive menggunakan,, dan. `INSERT INTO` `INSERT OVERWRITE` `ALTER TABLE` Saat menggunakan ALTER TABLE dengan Spark SQL, lokasi partisi harus menjadi direktori anak dari lokasi tabel. Amazon EMR saat ini tidak mendukung penyisipan data ke dalam partisi di mana lokasi partisi berbeda dari lokasi tabel. + [PrestosQL telah diubah namanya menjadi Trino.](https://trino.io/blog/2020/12/27/announcing-trino.html) + Hive: Eksekusi kueri SELECT sederhana dengan klausa LIMIT dipercepat dengan menghentikan eksekusi kueri segera setelah jumlah catatan yang disebutkan dalam klausa LIMIT diambil. Kueri SELECT sederhana adalah kueri yang tidak memiliki GROUP BY/ORDER by klausa atau kueri yang tidak memiliki tahap peredam. Misalnya, `SELECT * from WHERE LIMIT `. **Kontrol Konkurensi Hudi** + Hudi sekarang mendukung Optimistic Concurrency Control (OCC), yang dapat dimanfaatkan dengan operasi tulis seperti UPSERT dan INSERT untuk memungkinkan perubahan dari beberapa penulis ke tabel Hudi yang sama. Ini adalah OCC tingkat file, jadi dua komit (atau penulis) dapat menulis ke tabel yang sama, jika perubahannya tidak bertentangan. Untuk informasi lebih lanjut, lihat kontrol [konkurensi Hudi](https://hudi.apache.org/docs/concurrency_control/). + Cluster EMR Amazon telah menginstal Zookeeper, yang dapat dimanfaatkan sebagai penyedia kunci untuk OCC. Untuk mempermudah penggunaan fitur ini, klaster EMR Amazon memiliki properti berikut yang telah dikonfigurasi sebelumnya: ``` hoodie.write.lock.provider=org.apache.hudi.client.transaction.lock.ZookeeperBasedLockProvider hoodie.write.lock.zookeeper.url= hoodie.write.lock.zookeeper.port= hoodie.write.lock.zookeeper.base_path=/hudi ``` Untuk mengaktifkan OCC, Anda perlu mengonfigurasi properti berikut baik dengan opsi pekerjaan Hudi atau di tingkat cluster menggunakan API konfigurasi EMR Amazon: ``` hoodie.write.concurrency.mode=optimistic_concurrency_control hoodie.cleaner.policy.failed.writes=LAZY (Performs cleaning of failed writes lazily instead of inline with every write) hoodie.write.lock.zookeeper.lock_key= (Table Name is a good option) ``` **Pemantauan Hudi: CloudWatch Integrasi Amazon untuk melaporkan Metrik Hudi** + Amazon EMR mendukung penerbitan Hudi Metrics ke Amazon. CloudWatch Ini diaktifkan dengan mengatur konfigurasi yang diperlukan berikut: ``` hoodie.metrics.on=true hoodie.metrics.reporter.type=CLOUDWATCH ``` + Berikut ini adalah konfigurasi Hudi opsional yang dapat Anda ubah: [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-640-release.html) **Dukungan dan peningkatan konfigurasi Amazon EMR Hudi** + Pelanggan sekarang dapat memanfaatkan API Konfigurasi EMR dan fitur Konfigurasi Ulang untuk mengonfigurasi konfigurasi Hudi di tingkat cluster. Dukungan konfigurasi berbasis file baru telah diperkenalkan melalui/etc/hudi/conf/hudi-defaults.conf di sepanjang baris aplikasi lain seperti Spark, Hive dll. EMR mengonfigurasi beberapa default untuk meningkatkan pengalaman pengguna: — `hoodie.datasource.hive_sync.jdbcurl ` dikonfigurasi ke URL server Hive cluster dan tidak perlu lagi ditentukan. Ini sangat berguna saat menjalankan pekerjaan dalam mode cluster Spark, di mana Anda sebelumnya harus menentukan IP master EMR Amazon. — konfigurasi HBase khusus, yang berguna untuk menggunakan HBase indeks dengan Hudi. — Konfigurasi khusus penyedia kunci Zookeeper, seperti yang dibahas di bawah kontrol konkurensi, yang membuatnya lebih mudah untuk menggunakan Optimistic Concurrency Concurrency Control (OCC). + Perubahan tambahan telah diperkenalkan untuk mengurangi jumlah konfigurasi yang perlu Anda lewati, dan untuk menyimpulkan secara otomatis jika memungkinkan: — `partitionBy ` Kata kunci dapat digunakan untuk menentukan kolom partisi. — Saat mengaktifkan Hive Sync, tidak lagi wajib untuk lulus. `HIVE_TABLE_OPT_KEY, HIVE_PARTITION_FIELDS_OPT_KEY, HIVE_PARTITION_EXTRACTOR_CLASS_OPT_KEY` Nilai-nilai tersebut dapat disimpulkan dari nama tabel Hudi dan bidang partisi. — `KEYGENERATOR_CLASS_OPT_KEY` tidak wajib untuk lulus, dan dapat disimpulkan dari kasus yang lebih sederhana dari `SimpleKeyGenerator` dan`ComplexKeyGenerator`. **Peringatan Hudi** + Hudi tidak mendukung eksekusi vektor di Hive for Merge on Read (MoR) dan tabel Bootstrap. Misalnya, `count(*)` gagal dengan tabel realtime Hudi ketika `hive.vectorized.execution.enabled` disetel ke true. Sebagai solusinya, Anda dapat menonaktifkan pembacaan vektor dengan menyetel ke. `hive.vectorized.execution.enabled` `false` + Dukungan multi-penulis tidak kompatibel dengan fitur bootstrap Hudi. + Flink Streamer dan Flink SQL adalah fitur eksperimental dalam rilis ini. Fitur-fitur ini tidak disarankan untuk digunakan dalam penyebaran produksi. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. + Sebelumnya, restart manual pengelola sumber daya pada cluster multi-master menyebabkan daemon on-cluster Amazon EMR, seperti Zookeeper, memuat ulang semua node yang sebelumnya dinonaktifkan atau hilang dalam file znode Zookeeper. Hal ini menyebabkan batas default terlampaui dalam situasi tertentu. Amazon EMR sekarang menghapus catatan node yang dinonaktifkan atau hilang yang lebih tua dari satu jam dari file Zookeeper dan batas internal telah ditingkatkan. + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [SPARK-29683](https://issues.apache.org/jira/browse/SPARK-29683). Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG 9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan autentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + **Mengkonfigurasi cluster untuk memperbaiki masalah kinerja Apache YARN Timeline Server versi 1 dan 1.5** Apache YARN Timeline Server versi 1 dan 1.5 dapat menyebabkan masalah kinerja dengan cluster EMR yang sangat aktif dan besar, terutama dengan`yarn.resourcemanager.system-metrics-publisher.enabled=true`, yang merupakan pengaturan default di Amazon EMR. YARN Timeline Server v2 open source memecahkan masalah kinerja yang terkait dengan skalabilitas YARN Timeline Server. Solusi lain untuk masalah ini meliputi: + Mengkonfigurasi yarn.resourcemanager. system-metrics-publisher.enabled=false di yarn-site.xml. + Mengaktifkan perbaikan untuk masalah ini saat membuat cluster, seperti yang dijelaskan di bawah ini. Rilis EMR Amazon berikut berisi perbaikan untuk masalah kinerja Server Timeline YARN ini. EMR 5.30.2, 5.31.1, 5.32.1, 5.33.1, 5.34.x, 6.0.1, 6.1.1, 6.2.1, 6.3.1, 6.4.x [Untuk mengaktifkan perbaikan pada salah satu rilis EMR Amazon yang ditentukan di atas, setel properti ini ke `true` dalam file JSON konfigurasi yang diteruskan menggunakan parameter perintah:. `aws emr create-cluster`](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps-create-cluster.html) `--configurations file://./configurations.json` Atau aktifkan perbaikan menggunakan [UI konsol konfigurasi ulang](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps-running-cluster.html). Contoh isi file configurations.json: ``` [ { "Classification": "yarn-site", "Properties": { "yarn.resourcemanager.system-metrics-publisher.timeline-server-v1.enable-batch": "true", "yarn.resourcemanager.system-metrics-publisher.enabled": "true" }, "Configurations": [] } ] ``` + WebHDFS dan server HTTPFS dinonaktifkan secara default. Anda dapat mengaktifkan kembali WebHDFS menggunakan konfigurasi Hadoop,. `dfs.webhdfs.enabled` Server HTTPFS dapat dimulai dengan menggunakan. `sudo systemctl start hadoop-httpfs` + HTTPS sekarang diaktifkan secara default untuk repositori Amazon Linux. Jika Anda menggunakan kebijakan Amazon S3 VPCE untuk membatasi akses ke bucket tertentu, Anda harus menambahkan ARN bucket Amazon Linux baru `arn:aws:s3:::amazonlinux-2-repos-$region/*` ke kebijakan Anda (ganti `$region` dengan wilayah tempat titik akhir berada). Untuk informasi lebih lanjut, lihat topik ini di forum AWS diskusi. [Pengumuman: Amazon Linux 2 sekarang mendukung kemampuan untuk menggunakan HTTPS saat menghubungkan ke repositori paket](https://forums.aws.amazon.com/ann.jspa?annID=8528). + Hive: Kinerja kueri tulis ditingkatkan dengan mengaktifkan penggunaan direktori awal pada HDFS untuk pekerjaan terakhir. Data sementara untuk pekerjaan akhir ditulis ke HDFS alih-alih Amazon S3 dan kinerjanya ditingkatkan karena data dipindahkan dari HDFS ke lokasi tabel akhir (Amazon S3) alih-alih di antara perangkat Amazon S3. + Hive: Peningkatan waktu kompilasi kueri hingga 2.5x dengan Glue metastore Partition Pruning. + Secara default, ketika built-in UDFs diteruskan oleh Hive ke Server Metastore Hive, hanya sebagian dari built-in yang UDFs diteruskan ke Glue Metastore karena Glue hanya mendukung operator ekspresi terbatas. Jika Anda mengatur`hive.glue.partition.pruning.client=true`, maka semua pemangkasan partisi terjadi di sisi klien. Jika Anda mengatur`hive.glue.partition.pruning.server=true`, maka semua pemangkasan partisi terjadi di sisi server. **Masalah yang diketahui** + Kueri Hue tidak berfungsi di Amazon EMR 6.4.0 karena server Apache Hadoop HTTPFS dinonaktifkan secara default. [Untuk menggunakan Hue di Amazon EMR 6.4.0, mulai server HTTPFS secara manual di simpul utama Amazon EMR menggunakan`sudo systemctl start hadoop-httpfs`, atau gunakan langkah EMR Amazon.](https://docs.aws.amazon.com/emr/latest/ManagementGuide/add-step-cli.html) + Fitur Amazon EMR Notebooks yang digunakan dengan peniruan identitas pengguna Livy tidak berfungsi karena HTTPFS dinonaktifkan secara default. Dalam hal ini, notebook EMR tidak dapat terhubung ke cluster yang mengaktifkan peniruan Livy. Solusinya adalah memulai server HTTPFS sebelum menghubungkan notebook EMR ke cluster menggunakan. `sudo systemctl start hadoop-httpfs` + Di Amazon EMR versi 6.4.0, Phoenix tidak mendukung komponen konektor Phoenix. + Untuk menggunakan tindakan Spark dengan Apache Oozie, Anda harus menambahkan konfigurasi berikut ke file Oozie Anda. `workflow.xml` Jika tidak, beberapa perpustakaan penting seperti Hadoop dan EMRFS akan hilang dari classpath dari pelaksana Spark yang diluncurkan Oozie. ``` --conf spark.yarn.populateHadoopClasspath=true ``` + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, setel `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 6.4.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.3.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.18.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.1.0 | EMR S3Select Connector | | emrfs | 2.47.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.13.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.13.1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.4.4-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.4.4-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.4.4-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.4.4-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.4.4-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 3.1.2-amzn-5 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.2-amzn-5 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.2-amzn-5 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.2-amzn-5 | Klien baris perintah Hive. | | hive-hbase | 3.1.2-amzn-5 | Klien Hive-hbase. | | hive-metastore-server | 3.1.2-amzn-5 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.2-amzn-5 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.8.0-amzn-0 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.8.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-trino | 0.8.0-amzn-0 | Perpustakaan bundel untuk menjalankan Trino dengan Hudi. | | hudi-spark | 0.8.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.9.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.8.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.1.2 | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.1.2 | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.254.1-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.254.1-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.254.1-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | trino-coordinator | 359 | Layanan untuk menerima kueri dan mengelola eksekusi kueri di antara trino-workers. | | trino-worker | 359 | Layanan untuk mengeksekusi potongan kueri. | | trino-client | 359 | Klien baris perintah Trino yang diinstal pada master siaga cluster HA di mana server Trino tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.1.2-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.1.2-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.1.2-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.1.2-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 0.4.1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.5.7 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.5.7 | ZooKeeper klien baris perintah. | ## 6.4.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.4.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | trino-log | Ubah nilai dalam file log.properties Trino. | Restarts Trino-Server (for Trino) | | trino-config | Ubah nilai dalam file config.properties Trino. | Restarts Trino-Server (for Trino) | | trino-password-authenticator | Ubah nilai dalam file password-authenticator.properties Trino. | Restarts Trino-Server (for Trino) | | trino-env | Ubah nilai dalam file trino-env.sh Trino. | Restarts Trino-Server (for Trino) | | trino-node | Ubah nilai dalam file node.properties Trino. | Not available. | | trino-connector-blackhole | Ubah nilai dalam file blackhole.properties Trino. | Not available. | | trino-connector-cassandra | Ubah nilai dalam file cassandra.properties Trino. | Not available. | | trino-connector-hive | Ubah nilai dalam file hive.properties Trino. | Restarts Trino-Server (for Trino) | | trino-connector-jmx | Ubah nilai dalam file jmx.properties Trino. | Not available. | | trino-connector-kafka | Ubah nilai dalam file kafka.properties Trino. | Not available. | | trino-connector-localfile | Ubah nilai dalam file localfile.properties Trino. | Not available. | | trino-connector-memory | Ubah nilai dalam file memory.properties Trino. | Not available. | | trino-connector-mongodb | Ubah nilai dalam file mongodb.properties Trino. | Not available. | | trino-connector-mysql | Ubah nilai dalam file mysql.properties Trino. | Not available. | | trino-connector-postgresql | Ubah nilai dalam file postgresql.properties Trino. | Not available. | | trino-connector-raptor | Ubah nilai dalam file raptor.properties Trino. | Not available. | | trino-connector-redis | Ubah nilai dalam file redis.properties Trino. | Not available. | | trino-connector-redshift | Ubah nilai dalam file redshift.properties Trino. | Not available. | | trino-connector-tpch | Ubah nilai dalam file tpch.properties Trino. | Not available. | | trino-connector-tpcds | Ubah nilai dalam file tpcds.properties Trino. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 6.3.1 ## 6.3.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://prestosql.io/](https://prestosql.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.3.1 | emr-6.3.0 | emr-6.2.1 | emr-6.2.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.977 | 1.11.977 | 1.11.880 | 1.11.880 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.12.1 | 1.12.1 | 1.11.2 | 1.11.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.2.6-amzn-1 | 2.2.6-amzn-1 | 2.2.6-amzn-0 | 2.2.6-amzn-0 | | HCatalog | 3.1.2-amzn-4 | 3.1.2-amzn-4 | Versi 3.1.2 amzn-3 | Versi 3.1.2 amzn-3 | | Hadoop | 3.2.1-amzn-3.1 | 3.2.1-amzn-3 | 3.2.1-amzn-2.1 | 3.2.1-amzn-2 | | Hive | 3.1.2-amzn-4 | 3.1.2-amzn-4 | Versi 3.1.2 amzn-3 | Versi 3.1.2 amzn-3 | | Hudi | 0.7.0-amzn-0 | 0.7.0-amzn-0 | 0.6.0-amzn-1 | 0.6.0-amzn-1 | | Hue | 4.9.0 | 4.9.0 | 4.8.0 | 4.8.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.2.2 | 1.2.2 | 1.1.0 | 1.1.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.7.0 | 1.7.0 | 1.7.0 | 1.7.0 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.1 | 5.2.0 | 5.2.0 | | Phoenix | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.245.1-amzn-0 | 0.245.1-amzn-0 | 0.238.3-amzn-1 | 0.238.3-amzn-1 | | Spark | 3.1.1-amzn-0.1 | 3.1.1-amzn-0 | 3.0.1-amzn-0.1 | 3.0.1-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.3.1 | 2.3.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 350 | 350 | 343 | 343 | | Zeppelin | 0.9.0 | 0.9.0 | 0.9.0-preview1 | 0.9.0-preview1 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## 6.3.1 Catatan terbitan Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [SPARK-29683](https://issues.apache.org/jira/browse/SPARK-29683). Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG 9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan autentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + HTTPS sekarang diaktifkan secara default untuk repositori Amazon Linux. Jika Anda menggunakan kebijakan Amazon S3 VPCE untuk membatasi akses ke bucket tertentu, Anda harus menambahkan ARN bucket Amazon Linux baru `arn:aws:s3:::amazonlinux-2-repos-$region/*` ke kebijakan Anda (ganti `$region` dengan wilayah tempat titik akhir berada). Untuk informasi lebih lanjut, lihat topik ini di forum AWS diskusi. [Pengumuman: Amazon Linux 2 sekarang mendukung kemampuan untuk menggunakan HTTPS saat menghubungkan ke repositori paket](https://forums.aws.amazon.com/ann.jspa?annID=8528). **Masalah yang diketahui** + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, setel `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 6.3.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.2.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.18.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.1.0 | EMR S3Select Connector | | emrfs | 2.46.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.12.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.12.1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-3.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-3.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-3.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-3.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-3.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-3.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-3.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-3.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-3.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-3.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-3.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.2.6-amzn-1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.2.6-amzn-1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.2.6-amzn-1 | HBase klien baris perintah. | | hbase-rest-server | 2.2.6-amzn-1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.2.6-amzn-1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 3.1.2-amzn-4 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.2-amzn-4 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.2-amzn-4 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.2-amzn-4 | Klien baris perintah Hive. | | hive-hbase | 3.1.2-amzn-4 | Klien Hive-hbase. | | hive-metastore-server | 3.1.2-amzn-4 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.2-amzn-4 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.7.0-amzn-0 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.7.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-prestosql | 0.7.0-amzn-0 | Perpustakaan paket untuk menjalankan PrestoSQL dengan Hudi. | | hudi-spark | 0.7.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.9.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.2.2 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.7.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.0.0- -2.0 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.0.0- -2.0 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.245.1-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.245.1-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.245.1-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | prestosql-coordinator | 350 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara prestosql-woorker. | | prestosql-worker | 350 | Layanan untuk mengeksekusi potongan kueri. | | prestosql-client | 350 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.1.1-amzn-0.1 | Klien baris perintah Spark. | | spark-history-server | 3.1.1-amzn-0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.1.1-amzn-0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.1.1-amzn-0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 0.4.1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 6.3.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.3.1** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | prestosql-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-node | Ubah nilai dalam file node.properties PrestoSQL. | Not available. | | prestosql-connector-blackhole | Ubah nilai dalam file blackhole.properties PrestoSQL. | Not available. | | prestosql-connector-cassandra | Ubah nilai dalam file cassandra.properties PrestoSQL. | Not available. | | prestosql-connector-hive | Ubah nilai dalam file hive.properties PrestoSQL. | Restarts Presto-Server (for PrestoSQL) | | prestosql-connector-jmx | Ubah nilai dalam file jmx.properties PrestoSQL. | Not available. | | prestosql-connector-kafka | Ubah nilai dalam file kafka.properties PrestoSQL. | Not available. | | prestosql-connector-localfile | Ubah nilai dalam file localfile.properties PrestoSQL. | Not available. | | prestosql-connector-memory | Ubah nilai dalam file memory.properties PrestoSQL. | Not available. | | prestosql-connector-mongodb | Ubah nilai dalam file mongodb.properties PrestoSQL. | Not available. | | prestosql-connector-mysql | Ubah nilai dalam file mysql.properties PrestoSQL. | Not available. | | prestosql-connector-postgresql | Ubah nilai dalam file postgresql.properties PrestoSQL. | Not available. | | prestosql-connector-raptor | Ubah nilai dalam file raptor.properties PrestoSQL. | Not available. | | prestosql-connector-redis | Ubah nilai dalam file redis.properties PrestoSQL. | Not available. | | prestosql-connector-redshift | Ubah nilai dalam file redshift.properties PrestoSQL. | Not available. | | prestosql-connector-tpch | Ubah nilai dalam file tpch.properties PrestoSQL. | Not available. | | prestosql-connector-tpcds | Ubah nilai dalam file tpcds.properties PrestoSQL. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR Rilis 6.3.0 ## versi aplikasi 6.3.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://prestosql.io/](https://prestosql.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.3.0 | emr-6.2.1 | emr-6.2.0 | emr-6.1.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.977 | 1.11.880 | 1.11.880 | 1.11.828 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.12.1 | 1.11.2 | 1.11.2 | 1.11.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.2.6-amzn-1 | 2.2.6-amzn-0 | 2.2.6-amzn-0 | 2.2.5 | | HCatalog | 3.1.2-amzn-4 | Versi 3.1.2 amzn-3 | Versi 3.1.2 amzn-3 | Versi 3.1.2-amzn-2 | | Hadoop | 3.2.1-amzn-3 | 3.2.1-amzn-2.1 | 3.2.1-amzn-2 | 3.2.1-amzn-1.1 | | Hive | 3.1.2-amzn-4 | Versi 3.1.2 amzn-3 | Versi 3.1.2 amzn-3 | Versi 3.1.2-amzn-2 | | Hudi | 0.7.0-amzn-0 | 0.6.0-amzn-1 | 0.6.0-amzn-1 | 0.5.2-incubating-amzn-2 | | Hue | 4.9.0 | 4.8.0 | 4.8.0 | 4.7.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | - | | JupyterHub | 1.2.2 | 1.1.0 | 1.1.0 | 1.1.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.7.0 | 1.7.0 | 1.7.0 | 1.6.0 | | Mahout | - | - | - | - | | Oozie | 5.2.1 | 5.2.0 | 5.2.0 | 5.2.0 | | Phoenix | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.245.1-amzn-0 | 0.238.3-amzn-1 | 0.238.3-amzn-1 | 0,232 | | Spark | 3.1.1-amzn-0 | 3.0.1-amzn-0.1 | 3.0.1-amzn-0 | 3.0.0-amzn-0.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.3.1 | 2.3.1 | 2.1.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 350 | 343 | 343 | 338 | | Zeppelin | 0.9.0 | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-preview1 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## catatan rilis 6.3.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.3.0. Perubahan bersifat relatif terhadap 6.2.0. Tanggal rilis awal: 12 Mei 2021 Terakhir dimutakhirkan tanggal: Agustus 9, 2021 **Aplikasi-aplikasi yang didukung** + AWS SDK untuk Java versi 1.11.977 + CloudWatch Wastafel versi 2.1.0 + DynamoDB Connector versi 4.16.0 + EMRFS versi 2.46.0 + Amazon EMR Goodies versi 3.2.0 + Amazon EMR Kinesis Connector versi 3.5.0 + Amazon EMR Record Server versi 2.0.0 + Amazon EMR Scripts versi 2.5.0 + Flink versi 1.12.1 + Ganglia versi 3.7.2 + AWS Glue Hive Metastore Client versi 3.2.0 + Hadoop versi 3.2.1-amzn-3 + HBase versi 2.2.6-amzn-1 + HBase-operator-tools 1.0.0 + HCatalog versi 3.1.2-amzn-0 + Hive 3.1.2-amzn-4 + Hudi versi 0.7.0-amzn-0 + Hue versi 4.9.0 + Java JDK versi Corretto-8.282.08.1 (build 1.8.0\$1282-b08) + JupyterHub versi 1.2.0 + Livy versi 0.7.0-incubating + MXNet versi 1.7.0 + Oozie versi 5.2.1 + Phoenix versi 5.0.0 + Pig versi 0.17.0 + Presto versi 0.245.1-amzn-0 + PrestoSQL versi 350 + Apache Ranger KMS (enkripsi transparan multi-utama) versi 2.0.0 + ranger-plugin 2.0.1-amzn-0 + ranger-s3-plugin 1.1.0 + SageMaker Spark SDK versi 1.4.1 + Scala versi 2.12.10 (OpenJDK 64-Bit Server VM, Java 1.8.0\$1282) + Spark 3.1.1-amzn-0 + spark-rapids 0.4.1 + Sqoop versi 1.4.7 + TensorFlow versi 2.4.1 + tez versi 0.9.2 + Zeppelin versi 0.9.0 + Zookeeper versi 3.4.14 + Konektor dan driver: DynamoDB Connector 4.16.0 **Fitur baru** + Amazon EMR mendukung Poin Akses Amazon S3, fitur Amazon S3 yang memungkinkan Anda mengelola akses untuk danau data bersama dengan mudah. Dengan menggunakan alias Titik Akses Amazon S3, Anda dapat menyederhanakan akses data dalam skala besar di Amazon EMR. Anda dapat menggunakan Titik Akses Amazon S3 dengan semua versi Amazon EMR tanpa biaya tambahan di semua wilayah di mana AWS Amazon EMR tersedia. *Untuk mempelajari selengkapnya tentang Alias Titik Akses Amazon S3 dan Titik Akses, lihat [Menggunakan alias gaya ember untuk titik akses Anda di Panduan Pengguna](https://docs.aws.amazon.com/AmazonS3/latest/userguide/access-points-alias.html) Amazon S3.* + Parameter baru `DescribeReleaseLabel` dan `ListReleaseLabel` API memberikan detail label rilis Amazon EMR. Anda dapat membuat daftar rilis yang tersedia secara terprogram di wilayah tempat permintaan API dijalankan, dan mencantumkan aplikasi yang tersedia untuk label rilis EMR Amazon tertentu. Parameter label rilis juga mencantumkan rilis EMR Amazon yang mendukung aplikasi tertentu, seperti Spark. Informasi ini dapat digunakan untuk meluncurkan kluster EMR Amazon secara terprogram. Misalnya, Anda dapat meluncurkan cluster menggunakan versi rilis terbaru dari `ListReleaseLabel` hasil. Untuk informasi selengkapnya, lihat [DescribeReleaseLabel](https://docs.aws.amazon.com/emr/latest/APIReference/API_DescribeReleaseLabel.html)dan [ListReleaseLabels](https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html)di Referensi *API EMR Amazon*. + Dengan Amazon EMR 6.3.0, Anda dapat meluncurkan sebuah klaster yang asli terintegrasi dengan Apache Ranger. Apache Ranger adalah kerangka kerja sumber terbuka untuk mengaktifkan, memantau, dan mengelola keamanan data komprehensif di seluruh platform Hadoop. Untuk informasi selengkapnya, lihat [Apache Ranger](https://ranger.apache.org/). Dengan integrasi asli, Anda dapat membawa Apache Ranger Anda sendiri untuk memberlakukan kendali akses data halus di Amazon EMR. Lihat [Mengintegrasikan Amazon EMR dengan Apache Ranger](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-ranger.html) dalam Panduan Pengelolaan Amazon EMR. + Kebijakan terkelola cakupan: Untuk menyelaraskan dengan praktik AWS terbaik, Amazon EMR telah memperkenalkan kebijakan terkelola default cakupan EMR v2 sebagai pengganti kebijakan yang tidak digunakan lagi. Lihat [Kebijakan Terkelola Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-iam-policies.html). + Status dukungan Instance Metadata Service (IMDS) V2: Untuk Amazon EMR 6.2 atau yang lebih baru, komponen EMR Amazon digunakan untuk semua panggilan IMDS. IMDSv2 Untuk panggilan IMDS dalam kode aplikasi Anda, Anda dapat menggunakan keduanya IMDSv1 dan IMDSv2, atau mengkonfigurasi IMDS untuk digunakan hanya IMDSv2 untuk keamanan tambahan. Jika Anda menonaktifkan IMDSv1 di rilis Amazon EMR 6.x sebelumnya, ini menyebabkan kegagalan startup cluster. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [SPARK-29683](https://issues.apache.org/jira/browse/SPARK-29683). Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG 9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan autentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + Spark SQL UI menjelaskan mode default diubah dari `extended` ke `formatted` di [Spark](https://issues.apache.org/jira/browse/SPARK-31325) 3.1. Amazon EMR mengembalikannya `extended` untuk memasukkan informasi rencana logis di Spark SQL UI. Ini dapat dikembalikan dengan pengaturan `spark.sql.ui.explainMode` ke`formatted`. + Komit berikut di-backport dari cabang master Spark. - [[SPARK-34752] [BUILD]](https://issues.apache.org/jira/browse/SPARK-34752) Bump Jetty ke 9.4.37 untuk alamat CVE-2020-27223. - [[SPARK-34534]](https://issues.apache.org/jira/browse/SPARK-34534) Perbaiki pesanan BlocKids saat digunakan untuk mengambil blok. FetchShuffleBlocks - [[SPARK-34681] [SQL]](https://issues.apache.org/jira/browse/SPARK-34681) Perbaiki bug untuk gabungan hash acak luar penuh saat membangun sisi kiri dengan kondisi yang tidak sama. - [[SPARK-34497] [SQL]](https://issues.apache.org/jira/browse/SPARK-34497) Perbaiki penyedia koneksi JDBC bawaan untuk memulihkan perubahan konteks keamanan JVM. + [https://github.com/NVIDIA/spark-rapids/issues/1378](https://github.com/NVIDIA/spark-rapids/issues/1378) Untuk detail konfigurasi baru`spark.sql.optimizer.dynamicPartitionPruning.enforceBroadcastReuse`, lihat [RAPIDS issue \$1 \$11386](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-performance.html#emr-spark-performance-dynamic). + File algoritme default output committer telah berubah dari algoritme v2 untuk algoritme v1 di Spark 3.1 sumber terbuka. Untuk informasi lebih lanjut, lihat [EMR Amazon ini mengoptimalkan kinerja Spark -](https://issues.apache.org/jira/browse/SPARK-33019) pemangkasan partisi dinamis. + Amazon EMR mengembalikan ke algoritme v2, default yang digunakan di Amazon EMR rilis 6.x sebelumnya, untuk mencegah penurunan performa. Untuk memulihkan perilaku sumber terbuka Spark 3.1, atur `spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version` ke `1`. Spark sumber terbuka membuat perubahan ini karena melakukan tugas dalam file algoritme output committer v2 tidak bersifat atom, yang dapat menyebabkan masalah kebenaran data output dalam beberapa kasus. Namun, melakukan tugas dalam algoritme v1 juga tidak bersifat atom. Dalam beberapa skenario melakukan tugas termasuk penghapusan yang dilakukan sebelum mengubah nama. Hal ini dapat mengakibatkan terjadinya masalah kebenaran data diam. + Memperbaiki masalah Penskalaan Terkelola dalam rilis EMR Amazon sebelumnya dan melakukan peningkatan sehingga tingkat kegagalan aplikasi berkurang secara signifikan. + Menginstal AWS Java SDK Bundle pada setiap cluster baru. Ini adalah toples tunggal yang berisi semua layanan SDKs dan dependensinya, bukan stoples komponen individual. Untuk informasi selengkapnya, lihat [Java SDK Bundled](https://aws.amazon.com/blogs/developer/java-sdk-bundle/) Dependency. **Masalah yang diketahui** + Untuk Amazon EMR 6.3.0 dan 6.2.0 kluster subnet pribadi, Anda tidak dapat mengakses UI web Ganglia. Anda akan mendapatkan pesan kesalahan "akses ditolak (403)". Web lain UIs, seperti Spark, Hue,, Zeppelin JupyterHub, Livy, dan Tez bekerja secara normal. Akses UI web Ganglia pada klaster subnet publik juga bekerja secara normal. Untuk mengatasi masalah ini, mulai ulang layanan httpd pada node utama dengan`sudo systemctl restart httpd`. Masalah ini telah diperbaiki di Amazon EMR 6.4.0. + Saat AWS Glue Data Catalog diaktifkan, menggunakan Spark untuk mengakses AWS Glue DB dengan URI lokasi string nol mungkin gagal. Ini terjadi pada rilis EMR Amazon sebelumnya, tetapi SPARK-31709 (https://issues.apache. org/jira/browse/SPARK-31709) membuatnya berlaku untuk lebih banyak kasus. Misalnya, saat membuat tabel dalam AWS Glue DB default yang URI lokasinya adalah string null, `spark.sql("CREATE TABLE mytest (key string) location '/table_path';")` gagal dengan pesan, “Tidak dapat membuat Path dari string kosong.” Untuk mengatasinya, atur URI lokasi database AWS Glue Anda secara manual, lalu buat tabel dalam database ini menggunakan Spark. + Di Amazon EMR 6.3.0, PrestoSQL telah naik dari versi 343 ke versi 350. Ada dua keamanan terkait perubahan dari sumber terbuka yang berhubungan dengan perubahan versi ini. Kendali akses katalog berbasis file diubah dari `deny` ke `allow` ketika tabel, skema, atau aturan properti sesi tidak ditentukan. Juga, kendali akses sistem berbasis file diubah untuk mendukung file tanpa katalog aturan yang ditentukan. Dalam hal ini, semua akses ke katalog diizinkan. Untuk informasi selengkapnya, lihat [Rilis 344 (9 Oktober 2020)](https://trino.io/docs/current/release/release-344.html#security). + Perhatikan bahwa direktori pengguna Hadoop (/home/hadoop) is readable by everyone. It has Unix 755 (drwxr-xr-x) directory permissions to allow read access by frameworks like Hive. You can put files in /home/hadoopdan subdirektorinya, tetapi perhatikan izin pada direktori tersebut untuk melindungi informasi sensitif. + **Turunkan batas “Maks open files” pada yang lebih lama AL2 [diperbaiki dalam rilis yang lebih baru].** Rilis Amazon EMR: emr-5.30.x, emr-5.31.0, emr-5.32.0, emr-6.0.0, emr-6.1.0, dan emr-6.2.0 didasarkan pada versi lama dari Amazon Linux 2 (), yang memiliki pengaturan ulimit yang lebih rendah untuk “File terbuka maksimum” ketika kluster Amazon EMR dibuat dengan AMI default. AL2 Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. Rilis dengan batas file terbuka yang lebih rendah menyebabkan kesalahan “Terlalu banyak file terbuka” saat mengirimkan pekerjaan Spark. Dalam rilis yang terkena dampak, AMI default Amazon EMR memiliki pengaturan ulimit default 4096 untuk “File terbuka maksimum,” yang lebih rendah dari batas file 65536 di AMI Amazon Linux 2 terbaruAmazon. Pengaturan ulimit yang lebih rendah untuk "Maksimal file terbuka" menyebabkan kegagalan tugas Spark ketika driver dan pelaksana mencoba untuk membuka lebih dari 4096 file. Untuk memperbaiki masalah, Amazon EMR memiliki skrip tindakan bootstrap (BA) yang menyesuaikan pengaturan ulimit saat pembuatan klaster. Jika Anda menggunakan versi EMR Amazon yang lebih lama yang tidak memiliki perbaikan permanen untuk masalah ini, solusi berikut memungkinkan Anda untuk secara eksplisit mengatur ulimit pengontrol instans ke maksimum 65536 file. **Mengatur secara eksplisit ulimit dari baris perintah** 1. Edit `/etc/systemd/system/instance-controller.service` untuk menambahkan parameter berikut ke bagian Layanan. `LimitNOFILE=65536` `LimitNPROC=65536` 1. Mulai ulang InstanceController `$ sudo systemctl daemon-reload` `$ sudo systemctl restart instance-controller` **Tetapkan ulimit menggunakan tindakan bootstrap (BA)** Anda juga dapat menggunakan skrip tindakan bootstrap (BA) untuk mengkonfigurasi ulimit instans-pengendali menjadi 65536 file saat pembuatan klaster. ``` #!/bin/bash for user in hadoop spark hive; do sudo tee /etc/security/limits.d/$user.conf << EOF $user - nofile 65536 $user - nproc 65536 EOF done for proc in instancecontroller logpusher; do sudo mkdir -p /etc/systemd/system/$proc.service.d/ sudo tee /etc/systemd/system/$proc.service.d/override.conf << EOF [Service] LimitNOFILE=65536 LimitNPROC=65536 EOF pid=$(pgrep -f aws157.$proc.Main) sudo prlimit --pid $pid --nofile=65535:65535 --nproc=65535:65535 done sudo systemctl daemon-reload ``` + **penting** Cluster EMR yang menjalankan Amazon Linux atau Amazon Linux 2 Amazon Machine Images (AMI) menggunakan perilaku default Amazon Linux, dan tidak secara otomatis mengunduh dan menginstal pembaruan kernel penting dan kritis yang memerlukan reboot. Ini adalah perilaku yang sama dengan instans Amazon EC2 lainnya yang menjalankan AMI Amazon Linux default. Jika pembaruan perangkat lunak Amazon Linux baru yang memerlukan reboot (seperti pembaruan kernel, NVIDIA, dan CUDA) tersedia setelah rilis EMR Amazon tersedia, instance cluster EMR yang menjalankan AMI default tidak secara otomatis mengunduh dan menginstal pembaruan tersebut. Untuk mendapatkan pembaruan kernel, Anda dapat [menyesuaikan Amazon EMR AMI](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-custom-ami.html) menjadi [gunakan Amazon Linux AMI terbaru](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/finding-an-ami.html). + Untuk menggunakan tindakan Spark dengan Apache Oozie, Anda harus menambahkan konfigurasi berikut ke file Oozie Anda. `workflow.xml` Jika tidak, beberapa perpustakaan penting seperti Hadoop dan EMRFS akan hilang dari classpath dari pelaksana Spark yang diluncurkan Oozie. ``` --conf spark.yarn.populateHadoopClasspath=true ``` + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, setel `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## versi komponen 6.3.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.2.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.18.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.1.0 | EMR S3Select Connector | | emrfs | 2.46.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.12.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.12.1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-3 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.2.6-amzn-1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.2.6-amzn-1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.2.6-amzn-1 | HBase klien baris perintah. | | hbase-rest-server | 2.2.6-amzn-1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.2.6-amzn-1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 3.1.2-amzn-4 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.2-amzn-4 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.2-amzn-4 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.2-amzn-4 | Klien baris perintah Hive. | | hive-hbase | 3.1.2-amzn-4 | Klien Hive-hbase. | | hive-metastore-server | 3.1.2-amzn-4 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.2-amzn-4 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.7.0-amzn-0 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.7.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-prestosql | 0.7.0-amzn-0 | Perpustakaan paket untuk menjalankan PrestoSQL dengan Hudi. | | hudi-spark | 0.7.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.9.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.2.2 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.7.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MariaDB. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.0.0- -2.0 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.0.0- -2.0 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.245.1-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.245.1-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.245.1-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | prestosql-coordinator | 350 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara prestosql-woorker. | | prestosql-worker | 350 | Layanan untuk mengeksekusi potongan kueri. | | prestosql-client | 350 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.1.1-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.1.1-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.1.1-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.1.1-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 0.4.1 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## klasifikasi konfigurasi 6.3.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.3.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Restarts Flink history server. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS services Namenode, Datanode, and ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | prestosql-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-node | Ubah nilai dalam file node.properties PrestoSQL. | Not available. | | prestosql-connector-blackhole | Ubah nilai dalam file blackhole.properties PrestoSQL. | Not available. | | prestosql-connector-cassandra | Ubah nilai dalam file cassandra.properties PrestoSQL. | Not available. | | prestosql-connector-hive | Ubah nilai dalam file hive.properties PrestoSQL. | Restarts Presto-Server (for PrestoSQL) | | prestosql-connector-jmx | Ubah nilai dalam file jmx.properties PrestoSQL. | Not available. | | prestosql-connector-kafka | Ubah nilai dalam file kafka.properties PrestoSQL. | Not available. | | prestosql-connector-localfile | Ubah nilai dalam file localfile.properties PrestoSQL. | Not available. | | prestosql-connector-memory | Ubah nilai dalam file memory.properties PrestoSQL. | Not available. | | prestosql-connector-mongodb | Ubah nilai dalam file mongodb.properties PrestoSQL. | Not available. | | prestosql-connector-mysql | Ubah nilai dalam file mysql.properties PrestoSQL. | Not available. | | prestosql-connector-postgresql | Ubah nilai dalam file postgresql.properties PrestoSQL. | Not available. | | prestosql-connector-raptor | Ubah nilai dalam file raptor.properties PrestoSQL. | Not available. | | prestosql-connector-redis | Ubah nilai dalam file redis.properties PrestoSQL. | Not available. | | prestosql-connector-redshift | Ubah nilai dalam file redshift.properties PrestoSQL. | Not available. | | prestosql-connector-tpch | Ubah nilai dalam file tpch.properties PrestoSQL. | Not available. | | prestosql-connector-tpcds | Ubah nilai dalam file tpcds.properties PrestoSQL. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie and HiveServer2. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 6.2.1 ## 6.2.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://prestosql.io/](https://prestosql.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.2.1 | emr-6.2.0 | emr-6.1.1 | emr-6.1.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.880 | 1.11.880 | 1.11.828 | 1.11.828 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.2 | 1.11.2 | 1.11.0 | 1.11.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.2.6-amzn-0 | 2.2.6-amzn-0 | 2.2.5 | 2.2.5 | | HCatalog | Versi 3.1.2 amzn-3 | Versi 3.1.2 amzn-3 | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | | Hadoop | 3.2.1-amzn-2.1 | 3.2.1-amzn-2 | 3.2.1-amzn-1.1 | Versi 3.2.1-amzn-1 | | Hive | Versi 3.1.2 amzn-3 | Versi 3.1.2 amzn-3 | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | | Hudi | 0.6.0-amzn-1 | 0.6.0-amzn-1 | 0.5.2-incubating-amzn-2 | 0.5.2-incubating-amzn-2 | | Hue | 4.8.0 | 4.8.0 | 4.7.1 | 4.7.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.7.0 | 1.7.0 | 1.6.0 | 1.6.0 | | Mahout | - | - | - | - | | Oozie | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | | Phoenix | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.238.3-amzn-1 | 0.238.3-amzn-1 | 0,232 | 0,232 | | Spark | 3.0.1-amzn-0.1 | 3.0.1-amzn-0 | 3.0.0-amzn-0.1 | 3.0.0-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.3.1 | 2.3.1 | 2.1.0 | 2.1.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 343 | 343 | 338 | 338 | | Zeppelin | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-preview1 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## 6.2.1 catatan rilis Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [SPARK-29683](https://issues.apache.org/jira/browse/SPARK-29683). Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG 9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan autentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + HTTPS sekarang diaktifkan secara default untuk repositori Amazon Linux. Jika Anda menggunakan kebijakan Amazon S3 VPCE untuk membatasi akses ke bucket tertentu, Anda harus menambahkan ARN bucket Amazon Linux baru `arn:aws:s3:::amazonlinux-2-repos-$region/*` ke kebijakan Anda (ganti `$region` dengan wilayah tempat titik akhir berada). Untuk informasi lebih lanjut, lihat topik ini di forum AWS diskusi. [Pengumuman: Amazon Linux 2 sekarang mendukung kemampuan untuk menggunakan HTTPS saat menghubungkan ke repositori paket](https://forums.aws.amazon.com/ann.jspa?annID=8528). **Masalah yang diketahui** + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, setel `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 6.2.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.0.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.16.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.0.0 | EMR S3Select Connector | | emrfs | 2.44.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.11.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.11.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-2.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-2.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-2.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-2.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-2.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-2.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-2.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-2.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-2.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-2.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-2.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.2.6-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.2.6-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.2.6-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.2.6-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.2.6-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | Versi 3.1.2 amzn-3 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | Versi 3.1.2 amzn-3 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | Versi 3.1.2 amzn-3 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | Versi 3.1.2 amzn-3 | Klien baris perintah Hive. | | hive-hbase | Versi 3.1.2 amzn-3 | Klien Hive-hbase. | | hive-metastore-server | Versi 3.1.2 amzn-3 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | Versi 3.1.2 amzn-3 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.6.0-amzn-1 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.6.0-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-prestosql | 0.6.0-amzn-1 | Perpustakaan paket untuk menjalankan PrestoSQL dengan Hudi. | | hudi-spark | 0.6.0-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.8.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.7.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64\$1 | Server basis data MariaDB. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.0.0- -2.0 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.0.0- -2.0 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.238.3-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.238.3-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.238.3-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | prestosql-coordinator | 343 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara prestosql-woorker. | | prestosql-worker | 343 | Layanan untuk mengeksekusi potongan kueri. | | prestosql-client | 343 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.0.1-amzn-0.1 | Klien baris perintah Spark. | | spark-history-server | 3.0.1-amzn-0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.0.1-amzn-0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.0.1-amzn-0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 0.2.0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.3.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0-preview1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 6.2.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-6.2.1** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Not available. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Not available. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Not available. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | prestosql-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-node | Ubah nilai dalam file node.properties PrestoSQL. | Not available. | | prestosql-connector-blackhole | Ubah nilai dalam file blackhole.properties PrestoSQL. | Not available. | | prestosql-connector-cassandra | Ubah nilai dalam file cassandra.properties PrestoSQL. | Not available. | | prestosql-connector-hive | Ubah nilai dalam file hive.properties PrestoSQL. | Restarts Presto-Server (for PrestoSQL) | | prestosql-connector-jmx | Ubah nilai dalam file jmx.properties PrestoSQL. | Not available. | | prestosql-connector-kafka | Ubah nilai dalam file kafka.properties PrestoSQL. | Not available. | | prestosql-connector-localfile | Ubah nilai dalam file localfile.properties PrestoSQL. | Not available. | | prestosql-connector-memory | Ubah nilai dalam file memory.properties PrestoSQL. | Not available. | | prestosql-connector-mongodb | Ubah nilai dalam file mongodb.properties PrestoSQL. | Not available. | | prestosql-connector-mysql | Ubah nilai dalam file mysql.properties PrestoSQL. | Not available. | | prestosql-connector-postgresql | Ubah nilai dalam file postgresql.properties PrestoSQL. | Not available. | | prestosql-connector-raptor | Ubah nilai dalam file raptor.properties PrestoSQL. | Not available. | | prestosql-connector-redis | Ubah nilai dalam file redis.properties PrestoSQL. | Not available. | | prestosql-connector-redshift | Ubah nilai dalam file redshift.properties PrestoSQL. | Not available. | | prestosql-connector-tpch | Ubah nilai dalam file tpch.properties PrestoSQL. | Not available. | | prestosql-connector-tpcds | Ubah nilai dalam file tpcds.properties PrestoSQL. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 6.2.0 ## versi aplikasi 6.2.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://prestosql.io/](https://prestosql.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.2.0 | emr-6.1.1 | emr-6.1.0 | emr-6.0.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.880 | 1.11.828 | 1.11.828 | 1.11.711 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.12.10 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.2 | 1.11.0 | 1.11.0 | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.2.6-amzn-0 | 2.2.5 | 2.2.5 | 2.2.3 | | HCatalog | Versi 3.1.2 amzn-3 | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | | Hadoop | 3.2.1-amzn-2 | 3.2.1-amzn-1.1 | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0.1 | | Hive | Versi 3.1.2 amzn-3 | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | | Hudi | 0.6.0-amzn-1 | 0.5.2-incubating-amzn-2 | 0.5.2-incubating-amzn-2 | 0.5.0-incubating-amzn-1 | | Hue | 4.8.0 | 4.7.1 | 4.7.1 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.1.0 | 1.0.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.6.0-incubating | | MXNet | 1.7.0 | 1.6.0 | 1.6.0 | 1.5.1 | | Mahout | - | - | - | - | | Oozie | 5.2.0 | 5.2.0 | 5.2.0 | 5.1.0 | | Phoenix | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | - | | Presto | 0.238.3-amzn-1 | 0,232 | 0,232 | 0,230 | | Spark | 3.0.1-amzn-0 | 3.0.0-amzn-0.1 | 3.0.0-amzn-0 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | - | | TensorFlow | 2.3.1 | 2.1.0 | 2.1.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 343 | 338 | 338 | - | | Zeppelin | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-SNAPSHOT | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## catatan rilis 6.2.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.2.0. Perubahan bersifat relatif terhadap versi 6.1.0. Tanggal rilis awal: 09 Desember 2020 Tanggal terakhir dimutakhirkan: Okt 04, 2021 **Aplikasi-aplikasi yang didukung** + AWS SDK untuk Java versi 1.11.828 + emr-record-server versi 1.7.0 + Flink versi 1.11.2 + Ganglia versi 3.7.2 + Hadoop versi 3.2.1-amzn-1 + HBase versi 2.2.6-amzn-0 + HBase-operator-tools 1.0.0 + HCatalog versi 3.1.2-amzn-0 + Hive versi 3.1.2-amzn-3 + Hudi versi 0.6.0-amzn-1 + Hue versi 4.8.0 + JupyterHub versi 1.1.0 + Livy versi 0.7.0 + MXNet versi 1.7.0 + Oozie versi 5.2.0 + Phoenix versi 5.0.0 + Pig versi 0.17.0 + Presto versi 0.238.3-amzn-1 + PrestoSQL versi 343 + Spark versi 3.0.1-amzn-0 + spark-rapids versi 0.2.0 + TensorFlow versi 2.3.1 + Zeppelin versi 0.9.0-preview1 + Zookeeper versi 3.4.14 + Konektor dan driver: DynamoDB Connector 4.16.0 **Fitur baru** + HBase: Menghapus ganti nama dalam fase komit dan menambahkan HFile pelacakan persisten. Lihat [ HFile Pelacakan Persisten](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hbase-s3.html#emr-hbase-s3-hfile-tracking) di *Panduan Rilis EMR Amazon*. + HBase: Backported [Buat konfigurasi yang memaksa untuk menyimpan blok](https://issues.apache.org/jira/browse/HBASE-23066) pada pemadatan. + PrestoDB: Perbaikan Pemangkasan Partisi Dinamis. Join Reorder berbasis aturan bekerja pada data non-partisi. + Kebijakan terkelola cakupan: Untuk menyelaraskan dengan praktik AWS terbaik, Amazon EMR telah memperkenalkan kebijakan terkelola default cakupan EMR v2 sebagai pengganti kebijakan yang tidak digunakan lagi. Lihat [Kebijakan Terkelola Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-iam-policies.html). + Status dukungan Instance Metadata Service (IMDS) V2: Untuk Amazon EMR 6.2 atau yang lebih baru, komponen EMR Amazon digunakan untuk semua panggilan IMDS. IMDSv2 Untuk panggilan IMDS dalam kode aplikasi Anda, Anda dapat menggunakan keduanya IMDSv1 dan IMDSv2, atau mengkonfigurasi IMDS untuk digunakan hanya IMDSv2 untuk keamanan tambahan. Jika Anda menonaktifkan IMDSv1 di rilis Amazon EMR 6.x sebelumnya, ini menyebabkan kegagalan startup cluster. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [SPARK-29683](https://issues.apache.org/jira/browse/SPARK-29683). Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG 9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan autentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + Spark: Perbaikan performa dalam waktu aktif Spark. **Masalah yang diketahui** + Amazon EMR 6.2 memiliki izin yang salah disetel pada direktori/etc/cron.d/libinstance-controller-java file in EMR 6.2.0. Permissions on the file are 645 (-rw-r--r-x), when they should be 644 (-rw-r--r--). As a result, Amazon EMR version 6.2 does not log instance-state logs, and the /emr/instance-logs kosong. Masalah ini diperbaiki di Amazon EMR 6.3.0 dan yang lebih baru. Untuk mengatasi masalah ini, jalankan skrip berikut sebagai tindakan bootstrap saat peluncuran cluster. ``` #!/bin/bash sudo chmod 644 /etc/cron.d/libinstance-controller-java ``` + Untuk Amazon EMR 6.2.0 dan 6.3.0 kluster subnet pribadi, Anda tidak dapat mengakses UI web Ganglia. Anda akan mendapatkan pesan kesalahan "akses ditolak (403)". Web lain UIs, seperti Spark, Hue,, Zeppelin JupyterHub, Livy, dan Tez bekerja secara normal. Akses UI web Ganglia pada klaster subnet publik juga bekerja secara normal. Untuk mengatasi masalah ini, mulai ulang layanan httpd pada node utama dengan`sudo systemctl restart httpd`. Masalah ini telah diperbaiki di Amazon EMR 6.4.0. + Ada masalah pada Amazon EMR 6.2.0 di mana httpd terus-menerus gagal, sehingga menyebabkan Ganglia tidak tersedia. Anda mendapatkan pesan kesalahan "tidak dapat menyambung ke server". Untuk memperbaiki cluster yang sudah berjalan dengan masalah ini, SSH ke node utama cluster dan tambahkan baris `Listen 80` ke file yang `httpd.conf` terletak di`/etc/httpd/conf/httpd.conf`. Masalah ini telah diperbaiki pada Amazon EMR 6.3.0. + HTTPD gagal pada klaster EMR 6.2.0 ketika Anda menggunakan konfigurasi keamanan. Hal ini membuat antarmuka pengguna aplikasi web Ganglia tidak tersedia. Untuk mengakses antarmuka pengguna aplikasi web Ganglia, tambahkan `Listen 80` ke `/etc/httpd/conf/httpd.conf` file pada node utama cluster Anda. Untuk informasi tentang menghubungkan ke cluster Anda, lihat [Connect to the Primary Node Using SSH](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-connect-master-node-ssh.html). EMR Notebooks juga gagal untuk membuat sambungan dengan klaster EMR 6.2.0 bila Anda menggunakan konfigurasi keamanan. Notebook tersebut akan gagal untuk membuat daftar kernel dan mengirimkan tugas Spark. Kami merekomendasikan agar Anda menggunakan EMR Notebooks dengan Amazon EMR versi lainnya sebagai gantinya. + **Turunkan batas “Maks open files” pada yang lebih lama AL2 [diperbaiki dalam rilis yang lebih baru].** Rilis Amazon EMR: emr-5.30.x, emr-5.31.0, emr-5.32.0, emr-6.0.0, emr-6.1.0, dan emr-6.2.0 didasarkan pada versi lama dari Amazon Linux 2 (), yang memiliki pengaturan ulimit yang lebih rendah untuk “File terbuka maksimum” ketika kluster Amazon EMR dibuat dengan AMI default. AL2 Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. Rilis dengan batas file terbuka yang lebih rendah menyebabkan kesalahan “Terlalu banyak file terbuka” saat mengirimkan pekerjaan Spark. Dalam rilis yang terkena dampak, AMI default Amazon EMR memiliki pengaturan ulimit default 4096 untuk “File terbuka maksimum,” yang lebih rendah dari batas file 65536 di AMI Amazon Linux 2 terbaruAmazon. Pengaturan ulimit yang lebih rendah untuk "Maksimal file terbuka" menyebabkan kegagalan tugas Spark ketika driver dan pelaksana mencoba untuk membuka lebih dari 4096 file. Untuk memperbaiki masalah, Amazon EMR memiliki skrip tindakan bootstrap (BA) yang menyesuaikan pengaturan ulimit saat pembuatan klaster. Jika Anda menggunakan versi EMR Amazon yang lebih lama yang tidak memiliki perbaikan permanen untuk masalah ini, solusi berikut memungkinkan Anda untuk secara eksplisit mengatur ulimit pengontrol instans ke maksimum 65536 file. **Mengatur secara eksplisit ulimit dari baris perintah** 1. Edit `/etc/systemd/system/instance-controller.service` untuk menambahkan parameter berikut ke bagian Layanan. `LimitNOFILE=65536` `LimitNPROC=65536` 1. Mulai ulang InstanceController `$ sudo systemctl daemon-reload` `$ sudo systemctl restart instance-controller` **Tetapkan ulimit menggunakan tindakan bootstrap (BA)** Anda juga dapat menggunakan skrip tindakan bootstrap (BA) untuk mengkonfigurasi ulimit instans-pengendali menjadi 65536 file saat pembuatan klaster. ``` #!/bin/bash for user in hadoop spark hive; do sudo tee /etc/security/limits.d/$user.conf << EOF $user - nofile 65536 $user - nproc 65536 EOF done for proc in instancecontroller logpusher; do sudo mkdir -p /etc/systemd/system/$proc.service.d/ sudo tee /etc/systemd/system/$proc.service.d/override.conf << EOF [Service] LimitNOFILE=65536 LimitNPROC=65536 EOF pid=$(pgrep -f aws157.$proc.Main) sudo prlimit --pid $pid --nofile=65535:65535 --nproc=65535:65535 done sudo systemctl daemon-reload ``` + **penting** Amazon EMR 6.1.0 dan 6.2.0 mempunyai masalah performa yang secara kritis dapat mempengaruhi semua operasi insert, upsert, dan delete Hudi. Jika Anda berencana untuk menggunakan Hudi dengan Amazon EMR 6.1.0 atau 6.2.0, Anda harus AWS menghubungi dukungan untuk mendapatkan RPM Hudi yang ditambal. + **penting** Cluster EMR yang menjalankan Amazon Linux atau Amazon Linux 2 Amazon Machine Images (AMI) menggunakan perilaku default Amazon Linux, dan tidak secara otomatis mengunduh dan menginstal pembaruan kernel penting dan kritis yang memerlukan reboot. Ini adalah perilaku yang sama dengan instans Amazon EC2 lainnya yang menjalankan AMI Amazon Linux default. Jika pembaruan perangkat lunak Amazon Linux baru yang memerlukan reboot (seperti pembaruan kernel, NVIDIA, dan CUDA) tersedia setelah rilis EMR Amazon tersedia, instance cluster EMR yang menjalankan AMI default tidak secara otomatis mengunduh dan menginstal pembaruan tersebut. Untuk mendapatkan pembaruan kernel, Anda dapat [menyesuaikan Amazon EMR AMI](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-custom-ami.html) menjadi [gunakan Amazon Linux AMI terbaru](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/finding-an-ami.html). + Artefak Amazon EMR 6.2.0 Maven tidak dipublikasikan. Ia akan diterbitkan dengan rilis Amazon EMR yang akan datang. + HFile Pelacakan persisten menggunakan tabel sistem HBase storefile tidak mendukung fitur replikasi HBase wilayah. Untuk informasi selengkapnya tentang replikasi HBase wilayah, lihat Pembacaan Tersedia Tinggi [Konsisten Waktu](http://hbase.apache.org/book.html#arch.timelineconsistent.reads). + Perbedaan versi bucket Amazon EMR 6.x dan EMR 5.x Hive EMR 5.x menggunakan OOS Apache Hive 2, sedangkan di EMR 6.x menggunakan OOS Apache Hive 3. Hive2 sumber terbuka menggunakan Bucketing versi 1, sementara Hive3 sumber terbuka menggunakan Bucketing versi 2. Perbedaan versi bucket antara Hive 2 (EMR 5.x) dan Hive 3 (EMR 6.x) berarti pem-bucket-an Hive melakukan hashing fungsi yang berbeda. Lihat contoh di bawah ini. Tabel berikut adalah contoh yang dibuat di EMR 6.x dan EMR 5.x, berurutan. ``` -- Using following LOCATION in EMR 6.x CREATE TABLE test_bucketing (id INT, desc STRING) PARTITIONED BY (day STRING) CLUSTERED BY(id) INTO 128 BUCKETS LOCATION 's3://your-own-s3-bucket/emr-6-bucketing/'; -- Using following LOCATION in EMR 5.x LOCATION 's3://your-own-s3-bucket/emr-5-bucketing/'; ``` Memasukkan data yang sama di EMR 6.x dan EMR 5.x. ``` INSERT INTO test_bucketing PARTITION (day='01') VALUES(66, 'some_data'); INSERT INTO test_bucketing PARTITION (day='01') VALUES(200, 'some_data'); ``` Memeriksa lokasi S3, menunjukkan nama file pem-bucket-an yang berbeda, karena fungsi hashing yang berbeda antara EMR 6.x (Hive 3) dan EMR 5.x (Hive 2). ``` [hadoop@ip-10-0-0-122 ~]$ aws s3 ls s3://your-own-s3-bucket/emr-6-bucketing/day=01/ 2020-10-21 20:35:16 13 000025_0 2020-10-21 20:35:22 14 000121_0 [hadoop@ip-10-0-0-122 ~]$ aws s3 ls s3://your-own-s3-bucket/emr-5-bucketing/day=01/ 2020-10-21 20:32:07 13 000066_0 2020-10-21 20:32:51 14 000072_0 ``` Anda juga dapat melihat perbedaan versi dengan menjalankan perintah berikut di Hive CLI di EMR 6.x. Perhatikan bahwa ia menghasilkan pem-bucket-an versi 2. ``` hive> DESCRIBE FORMATTED test_bucketing; ... Table Parameters: bucketing_version 2 ... ``` + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, setel `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## versi komponen 6.2.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.0.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.16.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.0.0 | EMR S3Select Connector | | emrfs | 2.44.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.11.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.11.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-2 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.2.6-amzn-0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.2.6-amzn-0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.2.6-amzn-0 | HBase klien baris perintah. | | hbase-rest-server | 2.2.6-amzn-0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.2.6-amzn-0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | Versi 3.1.2 amzn-3 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | Versi 3.1.2 amzn-3 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | Versi 3.1.2 amzn-3 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | Versi 3.1.2 amzn-3 | Klien baris perintah Hive. | | hive-hbase | Versi 3.1.2 amzn-3 | Klien Hive-hbase. | | hive-metastore-server | Versi 3.1.2 amzn-3 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | Versi 3.1.2 amzn-3 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.6.0-amzn-1 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.6.0-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-prestosql | 0.6.0-amzn-1 | Perpustakaan paket untuk menjalankan PrestoSQL dengan Hudi. | | hudi-spark | 0.6.0-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.8.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.7.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64\$1 | Server basis data MariaDB. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.0.0- -2.0 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.0.0- -2.0 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.238.3-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.238.3-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.238.3-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | prestosql-coordinator | 343 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara prestosql-woorker. | | prestosql-worker | 343 | Layanan untuk mengeksekusi potongan kueri. | | prestosql-client | 343 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.0.1-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.0.1-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.0.1-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.0.1-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | spark-rapids | 0.2.0 | Plugin Nvidia Spark RAPIDS yang mempercepat Apache Spark dengan. GPUs | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.3.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0-preview1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## klasifikasi konfigurasi 6.2.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **Klasifikasi emr-6.2.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Not available. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Not available. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Not available. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services SecondaryNamenode, Datanode, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | This classification should not be reconfigured. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | Restarts Hadoop HDFS ZKFC. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat server. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | Sets configurations to launch Hive LLAP service. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Not available. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2, HiveMetastore, and Hive HCatalog-Server. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoDB) | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server (for PrestoDB) | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | prestosql-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server (for PrestoSQL) | | prestosql-node | Ubah nilai dalam file node.properties PrestoSQL. | Not available. | | prestosql-connector-blackhole | Ubah nilai dalam file blackhole.properties PrestoSQL. | Not available. | | prestosql-connector-cassandra | Ubah nilai dalam file cassandra.properties PrestoSQL. | Not available. | | prestosql-connector-hive | Ubah nilai dalam file hive.properties PrestoSQL. | Restarts Presto-Server (for PrestoSQL) | | prestosql-connector-jmx | Ubah nilai dalam file jmx.properties PrestoSQL. | Not available. | | prestosql-connector-kafka | Ubah nilai dalam file kafka.properties PrestoSQL. | Not available. | | prestosql-connector-localfile | Ubah nilai dalam file localfile.properties PrestoSQL. | Not available. | | prestosql-connector-memory | Ubah nilai dalam file memory.properties PrestoSQL. | Not available. | | prestosql-connector-mongodb | Ubah nilai dalam file mongodb.properties PrestoSQL. | Not available. | | prestosql-connector-mysql | Ubah nilai dalam file mysql.properties PrestoSQL. | Not available. | | prestosql-connector-postgresql | Ubah nilai dalam file postgresql.properties PrestoSQL. | Not available. | | prestosql-connector-raptor | Ubah nilai dalam file raptor.properties PrestoSQL. | Not available. | | prestosql-connector-redis | Ubah nilai dalam file redis.properties PrestoSQL. | Not available. | | prestosql-connector-redshift | Ubah nilai dalam file redshift.properties PrestoSQL. | Not available. | | prestosql-connector-tpch | Ubah nilai dalam file tpch.properties PrestoSQL. | Not available. | | prestosql-connector-tpcds | Ubah nilai dalam file tpcds.properties PrestoSQL. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restart Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 6.1.1 ## 6.1.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://prestosql.io/](https://prestosql.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.1.1 | emr-6.1.0 | emr-6.0.1 | emr-6.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.828 | 1.11.828 | 1.11.711 | 1.11.711 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.0 | 1.11.0 | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.2.5 | 2.2.5 | 2.2.3 | 2.2.3 | | HCatalog | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hadoop | 3.2.1-amzn-1.1 | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0.1 | 3.2.1-amzn-0 | | Hive | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hudi | 0.5.2-incubating-amzn-2 | 0.5.2-incubating-amzn-2 | 0.5.0-incubating-amzn-1 | 0.5.0-incubating-amzn-1 | | Hue | 4.7.1 | 4.7.1 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.0.0 | 1.0.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.6.0 | 1.6.0 | 1.5.1 | 1.5.1 | | Mahout | - | - | - | - | | Oozie | 5.2.0 | 5.2.0 | 5.1.0 | 5.1.0 | | Phoenix | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | - | - | | Presto | 0,232 | 0,232 | 0,230 | 0,230 | | Spark | 3.0.0-amzn-0.1 | 3.0.0-amzn-0 | 2.4.4 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | - | - | | TensorFlow | 2.1.0 | 2.1.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 338 | 338 | - | - | | Zeppelin | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-SNAPSHOT | 0.9.0-SNAPSHOT | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## 6.1.1 catatan rilis Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [SPARK-29683](https://issues.apache.org/jira/browse/SPARK-29683). Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG 9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan autentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + HTTPS sekarang diaktifkan secara default untuk repositori Amazon Linux. Jika Anda menggunakan kebijakan Amazon S3 VPCE untuk membatasi akses ke bucket tertentu, Anda harus menambahkan ARN bucket Amazon Linux baru `arn:aws:s3:::amazonlinux-2-repos-$region/*` ke kebijakan Anda (ganti `$region` dengan wilayah tempat titik akhir berada). Untuk informasi lebih lanjut, lihat topik ini di forum AWS diskusi. [Pengumuman: Amazon Linux 2 sekarang mendukung kemampuan untuk menggunakan HTTPS saat menghubungkan ke repositori paket](https://forums.aws.amazon.com/ann.jspa?annID=8528). ## 6.1.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.3.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.14.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.14.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.0.0 | EMR S3Select Connector | | emrfs | 2.42.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.11.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-1.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-1.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-1.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-1.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-1.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-1.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-1.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-1.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-1.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-1.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-1.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.2.5 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.2.5 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.2.5 | HBase klien baris perintah. | | hbase-rest-server | 2.2.5 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.2.5 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | Versi 3.1.2-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | Versi 3.1.2-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | Versi 3.1.2-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | Versi 3.1.2-amzn-2 | Klien baris perintah Hive. | | hive-hbase | Versi 3.1.2-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | Versi 3.1.2-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | Versi 3.1.2-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.2-incubating-amzn-2 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.2-incubating-amzn-2 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-prestosql | 0.5.2-incubating-amzn-2 | Perpustakaan paket untuk menjalankan PrestoSQL dengan Hudi. | | hudi-spark | 0.5.2-incubating-amzn-2 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.7.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.6.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64\$1 | Server basis data MariaDB. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.3.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.0.0- -2.0 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.0.0- -2.0 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,232 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,232 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,232 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | prestosql-coordinator | 338 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara prestosql-woorker. | | prestosql-worker | 338 | Layanan untuk mengeksekusi potongan kueri. | | prestosql-client | 338 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.0.0-amzn-0.1 | Klien baris perintah Spark. | | spark-history-server | 3.0.0-amzn-0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.0.0-amzn-0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.0.0-amzn-0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.1.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0-preview1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 6.1.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-6.1.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | hudi-env | Ubah nilai di lingkungan Hudi. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | prestosql-log | Ubah nilai dalam file log.properties Presto. | | prestosql-config | Ubah nilai dalam file config.properties Presto. | | prestosql-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | prestosql-env | Ubah nilai dalam file presto-env.sh Presto. | | prestosql-node | Ubah nilai dalam file node.properties PrestoSQL. | | prestosql-connector-blackhole | Ubah nilai dalam file blackhole.properties PrestoSQL. | | prestosql-connector-cassandra | Ubah nilai dalam file cassandra.properties PrestoSQL. | | prestosql-connector-hive | Ubah nilai dalam file hive.properties PrestoSQL. | | prestosql-connector-jmx | Ubah nilai dalam file jmx.properties PrestoSQL. | | prestosql-connector-kafka | Ubah nilai dalam file kafka.properties PrestoSQL. | | prestosql-connector-localfile | Ubah nilai dalam file localfile.properties PrestoSQL. | | prestosql-connector-memory | Ubah nilai dalam file memory.properties PrestoSQL. | | prestosql-connector-mongodb | Ubah nilai dalam file mongodb.properties PrestoSQL. | | prestosql-connector-mysql | Ubah nilai dalam file mysql.properties PrestoSQL. | | prestosql-connector-postgresql | Ubah nilai dalam file postgresql.properties PrestoSQL. | | prestosql-connector-raptor | Ubah nilai dalam file raptor.properties PrestoSQL. | | prestosql-connector-redis | Ubah nilai dalam file redis.properties PrestoSQL. | | prestosql-connector-redshift | Ubah nilai dalam file redshift.properties PrestoSQL. | | prestosql-connector-tpch | Ubah nilai dalam file tpch.properties PrestoSQL. | | prestosql-connector-tpcds | Ubah nilai dalam file tpcds.properties PrestoSQL. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 6.1.0 ## versi aplikasi 6.1.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://prestosql.io/](https://prestosql.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.1.1 | emr-6.1.0 | emr-6.0.1 | emr-6.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.828 | 1.11.828 | 1.11.711 | 1.11.711 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.0 | 1.11.0 | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.2.5 | 2.2.5 | 2.2.3 | 2.2.3 | | HCatalog | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hadoop | 3.2.1-amzn-1.1 | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0.1 | 3.2.1-amzn-0 | | Hive | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hudi | 0.5.2-incubating-amzn-2 | 0.5.2-incubating-amzn-2 | 0.5.0-incubating-amzn-1 | 0.5.0-incubating-amzn-1 | | Hue | 4.7.1 | 4.7.1 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.0.0 | 1.0.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.6.0 | 1.6.0 | 1.5.1 | 1.5.1 | | Mahout | - | - | - | - | | Oozie | 5.2.0 | 5.2.0 | 5.1.0 | 5.1.0 | | Phoenix | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | - | - | | Presto | 0,232 | 0,232 | 0,230 | 0,230 | | Spark | 3.0.0-amzn-0.1 | 3.0.0-amzn-0 | 2.4.4 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | - | - | | TensorFlow | 2.1.0 | 2.1.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 338 | 338 | - | - | | Zeppelin | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-SNAPSHOT | 0.9.0-SNAPSHOT | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## catatan rilis 6.1.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 6.1.0. Perubahan bersifat relatif terhadap versi 6.0.0. Tanggal rilis awal: 04 September 2020 Tanggal terakhir diperbarui: 15 Oktober 2020 **Aplikasi-aplikasi yang didukung** + AWS SDK untuk Java versi 1.11.828 + Flink versi 1.11.0 + Ganglia versi 3.7.2 + Hadoop versi 3.2.1-amzn-1 + HBase versi 2.2.5 + HBase-operator-tools 1.0.0 + HCatalog versi 3.1.2-amzn-0 + Hive versi 3.1.2-amzn-1 + Hudi versi 0.5.2-incubating + Hue versi 4.7.1 + JupyterHub versi 1.1.0 + Livy versi 0.7.0 + MXNet versi 1.6.0 + Oozie versi 5.2.0 + Phoenix versi 5.0.0 + Presto versi 0.232 + PrestoSQL versi 338 + Spark versi 3.0.0-amzn-0 + TensorFlow versi 2.1.0 + Zeppelin versi 0.9.0-preview1 + Zookeeper versi 3.4.14 + Konektor dan driver: DynamoDB Connector 4.14.0 **Fitur baru** + Tipe instans ARM didukung mulai dari Amazon EMR versi 5.30.0 dan Amazon EMR versi 6.1.0. + Tipe instans tujuan umum M6g didukung mulai dengan Amazon EMR versi 6.1.0 dan 5.30.0. Untuk informasi selengkapnya, lihat [Tipe instans yang didukung](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-supported-instance-types.html) di *Panduan Pengelolaan Amazon EMR*. + Fitur grup penempatan EC2 didukung dimulai dengan Amazon EMR versi 5.23.0 sebagai opsi untuk beberapa kluster simpul utama. Saat ini, hanya tipe node primer yang didukung oleh fitur grup penempatan, dan `SPREAD` strategi diterapkan pada node utama tersebut. `SPREAD`Strategi ini menempatkan sekelompok kecil instance di perangkat keras dasar yang terpisah untuk mencegah hilangnya beberapa node primer jika terjadi kegagalan perangkat keras. Untuk informasi selengkapnya, lihat [Integrasi EMR dengan Grup Penempatan EC2](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-ha-placementgroup.html) di *Panduan Pengelolaan Amazon EMR*. + Penskalaan Terkelola - Dengan Amazon EMR versi 6.1.0, Anda dapat mengaktifkan penskalaan terkelola Amazon EMR untuk secara otomatis menambah atau mengurangi jumlah instans atau unit di klaster berdasarkan beban kerja. Amazon EMR terus mengevaluasi metrik klaster untuk membuat keputusan penskalaan yang mengoptimalkan kluster Anda untuk biaya dan kecepatan. Penskalaan Terkelola juga tersedia di Amazon EMR versi 5.30.0 dan setelahnya, kecuali versi 6.0.0. Untuk informasi selengkapnya, lihat [Penskalaan Sumber Daya Klaster](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-scale-on-demand.html) di *Panduan Pengelolaan Amazon EMR*. + PrestoSQL versi 338 didukung dengan EMR 6.1.0. Untuk informasi selengkapnya, lihat [Presto](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-presto.html). + PrestoSQL didukung pada EMR 6.1.0 dan hanya versi setelahnya, namun tidak pada EMR 6.0.0 atau EMR 5.x. + Nama aplikasi, `Presto` terus-menerus digunakan untuk menginstal PrestoDB pada klaster. Untuk menginstal PrestoSQL pada klaster, gunakan nama aplikasi `PrestoSQL`. + Anda dapat menginstal PrestoDB atau PrestoSQL, tetapi Anda tidak dapat menginstal keduanya pada satu klaster. Jika PrestoDB dan PrestoSQL keduanya ditentukan ketika mencoba untuk membuat sebuah klaster, maka akan terjadi kesalahan validasi dan permintaan pembuatan klaster gagal. + PrestoSQL didukung pada klaster single-master dan muti-master. Pada klaster multi-master, metastore Hive eksternal diperlukan untuk menjalankan PrestoSQL atau PrestoDB. Lihat [Aplikasi yang didukung dalam klaster EMR dengan beberapa node primer](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-ha-applications.html#emr-plan-ha-applications-list). + Support autentikasi otomatis ECR pada Apache Hadoop dan Apache Spark dengan Docker: pengguna Spark dapat menggunakan gambar Docker Hub dan Amazon Elastic Container Registry (Amazon ECR) untuk menentukan lingkungan dan dependensi perpustakaan. [Konfigurasi Docker](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-docker.html) dan [Jalankan Aplikasi Spark dengan Docker Menggunakan Amazon EMR 6.x](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-docker.html). + EMR mendukung transaksi Apache Hive ACID: Amazon EMR 6.1.0 menambahkan support untuk transaksi ACID Hive sehingga sesuai dengan properti basis data ACID. Dengan fitur ini, Anda dapat menjalankan `INSERT, UPDATE, DELETE,` dan `MERGE` mengoperasikannya di tabel terkelola Hive dengan data di Amazon Simple Storage Service (Amazon S3). Ini adalah fitur kunci untuk kasus penggunaan seperti menyerap streaming, pernyataan ulang data, update massal menggunakan MERGE, dan mengubah dimensi secara perlahan. Untuk informasi lebih lanjut, termasuk contoh konfigurasi dan kasus penggunaan, lihat [Amazon EMR mendukung transaksi Apache Hive ACID](https://aws.amazon.com/blogs/big-data/amazon-emr-supports-apache-hive-acid-transactions). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [SPARK-29683](https://issues.apache.org/jira/browse/SPARK-29683). Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG 9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan autentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + Apache Flink tidak didukung pada EMR 6.0.0, tetapi didukung pada EMR 6.1.0 dengan Flink 1.11.0. Ini adalah versi pertama Flink yang secara resmi mendukung Hadoop 3. Lihat [Pengumuman Rilis Apache Flink 1.11.0](https://flink.apache.org/news/2020/07/06/release-1.11.0.html). + Ganglia telah dihapus dari bundel paket default EMR 6.1.0. **Masalah yang diketahui** + **Turunkan batas “Maks open files” pada yang lebih lama AL2 [diperbaiki dalam rilis yang lebih baru].** Rilis Amazon EMR: emr-5.30.x, emr-5.31.0, emr-5.32.0, emr-6.0.0, emr-6.1.0, dan emr-6.2.0 didasarkan pada versi lama dari Amazon Linux 2 (), yang memiliki pengaturan ulimit yang lebih rendah untuk “File terbuka maksimum” ketika kluster Amazon EMR dibuat dengan AMI default. AL2 Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. Rilis dengan batas file terbuka yang lebih rendah menyebabkan kesalahan “Terlalu banyak file terbuka” saat mengirimkan pekerjaan Spark. Dalam rilis yang terkena dampak, AMI default Amazon EMR memiliki pengaturan ulimit default 4096 untuk “File terbuka maksimum,” yang lebih rendah dari batas file 65536 di AMI Amazon Linux 2 terbaruAmazon. Pengaturan ulimit yang lebih rendah untuk "Maksimal file terbuka" menyebabkan kegagalan tugas Spark ketika driver dan pelaksana mencoba untuk membuka lebih dari 4096 file. Untuk memperbaiki masalah, Amazon EMR memiliki skrip tindakan bootstrap (BA) yang menyesuaikan pengaturan ulimit saat pembuatan klaster. Jika Anda menggunakan versi EMR Amazon yang lebih lama yang tidak memiliki perbaikan permanen untuk masalah ini, solusi berikut memungkinkan Anda untuk secara eksplisit mengatur ulimit pengontrol instans ke maksimum 65536 file. **Mengatur secara eksplisit ulimit dari baris perintah** 1. Edit `/etc/systemd/system/instance-controller.service` untuk menambahkan parameter berikut ke bagian Layanan. `LimitNOFILE=65536` `LimitNPROC=65536` 1. Mulai ulang InstanceController `$ sudo systemctl daemon-reload` `$ sudo systemctl restart instance-controller` **Tetapkan ulimit menggunakan tindakan bootstrap (BA)** Anda juga dapat menggunakan skrip tindakan bootstrap (BA) untuk mengkonfigurasi ulimit instans-pengendali menjadi 65536 file saat pembuatan klaster. ``` #!/bin/bash for user in hadoop spark hive; do sudo tee /etc/security/limits.d/$user.conf << EOF $user - nofile 65536 $user - nproc 65536 EOF done for proc in instancecontroller logpusher; do sudo mkdir -p /etc/systemd/system/$proc.service.d/ sudo tee /etc/systemd/system/$proc.service.d/override.conf << EOF [Service] LimitNOFILE=65536 LimitNPROC=65536 EOF pid=$(pgrep -f aws157.$proc.Main) sudo prlimit --pid $pid --nofile=65535:65535 --nproc=65535:65535 done sudo systemctl daemon-reload ``` + **penting** Amazon EMR 6.1.0 dan 6.2.0 mempunyai masalah performa yang secara kritis dapat mempengaruhi semua operasi insert, upsert, dan delete Hudi. Jika Anda berencana untuk menggunakan Hudi dengan Amazon EMR 6.1.0 atau 6.2.0, Anda harus AWS menghubungi dukungan untuk mendapatkan RPM Hudi yang ditambal. + Jika Anda mengatur konfigurasi pengumpulan sampah khusus dengan `spark.driver.extraJavaOptions` dan`spark.executor.extraJavaOptions`, ini akan mengakibatkan kegagalan driver/executor peluncuran dengan EMR 6.1 karena konfigurasi pengumpulan sampah yang bertentangan. Dengan EMR Rilis 6.1.0, Anda harus menentukan konfigurasi pengumpulan sampah Spark kustom untuk driver dan pelaksana dengan properti `spark.driver.defaultJavaOptions` dan `spark.executor.defaultJavaOptions` sebagai gantinya. Baca selengkapnya di [Lingkungan Waktu Aktif Apache Spark](https://spark.apache.org/docs/latest/configuration.html#runtime-environment) dan [Mengkonfigurasi Pengumpulan Sampah Spark di Amazon EMR 6.1.0](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-configure.html#spark-gc-config). + Menggunakan Pig dengan Oozie (dan dalam Hue, karena Hue menggunakan tindakan Oozie untuk menjalankan skrip Pig), akan menghasilkan kesalahan di mana perpustakaan native-lzo tidak dapat dimuat. Pesan kesalahan ini adalah informasi dan tidak memblokir Pig sehingga tidak berjalan. + Hudi Concurrency Support: Saat ini Hudi tidak mendukung tulis bersamaan ke tabel Hudi tunggal. Selain itu, Hudi membatalkan setiap perubahan yang dilakukan oleh penulis yang sedang berlangsung sebelum mengizinkan penulis baru untuk memulai. Tulis bersamaan dapat mengganggu mekanisme ini dan memperkenalkan kondisi ras, yang dapat menyebabkan korupsi data. Anda harus memastikan bahwa sebagai bagian dari alur kerja pengolahan data Anda, hanya ada satu penulis Hudi yang beroperasi terhadap tabel Hudi setiap saat. Hudi tidak mendukung beberapa pembaca bersamaan yang beroperasi terhadap tabel Hudi yang sama. + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. + Ada masalah di Amazon EMR 6.1.0 yang mempengaruhi klaster yang menjalankan Presto. Setelah perpanjangan jangka waktu (hari), klaster mungkin membuang kesalahan seperti, "su: gagal untuk mengeksekusi/bin/bash: sumber daya sementara tidak tersedia" atau "permintaan shell gagal pada saluran 0". Masalah ini disebabkan oleh proses EMR Amazon internal (InstanceController) yang menghasilkan terlalu banyak Proses Berat Ringan (LWP), yang akhirnya menyebabkan pengguna Hadoop melebihi batas nproc mereka. Hal ini mencegah pengguna dari membuka proses tambahan. Solusi untuk masalah ini adalah dengan meng-upgrade ke EMR 6.2.0. ## versi komponen 6.1.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.3.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.14.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.14.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 2.0.0 | EMR S3Select Connector | | emrfs | 2.42.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.11.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | Versi 3.2.1-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | Versi 3.2.1-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | Versi 3.2.1-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | Versi 3.2.1-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | Versi 3.2.1-amzn-1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | Versi 3.2.1-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | Versi 3.2.1-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | Versi 3.2.1-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | Versi 3.2.1-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | Versi 3.2.1-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | Versi 3.2.1-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.2.5 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.2.5 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.2.5 | HBase klien baris perintah. | | hbase-rest-server | 2.2.5 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.2.5 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | Versi 3.1.2-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | Versi 3.1.2-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | Versi 3.1.2-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | Versi 3.1.2-amzn-2 | Klien baris perintah Hive. | | hive-hbase | Versi 3.1.2-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | Versi 3.1.2-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | Versi 3.1.2-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.2-incubating-amzn-2 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.2-incubating-amzn-2 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hudi-prestosql | 0.5.2-incubating-amzn-2 | Perpustakaan paket untuk menjalankan PrestoSQL dengan Hudi. | | hudi-spark | 0.5.2-incubating-amzn-2 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hue-server | 4.7.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.6.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64\$1 | Server basis data MariaDB. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.3.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.0.0- -2.0 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.0.0- -2.0 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,232 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,232 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,232 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | prestosql-coordinator | 338 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara prestosql-woorker. | | prestosql-worker | 338 | Layanan untuk mengeksekusi potongan kueri. | | prestosql-client | 338 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 2.0.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 3.0.0-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 3.0.0-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 3.0.0-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 3.0.0-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.1.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0-preview1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## klasifikasi konfigurasi 6.1.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-6.1.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | hudi-env | Ubah nilai di lingkungan Hudi. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | prestosql-log | Ubah nilai dalam file log.properties Presto. | | prestosql-config | Ubah nilai dalam file config.properties Presto. | | prestosql-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | prestosql-env | Ubah nilai dalam file presto-env.sh Presto. | | prestosql-node | Ubah nilai dalam file node.properties PrestoSQL. | | prestosql-connector-blackhole | Ubah nilai dalam file blackhole.properties PrestoSQL. | | prestosql-connector-cassandra | Ubah nilai dalam file cassandra.properties PrestoSQL. | | prestosql-connector-hive | Ubah nilai dalam file hive.properties PrestoSQL. | | prestosql-connector-jmx | Ubah nilai dalam file jmx.properties PrestoSQL. | | prestosql-connector-kafka | Ubah nilai dalam file kafka.properties PrestoSQL. | | prestosql-connector-localfile | Ubah nilai dalam file localfile.properties PrestoSQL. | | prestosql-connector-memory | Ubah nilai dalam file memory.properties PrestoSQL. | | prestosql-connector-mongodb | Ubah nilai dalam file mongodb.properties PrestoSQL. | | prestosql-connector-mysql | Ubah nilai dalam file mysql.properties PrestoSQL. | | prestosql-connector-postgresql | Ubah nilai dalam file postgresql.properties PrestoSQL. | | prestosql-connector-raptor | Ubah nilai dalam file raptor.properties PrestoSQL. | | prestosql-connector-redis | Ubah nilai dalam file redis.properties PrestoSQL. | | prestosql-connector-redshift | Ubah nilai dalam file redshift.properties PrestoSQL. | | prestosql-connector-tpch | Ubah nilai dalam file tpch.properties PrestoSQL. | | prestosql-connector-tpcds | Ubah nilai dalam file tpcds.properties PrestoSQL. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 6.0.1 ## 6.0.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org),, [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.1.1 | emr-6.1.0 | emr-6.0.1 | emr-6.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.828 | 1.11.828 | 1.11.711 | 1.11.711 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.0 | 1.11.0 | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.2.5 | 2.2.5 | 2.2.3 | 2.2.3 | | HCatalog | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hadoop | 3.2.1-amzn-1.1 | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0.1 | 3.2.1-amzn-0 | | Hive | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hudi | 0.5.2-incubating-amzn-2 | 0.5.2-incubating-amzn-2 | 0.5.0-incubating-amzn-1 | 0.5.0-incubating-amzn-1 | | Hue | 4.7.1 | 4.7.1 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.0.0 | 1.0.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.6.0 | 1.6.0 | 1.5.1 | 1.5.1 | | Mahout | - | - | - | - | | Oozie | 5.2.0 | 5.2.0 | 5.1.0 | 5.1.0 | | Phoenix | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | - | - | | Presto | 0,232 | 0,232 | 0,230 | 0,230 | | Spark | 3.0.0-amzn-0.1 | 3.0.0-amzn-0 | 2.4.4 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | - | - | | TensorFlow | 2.1.0 | 2.1.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 338 | 338 | - | - | | Zeppelin | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-SNAPSHOT | 0.9.0-SNAPSHOT | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## 6.0.1 catatan rilis Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [SPARK-29683](https://issues.apache.org/jira/browse/SPARK-29683). Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG 9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan autentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + HTTPS sekarang diaktifkan secara default untuk repositori Amazon Linux. Jika Anda menggunakan kebijakan Amazon S3 VPCE untuk membatasi akses ke bucket tertentu, Anda harus menambahkan ARN bucket Amazon Linux baru `arn:aws:s3:::amazonlinux-2-repos-$region/*` ke kebijakan Anda (ganti `$region` dengan wilayah tempat titik akhir berada). Untuk informasi lebih lanjut, lihat topik ini di forum AWS diskusi. [Pengumuman: Amazon Linux 2 sekarang mendukung kemampuan untuk menggunakan HTTPS saat menghubungkan ke repositori paket](https://forums.aws.amazon.com/ann.jspa?annID=8528). ## 6.0.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.6 | Amazon SageMaker Spark SDK | | emr-ddb | 4.14.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.14.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.5.0 | EMR S3Select Connector | | emrfs | 2.39.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-0.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-0.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-0.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-0.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-0.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-0.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-0.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-0.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-0.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-0.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-0.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.2.3 | HBase klien baris perintah. | | hbase-rest-server | 2.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 3.1.2-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.2-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.2-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.2-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 3.1.2-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 3.1.2-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.2-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.0-incubating-amzn-1 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.0-incubating-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.0.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.5.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64\$1 | Server basis data MariaDB. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.0.0- -2.0 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.0.0- -2.0 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,230 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,230 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,230 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.4 | Klien baris perintah Spark. | | spark-history-server | 2.4.4 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.4 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.4 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0-SNAPSHOT | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 6.0.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-6.0.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 6.0.0 ## versi aplikasi 6.0.0 Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org),, [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-6.1.1 | emr-6.1.0 | emr-6.0.1 | emr-6.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.828 | 1.11.828 | 1.11.711 | 1.11.711 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.12.10 | 2.12.10 | 2.12.10 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.0 | 1.11.0 | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 2.2.5 | 2.2.5 | 2.2.3 | 2.2.3 | | HCatalog | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hadoop | 3.2.1-amzn-1.1 | Versi 3.2.1-amzn-1 | 3.2.1-amzn-0.1 | 3.2.1-amzn-0 | | Hive | Versi 3.1.2-amzn-2 | Versi 3.1.2-amzn-2 | 3.1.2-amzn-0 | 3.1.2-amzn-0 | | Hudi | 0.5.2-incubating-amzn-2 | 0.5.2-incubating-amzn-2 | 0.5.0-incubating-amzn-1 | 0.5.0-incubating-amzn-1 | | Hue | 4.7.1 | 4.7.1 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.0.0 | 1.0.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.6.0 | 1.6.0 | 1.5.1 | 1.5.1 | | Mahout | - | - | - | - | | Oozie | 5.2.0 | 5.2.0 | 5.1.0 | 5.1.0 | | Phoenix | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | 5.0.0- -2.0 HBase | | Pig | 0.17.0 | 0.17.0 | - | - | | Presto | 0,232 | 0,232 | 0,230 | 0,230 | | Spark | 3.0.0-amzn-0.1 | 3.0.0-amzn-0 | 2.4.4 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | - | - | | TensorFlow | 2.1.0 | 2.1.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | 338 | 338 | - | - | | Zeppelin | 0.9.0-preview1 | 0.9.0-preview1 | 0.9.0-SNAPSHOT | 0.9.0-SNAPSHOT | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## catatan rilis 6.0.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 6.0.0. Tanggal rilis awal: 10 Maret 2020 **Aplikasi-aplikasi yang didukung** + AWS SDK untuk Java versi 1.11.711 + Ganglia versi 3.7.2 + Hadoop versi 3.2.1 + HBase versi 2.2.3 + HCatalog versi 3.1.2 + Hive versi 3.1.2 + Hudi versi 0.5.0-incubating + Hue versi 4.4.0 + JupyterHub versi 1.0.0 + Livy versi 0.6.0 + MXNet versi 1.5.1 + Oozie versi 5.1.0 + Phoenix versi 5.0.0 + Presto versi 0.230 + Spark versi 2.4.4 + TensorFlow versi 1.14.0 + Zeppelin versi 0.9.0-SNAPSHOT + Zookeeper versi 3.4.14 + Konektor dan driver: DynamoDB Connector 4.14.0 **catatan** Flink, Sqoop, Babi, dan Mahout tidak tersedia di Amazon EMR versi 6.0.0. **Fitur baru** + YARN Docker Runtime Support - aplikasi YARN, seperti tugas Spark, sekarang dapat berjalan dalam konteks kontainer Docker. Hal ini memungkinkan Anda untuk dengan mudah menentukan dependensi dalam gambar Docker tanpa perlu menginstal perpustakaan kustom di klaster Amazon EMR Anda. Untuk informasi selengkapnya, lihat [Konfigurasi integrasi Docker](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-docker.html) dan [Jalankan aplikasi Spark dengan Docker menggunakan Amazon EMR 6.0.0](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-docker.html). + Hive LLAP Support - Hive sekarang mendukung modus eksekusi LLAP untuk meningkatkan performa kueri. Untuk informasi selengkapnya, lihat [Menggunakan Hive LLAP](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hive-llap.html). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [SPARK-29683](https://issues.apache.org/jira/browse/SPARK-29683). Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG 9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan autentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + Amazon Linux + Amazon Linux 2 adalah sistem operasi untuk seri rilis EMR 6.x. + `systemd` digunakan untuk pengelolaan layanan bukan `upstart` yang digunakan dalam Amazon Linux 1. + Java Development Kit (JDK) + Corretto JDK 8 adalah JDK default untuk seri rilis EMR 6.x. + Scala + Scala 2.12 digunakan dengan Apache Spark dan Apache Livy. + Python 3 + Python 3 sekarang adalah versi default Python di EMR. + Label simpul YARN + Dimulai dengan Amazon EMR seri rilis 6.x, fitur label simpul YARN dinonaktifkan secara default. Proses utama aplikasi dapat berjalan pada kedua inti dan tugas simpul secara default. Anda dapat mengaktifkan fitur label simpul YARN dengan mengkonfigurasi properti berikut: `yarn.node-labels.enabled` dan `yarn.node-labels.am.default-node-label-expression`. Untuk informasi selengkapnya, lihat [Memahami Node Primer, Inti, dan Tugas](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-master-core-task-nodes.html). **Masalah yang diketahui** + **Turunkan batas “Maks open files” pada yang lebih lama AL2 [diperbaiki dalam rilis yang lebih baru].** Rilis Amazon EMR: emr-5.30.x, emr-5.31.0, emr-5.32.0, emr-6.0.0, emr-6.1.0, dan emr-6.2.0 didasarkan pada versi lama dari Amazon Linux 2 (), yang memiliki pengaturan ulimit yang lebih rendah untuk “File terbuka maksimum” ketika kluster Amazon EMR dibuat dengan AMI default. AL2 Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. Rilis dengan batas file terbuka yang lebih rendah menyebabkan kesalahan “Terlalu banyak file terbuka” saat mengirimkan pekerjaan Spark. Dalam rilis yang terkena dampak, AMI default Amazon EMR memiliki pengaturan ulimit default 4096 untuk “File terbuka maksimum,” yang lebih rendah dari batas file 65536 di AMI Amazon Linux 2 terbaruAmazon. Pengaturan ulimit yang lebih rendah untuk "Maksimal file terbuka" menyebabkan kegagalan tugas Spark ketika driver dan pelaksana mencoba untuk membuka lebih dari 4096 file. Untuk memperbaiki masalah, Amazon EMR memiliki skrip tindakan bootstrap (BA) yang menyesuaikan pengaturan ulimit saat pembuatan klaster. Jika Anda menggunakan versi EMR Amazon yang lebih lama yang tidak memiliki perbaikan permanen untuk masalah ini, solusi berikut memungkinkan Anda untuk secara eksplisit mengatur ulimit pengontrol instans ke maksimum 65536 file. **Mengatur secara eksplisit ulimit dari baris perintah** 1. Edit `/etc/systemd/system/instance-controller.service` untuk menambahkan parameter berikut ke bagian Layanan. `LimitNOFILE=65536` `LimitNPROC=65536` 1. Mulai ulang InstanceController `$ sudo systemctl daemon-reload` `$ sudo systemctl restart instance-controller` **Tetapkan ulimit menggunakan tindakan bootstrap (BA)** Anda juga dapat menggunakan skrip tindakan bootstrap (BA) untuk mengkonfigurasi ulimit instans-pengendali menjadi 65536 file saat pembuatan klaster. ``` #!/bin/bash for user in hadoop spark hive; do sudo tee /etc/security/limits.d/$user.conf << EOF $user - nofile 65536 $user - nproc 65536 EOF done for proc in instancecontroller logpusher; do sudo mkdir -p /etc/systemd/system/$proc.service.d/ sudo tee /etc/systemd/system/$proc.service.d/override.conf << EOF [Service] LimitNOFILE=65536 LimitNPROC=65536 EOF pid=$(pgrep -f aws157.$proc.Main) sudo prlimit --pid $pid --nofile=65535:65535 --nproc=65535:65535 done sudo systemctl daemon-reload ``` + Spark interaktif shell, termasuk PySpark, SparkR, dan spark-shell, tidak mendukung penggunaan Docker dengan pustaka tambahan. + Untuk menggunakan Python 3 dengan Amazon EMR versi 6.0.0, Anda harus menambahkan `PATH` ke `yarn.nodemanager.env-whitelist`. + Fungsionalitas Live Long and Process (LLAP) tidak didukung saat Anda menggunakan Katalog Data AWS Glue sebagai metastore untuk Hive. + Bila menggunakan Amazon EMR 6.0.0 dengan integrasi Spark dan Docker, Anda harus mengkonfigurasi instans di klaster Anda dengan tipe instans yang sama dan jumlah volume EBS yang sama untuk menghindari gagal ketika mengirimkan tugas Spark dengan waktu aktif Docker. + [Di Amazon EMR 6.0.0, pada mode penyimpanan Amazon HBase S3 dipengaruhi oleh masalah HBASE-24286.](https://issues.apache.org/jira/browse/HBASE-24286) HBase master tidak dapat menginisialisasi saat cluster dibuat menggunakan data S3 yang ada. + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## versi komponen 6.0.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.6 | Amazon SageMaker Spark SDK | | emr-ddb | 4.14.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 3.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.14.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.5.0 | EMR S3Select Connector | | emrfs | 2.39.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 3.2.1-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 3.2.1-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 3.2.1-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 3.2.1-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 3.2.1-amzn-0 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 3.2.1-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 3.2.1-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 3.2.1-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 3.2.1-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 3.2.1-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 3.2.1-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 2.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 2.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 2.2.3 | HBase klien baris perintah. | | hbase-rest-server | 2.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 2.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 3.1.2-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 3.1.2-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 3.1.2-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 3.1.2-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 3.1.2-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 3.1.2-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 3.1.2-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.0-incubating-amzn-1 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.0-incubating-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.0.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mxnet | 1.5.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64\$1 | Server basis data MariaDB. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 5.0.0- -2.0 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 5.0.0- -2.0 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,230 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,230 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,230 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.4 | Klien baris perintah Spark. | | spark-history-server | 2.4.4 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.4 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.4 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.41\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0-SNAPSHOT | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## klasifikasi konfigurasi 6.0.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-6.0.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-env | Ubah nilai dalam lingkungan HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive | Pengaturan dikurasi Amazon EMR untuk Apache Hive. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR versi rilis 5.x Bagian ini berisi versi aplikasi, catatan rilis, versi komponen, dan klasifikasi konfigurasi yang tersedia di setiap versi rilis Amazon EMR 5.x. Saat meluncurkan klaster, Anda dapat memilih dari beberapa rilis Amazon EMR. Ini memungkinkan Anda untuk menguji dan menggunakan versi aplikasi yang sesuai dengan kebutuhan kompatibilitas Anda. Anda menentukan nomor rilis dengan *label rilis*. Label rilis ada dalam bentuk`emr-x.x.x`. Misalnya, `emr-7.12.0`. Rilis EMR Amazon baru tersedia di berbagai Wilayah selama beberapa hari, dimulai dengan Wilayah pertama pada tanggal rilis awal. Versi rilis terbaru mungkin tidak tersedia di Wilayah Anda selama periode ini. Untuk tabel lengkap versi aplikasi di setiap rilis Amazon EMR 5.x, lihat. [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) **Topics** + [ # Versi aplikasi di Amazon EMR 5.x rilis ](emr-release-app-versions-5.x.md) + [ # Amazon EMR rilis 5.36.2 ](emr-5362-release.md) + [ # Amazon EMR rilis 5.36.1 ](emr-5361-release.md) + [ # Amazon EMR rilis 5.36.0 ](emr-5360-release.md) + [ # Amazon EMR rilis 5.35.0 ](emr-5350-release.md) + [ # Amazon EMR rilis 5.34.0 ](emr-5340-release.md) + [ # Amazon EMR rilis 5.33.1 ](emr-5331-release.md) + [ # Amazon EMR rilis 5.33.0 ](emr-5330-release.md) + [ # Amazon EMR rilis 5.32.1 ](emr-5321-release.md) + [ # Amazon EMR rilis 5.32.0 ](emr-5320-release.md) + [ # Amazon EMR rilis 5.31.1 ](emr-5311-release.md) + [ # Amazon EMR rilis 5.31.0 ](emr-5310-release.md) + [ # Amazon EMR rilis 5.30.2 ](emr-5302-release.md) + [ # Amazon EMR rilis 5.30.1 ](emr-5301-release.md) + [ # Amazon EMR rilis 5.30.0 ](emr-5300-release.md) + [ # Amazon EMR rilis 5.29.0 ](emr-5290-release.md) + [ # Amazon EMR rilis 5.28.1 ](emr-5281-release.md) + [ # Amazon EMR Rilis 5.28.0 ](emr-5280-release.md) + [ # Amazon EMR rilis 5.27.1 ](emr-5271-release.md) + [ # Amazon EMR rilis 5.27.0 ](emr-5270-release.md) + [ # Amazon EMR rilis 5.26.0 ](emr-5260-release.md) + [ # Amazon EMR Rilis 5.25.0 ](emr-5250-release.md) + [ # Amazon EMR rilis 5.24.1 ](emr-5241-release.md) + [ # Amazon EMR Rilis 5.24.0 ](emr-5240-release.md) + [ # Amazon EMR rilis 5.23.1 ](emr-5231-release.md) + [ # Amazon EMR rilis 5.23.0 ](emr-5230-release.md) + [ # Amazon EMR rilis 5.22.0 ](emr-5220-release.md) + [ # Amazon EMR rilis 5.21.2 ](emr-5212-release.md) + [ # Amazon EMR rilis 5.21.1 ](emr-5211-release.md) + [ # Amazon EMR rilis 5.21.0 ](emr-5210-release.md) + [ # Amazon EMR rilis 5.20.1 ](emr-5201-release.md) + [ # Amazon EMR rilis 5.20.0 ](emr-5200-release.md) + [ # Amazon EMR rilis 5.19.1 ](emr-5191-release.md) + [ # Amazon EMR Rilis 5.19.0 ](emr-5190-release.md) + [ # Amazon EMR rilis 5.18.1 ](emr-5181-release.md) + [ # Amazon EMR rilis 5.18.0 ](emr-5180-release.md) + [ # Amazon EMR rilis 5.17.2 ](emr-5172-release.md) + [ # Amazon EMR rilis 5.17.1 ](emr-5171-release.md) + [ # Amazon EMR Rilis 5.17.0 ](emr-5170-release.md) + [ # Amazon EMR rilis 5.16.1 ](emr-5161-release.md) + [ # Amazon EMR Rilis 5.16.0 ](emr-5160-release.md) + [ # Amazon EMR rilis 5.15.1 ](emr-5151-release.md) + [ # Amazon EMR Rilis 5.15.0 ](emr-5150-release.md) + [ # Amazon EMR rilis 5.14.2 ](emr-5142-release.md) + [ # Amazon EMR rilis 5.14.1 ](emr-5141-release.md) + [ # Amazon EMR Rilis 5.14.0 ](emr-5140-release.md) + [ # Amazon EMR rilis 5.13.1 ](emr-5131-release.md) + [ # Amazon EMR rilis 5.13.0 ](emr-5130-release.md) + [ # Amazon EMR rilis 5.12.3 ](emr-5123-release.md) + [ # Amazon EMR rilis 5.12.2 ](emr-5122-release.md) + [ # Amazon EMR rilis 5.12.1 ](emr-5121-release.md) + [ # Amazon EMR Rilis 5.12.0 ](emr-5120-release.md) + [ # Amazon EMR rilis 5.11.4 ](emr-5114-release.md) + [ # Amazon EMR rilis 5.11.3 ](emr-5113-release.md) + [ # Amazon EMR rilis 5.11.2 ](emr-5112-release.md) + [ # Amazon EMR rilis 5.11.1 ](emr-5111-release.md) + [ # Amazon EMR rilis 5.11.0 ](emr-5110-release.md) + [ # Amazon EMR rilis 5.10.1 ](emr-5101-release.md) + [ # Amazon EMR rilis 5.10.0 ](emr-5100-release.md) + [ # Amazon EMR rilis 5.9.1 ](emr-591-release.md) + [ # Amazon EMR rilis 5.9.0 ](emr-590-release.md) + [ # Amazon EMR rilis 5.8.3 ](emr-583-release.md) + [ # Amazon EMR rilis 5.8.2 ](emr-582-release.md) + [ # Amazon EMR rilis 5.8.1 ](emr-581-release.md) + [ # Amazon EMR rilis 5.8.0 ](emr-580-release.md) + [ # Amazon EMR rilis 5.7.1 ](emr-571-release.md) + [ # Amazon EMR rilis 5.7.0 ](emr-570-release.md) + [ # Amazon EMR rilis 5.6.1 ](emr-561-release.md) + [ # Amazon EMR rilis 5.6.0 ](emr-560-release.md) + [ # Amazon EMR rilis 5.5.4 ](emr-554-release.md) + [ # Amazon EMR rilis 5.5.3 ](emr-553-release.md) + [ # Amazon EMR rilis 5.5.2 ](emr-552-release.md) + [ # Amazon EMR rilis 5.5.1 ](emr-551-release.md) + [ # Amazon EMR rilis 5.5.0 ](emr-550-release.md) + [ # Amazon EMR rilis 5.4.1 ](emr-541-release.md) + [ # Amazon EMR rilis 5.4.0 ](emr-540-release.md) + [ # Amazon EMR rilis 5.3.2 ](emr-532-release.md) + [ # Amazon EMR rilis 5.3.1 ](emr-531-release.md) + [ # Amazon EMR rilis 5.3.0 ](emr-530-release.md) + [ # Amazon EMR rilis 5.2.3 ](emr-523-release.md) + [ # Amazon EMR rilis 5.2.2 ](emr-522-release.md) + [ # Amazon EMR rilis 5.2.1 ](emr-521-release.md) + [ # Amazon EMR rilis 5.2.0 ](emr-520-release.md) + [ # Amazon EMR rilis 5.1.1 ](emr-511-release.md) + [ # Amazon EMR rilis 5.1.0 ](emr-510-release.md) + [ # Amazon EMR rilis 5.0.3 ](emr-503-release.md) + [ # Amazon EMR rilis 5.0.2 ](emr-502-release.md) + [ # Amazon EMR rilis 5.0.1 ](emr-501-release.md) + [ # Amazon EMR rilis 5.0.0 ](emr-500-release.md) # Versi aplikasi di Amazon EMR 5.x rilis Tabel berikut mencantumkan versi aplikasi yang tersedia di setiap rilis Amazon EMR 5.x. **Informasi versi aplikasi** | | emr-5.36.2 | emr-5.36.1 | emr-5.36.0 | emr-5.35.0 | emr-5.34.0 | emr-5.33.1 | emr-5.33.0 | emr-5.32.1 | emr-5.32.0 | emr-5.31.1 | emr-5.31.0 | emr-5.30.2 | emr-5.30.1 | emr-5.30.0 | emr-5.29.0 | emr-5.28.1 | emr-5.28.0 | emr-5.27.1 | emr-5.27.0 | emr-5.26.0 | emr-5.25.0 | emr-5.24.1 | emr-5.24.0 | emr-5.23.1 | emr-5.23.0 | emr-5.22.0 | emr-5.21.2 | emr-5.21.1 | emr-5.21.0 | emr-5.20.1 | emr-5.20.0 | emr-5.19.1 | emr-5.19.0 | emr-5.18.1 | emr-5.18.0 | emr-5.17.2 | emr-5.17.1 | emr-5.17.0 | emr-5.16.1 | emr-5.16.0 | emr-5.15.1 | emr-5.15.0 | emr-5.14.2 | emr-5.14.1 | emr-5.14.0 | emr-5.13.1 | emr-5.13.0 | emr-5.12.3 | emr-5.12.2 | emr-5.12.1 | emr-5.12.0 | emr-5.11.4 | emr-5.11.3 | emr-5.11.2 | emr-5.11.1 | emr-5.11.0 | emr-5.10.1 | emr-5.10.0 | emr-5.9.1 | emr-5.9.0 | emr-5.8.3 | emr-5.8.2 | emr-5.8.1 | emr-5.8.0 | emr-5.7.1 | emr-5.7.0 | emr-5.6.1 | emr-5.6.0 | emr-5.5.4 | emr-5.5.3 | emr-5.5.2 | emr-5.5.1 | emr-5.5.0 | emr-5.4.1 | emr-5.4.0 | emr-5.3.2 | emr-5.3.1 | emr-5.3.0 | emr-5.2.3 | emr-5.2.2 | emr-5.2.1 | emr-5.2.0 | emr-5.1.1 | emr-5.1.0 | emr-5.0.3 | emr-5.0.2 | emr-5.0.1 | emr-5.0.0 | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.206 | 1.12.206 | 1.12.206 | 1.12.159 | 1.11.970 | 1.11.970 | 1.11.970 | 1.11.890 | 1.11.890 | 1.11.852 | 1.11.852 | 1.11.759 | 1.11.759 | 1.11.759 | 1.11.682 | 1.11.659 | 1.11.659 | 1.11.615 | 1.11.615 | 1.11.595 | 1.11.566 | 1.11.546 | 1.11.546 | 1.11.519 | 1.11.519 | 1.11.510 | 1.11.479 | 1.11.479 | 1.11.479 | 1.11.461 | 1.11.461 | 1.11.433 | 1.11.433 | 1.11.393 | 1.11.393 | 1.11.336 | 1.11.336 | 1.11.336 | 1.11.336 | 1.11.336 | 1.11.333 | 1.11.333 | 1.11.297 | 1.11.297 | 1.11.297 | 1.11.297 | 1.11.297 | 1.11.267 | 1.11.267 | 1.11.267 | 1.11.267 | 1.11.238 | 1.11.238 | 1.11.238 | 1.11.238 | 1.11.238 | 1.11.221 | 1.11.221 | 1.11.183 | 1.11.183 | 1.11.160 | 1.11.160 | 1.11.160 | 1.11.160 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Delta | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Flink | 1.14.2 | 1.14.2 | 1.14.2 | 1.14.2 | 1.13.1 | 1.12.1 | 1.12.1 | 1.11.2 | 1.11.2 | 1.11.0 | 1.11.0 | 1.10.0 | 1.10.0 | 1.10.0 | 1.9.1 | 1.9.0 | 1.9.0 | 1.8.1 | 1.8.1 | 1.8.0 | 1.8.0 | 1.8.0 | 1.8.0 | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.0 | 1.7.0 | 1.7.0 | 1.6.2 | 1.6.2 | 1.6.1 | 1.6.1 | 1.6.0 | 1.6.0 | 1.5.2 | 1.5.2 | 1.5.2 | 1.5.0 | 1.5.0 | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.0 | 1.3.0 | 1.2.1 | 1.2.1 | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | 1.1.4 | 1.1.4 | 1.1.4 | 1.1.3 | 1.1.3 | 1.1.3 | 1.1.3 | 1.1.3 | 1.1.3 | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.10 | 1.4.10 | 1.4.10 | 1.4.10 | 1.4.10 | 1.4.10 | 1.4.9 | 1.4.9 | 1.4.9 | 1.4.9 | 1.4.9 | 1.4.9 | 1.4.8 | 1.4.8 | 1.4.8 | 1.4.8 | 1.4.8 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.4 | 1.4.4 | 1.4.4 | 1.4.4 | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-0 | 2.3.8-amzn-0 | 2.3.7-amzn-4 | 2.3.7-amzn-4 | 2.3.7-amzn-3 | 2.3.7-amzn-3 | 2.3.7-amzn-1 | 2.3.7-amzn-1 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-1 | 2.3.6-amzn-0 | 2.3.6-amzn-0 | Versi 2.3.5 amzn-1 | Versi 2.3.5 amzn-1 | 2.3.5 amzn-0 | 2.3.5 amzn-0 | 2.3.4-amzn-2 | 2.3.4-amzn-2 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.3-amzn-2 | 2.3.3-amzn-2 | 2.3.3-amzn-2 | 2.3.3-amzn-2 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-0 | 2.3.3-amzn-0 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.1-amzn-0 | 2.3.1-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.10.1-amzn-4 | 2.10.1-amzn-4 | 2.10.1-amzn-4 | 2.10.1-amzn-3 | 2.10.1-amzn-2 | 2.10.1-amzn-1.1 | 2.10.1-amzn-1 | 2.10.1-amzn-0.1 | 2.10.1-amzn-0 | 2.10.0-amzn-0.1 | 2.10.0-amzn-0 | 2.8.5-amzn-6.1 | 2.8.5-amzn-6 | 2.8.5-amzn-6 | 2.8.5-amzn-5 | 2.8.5-amzn-5 | 2.8.5-amzn-5 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-3 | 2.8.5-amzn-3 | 2.8.5-amzn-2 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-0 | 2.8.5-amzn-0 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-0 | 2.8.4-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-5 | 2.7.3-amzn-5 | 2.7.3-amzn-4 | 2.7.3-amzn-4 | 2.7.3-amzn-3 | 2.7.3-amzn-3 | 2.7.3-amzn-3 | 2.7.3-amzn-3 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-0 | 2.7.3-amzn-0 | 2.7.3-amzn-0 | 2.7.3-amzn-0 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | | Hive | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-0 | 2.3.8-amzn-0 | 2.3.7-amzn-4 | 2.3.7-amzn-4 | 2.3.7-amzn-3 | 2.3.7-amzn-3 | 2.3.7-amzn-1 | 2.3.7-amzn-1 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-1 | 2.3.6-amzn-0 | 2.3.6-amzn-0 | Versi 2.3.5 amzn-1 | Versi 2.3.5 amzn-1 | 2.3.5 amzn-0 | 2.3.5 amzn-0 | 2.3.4-amzn-2 | 2.3.4-amzn-2 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-0 | 2.3.3-amzn-0 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.1-amzn-0 | 2.3.1-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | 0.10.1-amzn-1 | 0.10.1-amzn-1 | 0.10.1-amzn-1 | 0.9.0-amzn-2 | 0.9.0-amzn-0 | 0.7.0-amzn-1 | 0.7.0-amzn-1 | 0.6.0-amzn-0 | 0.6.0-amzn-0 | 0.6.0-amzn-0 | 0.6.0-amzn-0 | 0.5.2-incubating | 0.5.2-incubating | 0.5.2-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Hue | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | 4.9.0 | 4.9.0 | 4.9.0 | 4.8.0 | 4.8.0 | 4.7.1 | 4.7.1 | 4.6.0 | 4.6.0 | 4.6.0 | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | 3.11.0 | 3.11.0 | 3.11.0 | 3.11.0 | 3.11.0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | 1.2.2 | 1.2.2 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 0.9.6 | 0.9.6 | 0.9.6 | 0.9.6 | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | MXNet | 1.8.0 | 1.8.0 | 1.8.0 | 1.8.0 | 1.8.0 | 1.7.0 | 1.7.0 | 1.7.0 | 1.7.0 | 1.6.0 | 1.6.0 | 1.5.1 | 1.5.1 | 1.5.1 | 1.5.1 | 1.5.1 | 1.5.1 | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.0 | 1.3.0 | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | 0.12.0 | 0.12.0 | 0.12.0 | 0.12.0 | 0.12.0 | 0.12.0 | 0.12.0 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.2- -1.4 HBase | 4.14.2- -1.4 HBase | 4.14.2- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | 0.16.0-amzn-1 | 0.16.0-amzn-1 | 0.16.0-amzn-1 | 0.16.0-amzn-1 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,267-amzn-1 | 0,267-amzn-1 | 0,267-amzn-1 | 0,26-amzn-0 | 0,261-amzn-0 | 0.245.1-amzn-0 | 0.245.1-amzn-0 | 0.240.1-amzn-0 | 0.240.1-amzn-0 | 0.238.3-amzn-0 | 0.238.3-amzn-0 | 0,232 | 0,232 | 0,232 | 0,227 | 0,227 | 0,227 | 0,224 | 0,224 | 0,220 | 0,220 | 0,219 | 0,219 | 0,215 | 0,215 | 0,215 | 0,215 | 0,215 | 0,215 | 0,214 | 0,214 | 0,212 | 0,212 | 0.210 | 0.210 | 0,206 | 0,206 | 0,206 | 0,203 | 0,203 | 0,194 | 0,194 | 0,194 | 0,194 | 0,194 | 0,194 | 0,194 | 0,188 | 0,188 | 0,188 | 0,188 | 0,187 | 0,187 | 0,187 | 0,187 | 0,187 | 0,187 | 0,187 | 0,184 | 0,184 | 0,170 | 0,170 | 0,170 | 0,170 | 0,170 | 0,170 | 0,170 | 0,170 | 0,170 | 0,170 | 0,170 | 0,170 | 0,170 | 0,166 | 0,166 | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | 0,152.3 | 0,152.3 | 0,152.3 | 0,152.3 | 0,150 | 0,150 | 0,150 | | Spark | 2.4.8-amzn-2 | 2.4.8-amzn-2 | 2.4.8-amzn-2 | 2.4.8-amzn-1 | 2.4.8-amzn-0 | 2.4.7-amzn-1.1 | 2.4.7-amzn-1 | 2.4.7-amzn-0.1 | 2.4.7-amzn-0 | 2.4.6-amzn-0.1 | 2.4.6-amzn-0 | 2.4.5-amzn-0.1 | 2.4.5-amzn-0 | 2.4.5-amzn-0 | 2.4.4 | 2.4.4 | 2.4.4 | 2.4.4 | 2.4.4 | 2.4.3 | 2.4.3 | 2.4.2 | 2.4.2 | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | 2.3.2 | 2.3.2 | 2.3.2 | 2.3.2 | 2.3.1 | 2.3.1 | 2.3.1 | 2.3.1 | 2.3.1 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | 2.1.1 | 2.1.1 | 2.1.1 | 2.1.1 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.1 | 2.0.1 | 2.0.1 | 2.0.0 | 2.0.0 | 2.0.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | 2.3.1 | 2.3.1 | 2.1.0 | 2.1.0 | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | 1.13.1 | 1.13.1 | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | 1.11.0 | 1.11.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Zeppelin | 0.10.0 | 0.10.0 | 0.10.0 | 0.10.0 | 0.10.0 | 0.9.0 | 0.9.0 | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.0 | 0.7.0 | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.1 | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | # Amazon EMR rilis 5.36.2 ## 5.36.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.36.2 | emr-5.36.1 | emr-5.36.0 | emr-5.35.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.206 | 1.12.206 | 1.12.206 | 1.12.159 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.14.2 | 1.14.2 | 1.14.2 | 1.14.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-0 | | Hadoop | 2.10.1-amzn-4 | 2.10.1-amzn-4 | 2.10.1-amzn-4 | 2.10.1-amzn-3 | | Hive | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-0 | | Hudi | 0.10.1-amzn-1 | 0.10.1-amzn-1 | 0.10.1-amzn-1 | 0.9.0-amzn-2 | | Hue | 4.10.0 | 4.10.0 | 4.10.0 | 4.10.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.6.0 | 2.6.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.8.0 | 1.8.0 | 1.8.0 | 1.8.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,267-amzn-1 | 0,267-amzn-1 | 0,267-amzn-1 | 0,26-amzn-0 | | Spark | 2.4.8-amzn-2 | 2.4.8-amzn-2 | 2.4.8-amzn-2 | 2.4.8-amzn-1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.10.0 | 0.10.0 | 0.10.0 | 0.10.0 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.36.2 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.36.2. Perubahan relatif terhadap 5.36.1. Untuk informasi tentang timeline rilis, lihat [log perubahan](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-5362-release.html#5362-changelog). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Rilis ini meningkatkan logika penskalaan klaster sehingga Amazon EMR tidak menurunkan node inti di bawah pengaturan faktor replikasi HDFS untuk cluster. Peningkatan ini memenuhi persyaratan redundansi data, dan mengurangi kemungkinan operasi penskalaan mungkin terhenti. + Rilis ini menambahkan mekanisme coba lagi baru ke alur kerja penskalaan cluster untuk kluster EMR yang menjalankan Presto atau Trino. Peningkatan ini mengurangi risiko bahwa pengubahan ukuran cluster berjalan tanpa batas karena satu operasi pengubahan ukuran yang gagal. Ini juga meningkatkan pemanfaatan cluster, karena kluster Anda naik dan turun lebih cepat. + Memperbaiki masalah di mana operasi penskalaan klaster mungkin terhenti sementara Amazon EMR dengan anggun menonaktifkan node inti dan ternyata tidak sehat sebelum sepenuhnya dinonaktifkan. + Meningkatkan stabilitas node dalam klaster ketersediaan tinggi dengan beberapa node primer saat Amazon EMR memulai ulang satu node. + Mengoptimalkan manajemen log dengan Amazon EMR yang berjalan di Amazon EC2. Akibatnya, Anda mungkin melihat sedikit pengurangan biaya penyimpanan untuk log cluster Anda. + Meningkatkan pengelolaan file log ZooKeeper transaksi yang dipertahankan pada node primer untuk meminimalkan skenario di mana file log tumbuh di luar batas dan mengganggu operasi cluster. + Memperbaiki bug langka yang dapat menyebabkan cluster ketersediaan tinggi dengan beberapa node utama gagal karena tidak dapat berkomunikasi dengan Yarn. ResourceManager + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5362-release.html) ## 5.36.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.16.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.5.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.21.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.7.0 | EMR S3Select Connector | | emrfs | 2.51.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.14.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.14.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.1-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.1-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.1-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.1-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.1-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.1-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.1-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.1-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.1-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.1-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.1-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.9-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.9-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.9-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.9-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.9-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.9-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.9-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.10.1-amzn-1 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.10.1-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.10.1-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.13.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.8.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68 | Server basis data MySQL. | | nvidia-cuda | 11.0.194 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,267-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,267-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,267-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.8-amzn-2 | Klien baris perintah Spark. | | spark-history-server | 2.4.8-amzn-2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.8-amzn-2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.8-amzn-2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.36.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-5.36.2** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | Should not be reconfigured. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Restarts HiveServer2 and HiveMetastore. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server. | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server. | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | Restarts EMR record server. | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | Restarts EMR record server. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | Restarts EMR record server. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restarts Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 5.36.2 perubahan log **Ubah log untuk catatan rilis dan rilis 5.36.2** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2024-05-28 | Penerapan selesai | [Amazon EMR 5.36.2 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2024-05-28 | Publikasi Docs | Amazon EMR 5.36.2 catatan rilis pertama kali diterbitkan | | 2024-05-20 | Rilis awal | Amazon EMR 5.36.2 pertama kali dikerahkan ke Wilayah komersial terbatas | # Amazon EMR rilis 5.36.1 ## 5.36.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.36.1 | emr-5.36.0 | emr-5.35.0 | emr-5.34.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.206 | 1.12.206 | 1.12.159 | 1.11.970 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.14.2 | 1.14.2 | 1.14.2 | 1.13.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-0 | 2.3.8-amzn-0 | | Hadoop | 2.10.1-amzn-4 | 2.10.1-amzn-4 | 2.10.1-amzn-3 | 2.10.1-amzn-2 | | Hive | 2.3.9-amzn-2 | 2.3.9-amzn-2 | 2.3.9-amzn-0 | 2.3.8-amzn-0 | | Hudi | 0.10.1-amzn-1 | 0.10.1-amzn-1 | 0.9.0-amzn-2 | 0.9.0-amzn-0 | | Hue | 4.10.0 | 4.10.0 | 4.10.0 | 4.9.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.6.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.4.1 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | | MXNet | 1.8.0 | 1.8.0 | 1.8.0 | 1.8.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.1 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,267-amzn-1 | 0,267-amzn-1 | 0,26-amzn-0 | 0,261-amzn-0 | | Spark | 2.4.8-amzn-2 | 2.4.8-amzn-2 | 2.4.8-amzn-1 | 2.4.8-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.10.0 | 0.10.0 | 0.10.0 | 0.10.0 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.36.1 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.36.1. Perubahan relatif terhadap 5.36.0. Untuk informasi tentang timeline rilis, lihat [log perubahan](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-5361-release.html#5361-changelog). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Amazon EMR rilis 5.36.1 menambahkan dukungan untuk pengarsipan log ke Amazon S3 selama penskalaan klaster turun. Dalam rilis 5.x sebelumnya, Anda hanya dapat mengarsipkan file log ke Amazon S3 selama penghentian klaster. Peningkatan ini memastikan bahwa file log yang dihasilkan di cluster tetap ada di Amazon S3 bahkan setelah node dihentikan. Untuk informasi selengkapnya, lihat [Mengkonfigurasi logging dan debug klaster](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-debugging.html). + Rilis 5.36.1 meningkatkan daemon manajemen log on-cluster untuk memantau folder log tambahan di cluster EMR Anda. Peningkatan ini meminimalkan skenario pemanfaatan disk yang berlebihan. + Rilis 5.36.1 secara otomatis memulai ulang daemon manajemen log on-cluster saat berhenti. Peningkatan ini mengurangi risiko node tampak tidak sehat karena pemanfaatan disk yang berlebihan. + Rilis 5.36.1 memperbaiki masalah di mana daemon EMR Amazon pada node utama akan mempertahankan metadata basi untuk instance yang dihentikan di cluster. Mempertahankan data basi dapat menyebabkan CPU on-cluster dan penggunaan memori tumbuh tanpa batas, dan pada akhirnya menyebabkan kegagalan cluster. + Untuk cluster yang diluncurkan dengan beberapa node primer, rilis 5.36.1 memperbaiki masalah di mana kegagalan perangkat keras Amazon EC2 pada salah satu node primer dapat menyebabkan node primer kedua gagal dan membuat cluster Anda tidak stabil. + Untuk cluster yang dikonfigurasi dengan enkripsi in-transit, Managed Scaling sekarang menjadi *Spark* shuffle data aware. Spark shuffle data adalah data yang didistribusikan ulang Spark di seluruh partisi untuk melakukan operasi tertentu. Selama penurunan skala, Penskalaan Terkelola mengabaikan instance dengan data acak. Ini mencegah upaya ulang pekerjaan dan perhitungan ulang, yang mahal untuk harga dan kinerja. Untuk informasi selengkapnya tentang operasi shuffle, lihat Panduan [Pemrograman Spark](https://spark.apache.org/docs/latest/rdd-programming-guide.html#shuffle-operations). + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5361-release.html) ## 5.36.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.16.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.5.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.21.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.7.0 | EMR S3Select Connector | | emrfs | 2.51.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.14.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.14.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.1-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.1-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.1-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.1-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.1-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.1-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.1-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.1-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.1-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.1-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.1-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.9-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.9-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.9-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.9-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.9-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.9-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.9-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.10.1-amzn-1 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.10.1-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.10.1-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.13.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.8.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68 | Server basis data MySQL. | | nvidia-cuda | 11.0.194 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,267-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,267-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,267-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.8-amzn-2 | Klien baris perintah Spark. | | spark-history-server | 2.4.8-amzn-2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.8-amzn-2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.8-amzn-2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.36.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-5.36.1** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | Should not be reconfigured. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Restarts HiveServer2 and HiveMetastore. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | hudi-defaults | Ubah nilai dalam file hudi-defaults.conf Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server. | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server. | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | Restarts EMR record server. | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | Restarts EMR record server. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | Restarts EMR record server. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restarts Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | ## 5.36.1 perubahan log **Ubah log untuk catatan rilis dan rilis 5.36.1** | Date | Peristiwa | Deskripsi | | --- | --- | --- | | 2023-07-26 | Perbarui | Label rilis OS baru 2.0.20230612.0 dan2.0.20230628.0. | | 2023-05-25 | Penerapan selesai | [Amazon EMR 5.36.1 sepenuhnya diterapkan ke semua Wilayah yang didukung](https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/) | | 2023-05-09 | Publikasi Docs | Amazon EMR 5.36.1 catatan rilis pertama kali diterbitkan | | 2023-05-04 | Rilis awal | Amazon EMR 5.36.1 pertama kali dikerahkan ke Wilayah komersial terbatas | # Amazon EMR rilis 5.36.0 ## 5.36.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.36.0 | emr-5.35.0 | emr-5.34.0 | emr-5.33.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.206 | 1.12.159 | 1.11.970 | 1.11.970 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.14.2 | 1.14.2 | 1.13.1 | 1.12.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.9-amzn-2 | 2.3.9-amzn-0 | 2.3.8-amzn-0 | 2.3.7-amzn-4 | | Hadoop | 2.10.1-amzn-4 | 2.10.1-amzn-3 | 2.10.1-amzn-2 | 2.10.1-amzn-1.1 | | Hive | 2.3.9-amzn-2 | 2.3.9-amzn-0 | 2.3.8-amzn-0 | 2.3.7-amzn-4 | | Hudi | 0.10.1-amzn-1 | 0.9.0-amzn-2 | 0.9.0-amzn-0 | 0.7.0-amzn-1 | | Hue | 4.10.0 | 4.10.0 | 4.9.0 | 4.9.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.4.1 | 1.2.2 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.0-incubating | | MXNet | 1.8.0 | 1.8.0 | 1.8.0 | 1.7.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.1 | 5.2.1 | 5.2.1 | 5.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,267-amzn-1 | 0,26-amzn-0 | 0,261-amzn-0 | 0.245.1-amzn-0 | | Spark | 2.4.8-amzn-2 | 2.4.8-amzn-1 | 2.4.8-amzn-0 | 2.4.7-amzn-1.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.10.0 | 0.10.0 | 0.10.0 | 0.9.0 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan rilis 5.36.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.36.0. Perubahan relatif terhadap 5.35.0. Tanggal rilis awal: 15 Juni 2022 **Fitur Baru** + Amazon EMR rilis 5.36.0 menambahkan dukungan untuk bahasa definisi data (DDL) dengan Apache Spark pada cluster yang diaktifkan Apache Ranger. Ini memungkinkan Anda menggunakan Apache Ranger untuk mengelola akses untuk operasi seperti membuat, mengubah, dan menjatuhkan database dan tabel dari cluster EMR Amazon. + Saat Anda meluncurkan cluster dengan *rilis patch terbaru* Amazon EMR 5.36 atau lebih tinggi, 6.6 atau lebih tinggi, atau 7.0 atau lebih tinggi, Amazon EMR menggunakan rilis Amazon Linux 2023 atau Amazon Linux 2 terbaru untuk AMI EMR Amazon default. Untuk informasi selengkapnya, lihat [Menggunakan AMI Amazon Linux default untuk Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-default-ami.html). **catatan** Rilis ini tidak lagi mendapatkan pembaruan AMI otomatis karena telah digantikan oleh 1 rilis patch lagi. Rilis patch dilambangkan dengan angka setelah titik desimal kedua (). `6.8.1` Untuk melihat apakah Anda menggunakan rilis patch terbaru, periksa rilis yang tersedia di [https://docs.aws.amazon.com/emr/latest/ReleaseGuide](https://docs.aws.amazon.com/emr/latest/ReleaseGuide), atau periksa dropdown **rilis Amazon EMR** saat Anda membuat cluster di konsol, atau gunakan tindakan API [https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html](https://docs.aws.amazon.com/emr/latest/APIReference/API_ListReleaseLabels.html)atau CLI. [https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html](https://docs.aws.amazon.com/cli/latest/reference/emr/list-release-labels.html) Untuk mendapatkan pembaruan tentang rilis baru, berlangganan umpan RSS di [Apa yang baru?](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html) halaman. | OsReleaseLabel (Versi Amazon Linux) | Versi Kernel Amazon Linux | Tanggal Tersedia | Wilayah yang Didukung | | --- | --- | --- | --- | | 2.0.20260302.0 | 4.14.355-280.714.amzn2 | Maret 13, 2026 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20260216.0 | 4.14.355-280.714.amzn2 | Februari 25, 2026 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20260120.1 | 4.14.355-280.713.amzn2 | Februari 18, 2026 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20251208.0 | 4.14.355-280.710.amzn2 | Januari 13, 2026 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20251121.0 | 4.14.355-280.708.amzn2 | Desember 16, 2025 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20251027.1 | 4.14.355-280.706.amzn2 | November 10, 2025 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20250929.2 | 4.14.355-280.695.amzn2 | Oktober 13, 2025 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20250818.2 | 4.14.355-280.672.amzn2 | September 17, 2025 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20250808.1 | 4.14.355-280.664.amzn2 | Agustus 28, 2025 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20250721.2 | 4.14.355-280.652.amzn2 | Agustus 14, 2025 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20250623.0 | 4.14.355-277.647.amzn2 | Juli 21, 2025 | Afrika (Cape Town), Asia Pasifik (Hong Kong), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Mumbai), Asia Pasifik (Hyderabad), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Kanada (Tengah), Eropa (Frankfurt), Eropa (Zurich), Eropa (Stockholm), Eropa (Milan), Eropa (Spanyol), Eropa (Irlandia), Eropa (London), Eropa (Paris), Israel (Tel Aviv), Timur Tengah (UEA), Timur Tengah (Bahrain), Amerika Selatan (São Paulo), AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon) | | 2.0.20250610.0 | 4.14.355-277.647.amzn2 | Juli 14, 2025 | Eropa (Stockholm), Timur Tengah (Bahrain), Tiongkok (Beijing), Asia Pasifik (Mumbai), Eropa (Paris), Asia Pasifik (Jakarta), Timur AS (Ohio), Afrika (Cape Town), Eropa (Irlandia), Timur Tengah (UEA), Eropa (Frankfurt), Amerika Selatan (Sao Paulo), Asia Pasifik (Hong Kong), Asia Pasifik (Hyundai) Derabad), AS Timur (Virginia N.), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Eropa (London), Eropa (Milan), Asia Pasifik (Tokyo AWS GovCloud ), (AS-Timur), (AS-Barat), AS Barat (Oregon AWS GovCloud ), AS Barat (California N.), Asia Pasifik (Singapura), Asia Pasifik (Sydney ), Israel (Tel Aviv), Kanada (Tengah), Eropa (Spanyol), Tiongkok (Ningxia), Eropa (Zurich) | | 2.0.20250527.1 | 4.14.355-277.647.amzn2 | Jun 19, 2025 | Eropa (Stockholm), Timur Tengah (Bahrain), Asia Pasifik (Mumbai), Eropa (Paris), Asia Pasifik (Jakarta), AS Timur (Ohio), Afrika (Cape Town), Eropa (Irlandia), Timur Tengah (UEA), Eropa (Frankfurt), Amerika Selatan (São Paulo), Asia Pasifik (Hong Kong), Asia Pasifik (Hyderabad), AS Timur (Virginia N.), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Eropa (London), Asia Pasifik (Melbourne), Eropa (Milan), Asia Pasifik (Tokyo), AS Barat (Oregon), AS Barat (California N.), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Israel (Tel Aviv), Kanada (Tengah), Eropa (Spanyol), Eropa (Zürich) | | 2.0.20250512.0 | 4.14.355-277.643.amzn2 | 04 Jun 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Milan), Eropa (Paris), Eropa (Stockholm), Asia Pasifik (Hong Kong), Asia Pasifik (Jakarta), Asia Pasifik (Mumbai), Asia Pasifik (Osaka), Asia Pasifik (Osaka), Asia Pasifik (Seoul), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Tokyo), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), (AS-Timur), (AS-Barat), Tiongkok (Beijing), Tiongkok ( AWS GovCloud Ningxia) AWS GovCloud | | 2.0.20250428.0 | 4.14.355-276.639.amzn2 | Mei 23, 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Milan), Eropa (Paris), Eropa (Spanyol), Eropa (Stockholm), Eropa (Zurich), Asia Pasifik (Hong Kong), Asia Pasifik (Hyderabad), Asia Pasifik (Jakarta), Asia Pasifik (Melbourne), Asia Pasifik (Mumbai), Asia Pasifik (Osaka), Asia Pasifik (Seoul), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Tokyo), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Timur Tengah (UEA), Kanada (Tengah), Israel (Tel Aviv) | | 2.0.20250414.0 | 4.14.355-276.618.amzn2 | 12 Mei 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Stockholm), Eropa (Milan), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Paris), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), ( AWS GovCloud AS-Barat), (AS-Timur), Tiongkok (Beijing), Tiongkok (Ningxia) AWS GovCloud | | 2.0.20250321.0 | 4.14.355 | April 09, 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Stockholm), Eropa (Milan), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Paris), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), ( AWS GovCloud AS-Barat), (AS-Timur), Tiongkok (Beijing), Tiongkok (Ningxia) AWS GovCloud | | 2.0.20250305.0 | 4.14.355 | Maret 18, 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Stockholm), Eropa (Milan), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Paris), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), ( AWS GovCloud AS-Barat), (AS-Timur), Tiongkok (Beijing), Tiongkok (Ningxia) AWS GovCloud | | 2.0.20250220.0 | 4.14.355 | Maret 08, 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Stockholm), Eropa (Milan), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Paris), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), ( AWS GovCloud AS-Barat), (AS-Timur), Tiongkok (Beijing), Tiongkok (Ningxia) AWS GovCloud | | 2.0.20250201.0 | 4.14.355 | Februari 28, 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Stockholm), Eropa (Milan), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Paris), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), ( AWS GovCloud AS-Barat), (AS-Timur), Tiongkok (Beijing), Tiongkok (Ningxia) AWS GovCloud | | 2.0.20250123.4 | 4.14.355 | Januari 27, 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Stockholm), Eropa (Milan), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Paris), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), ( AWS GovCloud AS-Barat), (AS-Timur), Tiongkok (Beijing), Tiongkok (Ningxia) AWS GovCloud | | 2.0.20250116.0 | 4.14.355 | Januari 23, 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Stockholm), Eropa (Milan), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Paris), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), ( AWS GovCloud AS-Barat), (AS-Timur), Tiongkok (Beijing), Tiongkok (Ningxia) AWS GovCloud | | 2.0.20241217.0 | 4.14.355 | Januari 8, 2025 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Stockholm), Eropa (Milan), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Paris), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), ( AWS GovCloud AS-Barat), ( AWS GovCloud AS-Timur), Tiongkok (Beijing), Tiongkok (Ningxia), Asia Pasifik (Hyderabad), Timur Tengah (UEA), Eropa (Spanyol), Eropa (Zurich), Asia Pasifik (Melbourne), Israel (Tel Aviv) | | 2.0.20240709.1 | 4.14.348 | Juli 23, 2024 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Eropa (Stockholm), Eropa (Milan), Eropa (Frankfurt), Eropa (Irlandia), Eropa (London), Eropa (Paris), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Asia Pasifik (Jakarta), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain), Kanada (Tengah), ( AWS GovCloud AS-Barat), ( AWS GovCloud AS-Timur), Tiongkok (Beijing), Tiongkok (Ningxia), Asia Pasifik (Hyderabad), Timur Tengah (UEA), Eropa (Spanyol), Eropa (Zurich), Asia Pasifik (Melbourne), Israel (Tel Aviv) | | 2.0.20230504.1 | 4.14.313 | 16 Mei 2023 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20230418.0 | 4.14.311 | 3 Mei 2023 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20230404.1 | 4.14.311 | 18 April 2023 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20230404.0 | 4.14.311 | 10 April 2023 | AS Timur (Virginia N.), Eropa (Paris) | | 2.0.20230320.0 | 4.14.309 | 30 Maret 2023 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20230307.0 | 4.14.305 | 15 Maret 2023 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20230207.0 | 4.14.304 | 22 Februari 2023 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20230119.1 | 4.14.301 | 3 Februari 2023 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20221210.1 | 4.14.301 | 22 Desember 2023 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20221103.3 | 4.14.296 | Desember 5, 2022 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20221004.0 | 4.14.294 | 2 November 2022 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20220912.1 | 4.14.291 | Oktober 7, 2022 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | | 2.0.20220719.0 | 4.14.287 | Agustus 10, 2022 | AS Barat (California N.), Eropa (Paris), Eropa (Stockholm), Eropa (Frankfurt), Asia Pasifik (Mumbai), Timur Tengah (Bahrain) | | 2.0.20220426.0 | 4.14.281 | 14 Juni 2022 | AS Timur (Virginia N.), AS Timur (Ohio), AS Barat (California N.), AS Barat (Oregon), Kanada (Tengah), Eropa (Stockholm), Eropa (Irlandia), Eropa (London), Eropa (Paris), Eropa (Frankfurt), Eropa (Milan), Asia Pasifik (Hong Kong), Asia Pasifik (Mumbai), Asia Pasifik (Jakarta), Asia Pasifik (Tokyo), Asia Pasifik (Seoul), Asia Pasifik (Osaka), Asia Pasifik (Singapura), Asia Pasifik (Sydney), Afrika (Cape Town), Amerika Selatan (Sao Paulo), Timur Tengah (Bahrain) | **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Amazon EMR 5.36.0 upgrade sekarang mendukung: aws-sdk 1.12.206, Hadoop 2.10.1-amzn-4, Hive 2.3.9-amzn-2, Hudi 0.10.1-amzn-1, Spark 2.4.8-amzn-2, Presto 0.267-amzn-1, konektor Amazon Glue 1.18.0, EMRFS 2.51.0. **Masalah yang diketahui** + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` + Dengan Amazon EMR merilis 5.36.0 dan 6.6.0 hingga 6.9.0, `SecretAgent` dan komponen `RecordServer` layanan mungkin mengalami kehilangan data log karena konfigurasi pola nama file yang salah di properti Log4j2. Konfigurasi yang salah menyebabkan komponen menghasilkan hanya satu file log per hari. Ketika strategi rotasi terjadi, ia menimpa file yang ada alih-alih menghasilkan file log baru seperti yang diharapkan. Sebagai solusinya, gunakan tindakan bootstrap untuk menghasilkan file log setiap jam dan tambahkan bilangan bulat kenaikan otomatis dalam nama file untuk menangani rotasi. Untuk Amazon EMR 6.6.0 hingga 6.9.0 rilis, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-6x/replace-puppet.sh,Args=[]" ``` Untuk Amazon EMR 5.36.0, gunakan tindakan bootstrap berikut saat Anda meluncurkan cluster. ``` ‑‑bootstrap‑actions "Path=s3://emr-data-access-control-us-east-1/customer-bootstrap-actions/log-rotation-emr-5x/replace-puppet.sh,Args=[]" ``` ## 5.36.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.16.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.5.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.21.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.7.0 | EMR S3Select Connector | | emrfs | 2.51.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.14.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.14.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.1-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.1-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.1-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.1-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.1-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.1-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.1-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.1-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.1-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.1-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.1-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.9-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.9-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.9-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.9-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.9-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.9-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.9-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.10.1-amzn-1 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.10.1-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.10.1-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.13.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.8.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68 | Server basis data MySQL. | | nvidia-cuda | 11.0.194 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,267-amzn-1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,267-amzn-1 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,267-amzn-1 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.8-amzn-2 | Klien baris perintah Spark. | | spark-history-server | 2.4.8-amzn-2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.8-amzn-2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.8-amzn-2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.36.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-5.36.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | Should not be reconfigured. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Restarts HiveServer2 and HiveMetastore. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server. | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server. | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | Restarts EMR record server. | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | Restarts EMR record server. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | Restarts EMR record server. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restarts Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 5.35.0 ## 5.35.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.35.0 | emr-5.34.0 | emr-5.33.1 | emr-5.33.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.12.159 | 1.11.970 | 1.11.970 | 1.11.970 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.14.2 | 1.13.1 | 1.12.1 | 1.12.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.9-amzn-0 | 2.3.8-amzn-0 | 2.3.7-amzn-4 | 2.3.7-amzn-4 | | Hadoop | 2.10.1-amzn-3 | 2.10.1-amzn-2 | 2.10.1-amzn-1.1 | 2.10.1-amzn-1 | | Hive | 2.3.9-amzn-0 | 2.3.8-amzn-0 | 2.3.7-amzn-4 | 2.3.7-amzn-4 | | Hudi | 0.9.0-amzn-2 | 0.9.0-amzn-0 | 0.7.0-amzn-1 | 0.7.0-amzn-1 | | Hue | 4.10.0 | 4.9.0 | 4.9.0 | 4.9.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.4.1 | 1.2.2 | 1.2.2 | | Livy | 0.7.1-inkubasi | 0.7.1-inkubasi | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.8.0 | 1.8.0 | 1.7.0 | 1.7.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.1 | 5.2.1 | 5.2.0 | 5.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,26-amzn-0 | 0,261-amzn-0 | 0.245.1-amzn-0 | 0.245.1-amzn-0 | | Spark | 2.4.8-amzn-1 | 2.4.8-amzn-0 | 2.4.7-amzn-1.1 | 2.4.7-amzn-1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.4.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.10.0 | 0.10.0 | 0.9.0 | 0.9.0 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.35.0 Ini adalah catatan rilis Amazon EMR 5.35.0. Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.35.0. Perubahan relatif terhadap 5.34.0. Tanggal rilis awal: 30 Maret 2022 **Fitur Baru** + Amazon EMR merilis 5.35 aplikasi yang menggunakan Log4j 1.x dan Log4j 2.x ditingkatkan untuk menggunakan Log4j 1.2.17 (atau lebih tinggi) dan Log4j 2.17.1 (atau lebih tinggi) masing-masing, dan tidak perlu menggunakan tindakan bootstrap untuk mengurangi masalah CVE di rilis sebelumnya. Lihat [Pendekatan untuk mengurangi CVE-2021-44228](emr-log4j-vulnerability.md). **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** **Flink berubah** | Jenis perubahan | Deskripsi | | --- | --- | | Upgrade | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5350-release.html) | **Hadoop berubah** | Jenis perubahan | Deskripsi | | --- | --- | | Backport sumber terbuka Hadoop sejak EMR 5.34.0 | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5350-release.html) | | Perubahan dan perbaikan Hadoop | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5350-release.html) | **Perubahan sarang** | Jenis perubahan | Deskripsi | | --- | --- | | Hive ditingkatkan ke [rilis open source 2.3.9](https://www.mail-archive.com/user@hive.apache.org/msg22311.html), termasuk perbaikan JIRA ini | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5350-release.html) | | Sarang backport sumber terbuka sejak EMR 5.34.0 | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5350-release.html) | | Upgrade dan perbaikan sarang | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5350-release.html) | | Fitur baru | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5350-release.html) | **Perubahan Oozie** | Jenis perubahan | Deskripsi | | --- | --- | | Dukungan sumber terbuka Oozie sejak EMR 5.34.0 | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5350-release.html) | **Babi berubah** | Jenis perubahan | Deskripsi | | --- | --- | | Upgrade | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-5350-release.html) | **Masalah yang diketahui** + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.35.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.15.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.5.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.20.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.7.0 | EMR S3Select Connector | | emrfs | 2.49.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.14.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.14.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.1-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.1-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.1-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.1-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.1-amzn-3 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.1-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.1-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.1-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.1-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.1-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.1-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.9-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.9-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.9-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.9-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.9-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.9-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.9-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.9.0-amzn-2 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.9.0-amzn-2 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.9.0-amzn-2 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.10.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.13.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.8.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68 | Server basis data MySQL. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,26-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,26-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,26-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.8-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 2.4.8-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.8-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.8-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.35.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-5.35.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | Should not be reconfigured. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Restarts HiveServer2 and HiveMetastore. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server. | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server. | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | Restarts EMR record server. | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | Restarts EMR record server. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | Restarts EMR record server. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restarts Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 5.34.0 ## 5.34.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.34.0 | emr-5.33.1 | emr-5.33.0 | emr-5.32.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.970 | 1.11.970 | 1.11.970 | 1.11.890 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.13.1 | 1.12.1 | 1.12.1 | 1.11.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.8-amzn-0 | 2.3.7-amzn-4 | 2.3.7-amzn-4 | 2.3.7-amzn-3 | | Hadoop | 2.10.1-amzn-2 | 2.10.1-amzn-1.1 | 2.10.1-amzn-1 | 2.10.1-amzn-0.1 | | Hive | 2.3.8-amzn-0 | 2.3.7-amzn-4 | 2.3.7-amzn-4 | 2.3.7-amzn-3 | | Hudi | 0.9.0-amzn-0 | 0.7.0-amzn-1 | 0.7.0-amzn-1 | 0.6.0-amzn-0 | | Hue | 4.9.0 | 4.9.0 | 4.9.0 | 4.8.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.4.1 | 1.2.2 | 1.2.2 | 1.1.0 | | Livy | 0.7.1-inkubasi | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.8.0 | 1.7.0 | 1.7.0 | 1.7.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.1 | 5.2.0 | 5.2.0 | 5.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,261-amzn-0 | 0.245.1-amzn-0 | 0.245.1-amzn-0 | 0.240.1-amzn-0 | | Spark | 2.4.8-amzn-0 | 2.4.7-amzn-1.1 | 2.4.7-amzn-1 | 2.4.7-amzn-0.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.4.1 | 2.3.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.10.0 | 0.9.0 | 0.9.0 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.34.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.34.0. Perubahan relatif terhadap 5.33.1. Tanggal rilis awal: 20 Januari 2022 Tanggal rilis diperbarui: 21 Maret 2022 **Fitur Baru** + **[Penskalaan terkelola] Pengoptimalan penskalaan terkelola data acak percikan -** Untuk Amazon EMR versi 5.34.0 dan yang lebih baru, dan EMR versi 6.4.0 dan yang lebih baru, penskalaan terkelola sekarang sadar data acak Spark (data yang didistribusikan ulang Spark di seluruh partisi untuk melakukan operasi tertentu). [Untuk informasi selengkapnya tentang operasi shuffle, lihat [Menggunakan penskalaan terkelola EMR di Amazon](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-scaling.html) EMR di Panduan Manajemen *EMR Amazon* dan Panduan Pemrograman Spark.](https://spark.apache.org/docs/latest/rdd-programming-guide.html#shuffle-operations) + [Hudi] Perbaikan untuk menyederhanakan konfigurasi Hudi. Kontrol konkurensi optimis dinonaktifkan secara default. **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. + Sebelumnya, restart manual pengelola sumber daya pada cluster multi-master menyebabkan daemon on-cluster Amazon EMR, seperti Zookeeper, memuat ulang semua node yang sebelumnya dinonaktifkan atau hilang dalam file znode Zookeeper. Hal ini menyebabkan batas default terlampaui dalam situasi tertentu. Amazon EMR sekarang menghapus catatan node yang dinonaktifkan atau hilang yang lebih tua dari satu jam dari file Zookeeper dan batas internal telah ditingkatkan. + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [PERCIKAN API 29683.](https://issues.apache.org/jira/browse/SPARK-29683) Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG-9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan otentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Zeppelin ditingkatkan ke versi 0.10.0. + Livy Fix - ditingkatkan ke 0.7.1 + Peningkatan kinerja percikan - pelaksana heterogen dinonaktifkan ketika nilai konfigurasi Spark tertentu diganti di EMR 5.34.0. + WebHDFS dan server HTTPFS dinonaktifkan secara default. Anda dapat mengaktifkan kembali WebHDFS menggunakan konfigurasi Hadoop,. `dfs.webhdfs.enabled` Server HTTPFS dapat dimulai dengan menggunakan. `sudo systemctl start hadoop-httpfs` **Masalah yang Diketahui** + Fitur Amazon EMR Notebooks yang digunakan dengan peniruan identitas pengguna Livy tidak berfungsi karena HTTPFS dinonaktifkan secara default. Dalam hal ini, notebook EMR tidak dapat terhubung ke cluster yang mengaktifkan peniruan Livy. Solusinya adalah memulai server HTTPFS sebelum menghubungkan notebook EMR ke cluster menggunakan. `sudo systemctl start hadoop-httpfs` + Kueri Hue tidak berfungsi di Amazon EMR 6.4.0 karena server Apache Hadoop HTTPFS dinonaktifkan secara default. [Untuk menggunakan Hue di Amazon EMR 6.4.0, mulai server HTTPFS secara manual di simpul utama Amazon EMR menggunakan`sudo systemctl start hadoop-httpfs`, atau gunakan langkah EMR Amazon.](https://docs.aws.amazon.com/emr/latest/ManagementGuide/add-step-cli.html) + Fitur Amazon EMR Notebooks yang digunakan dengan peniruan identitas pengguna Livy tidak berfungsi karena HTTPFS dinonaktifkan secara default. Dalam hal ini, notebook EMR tidak dapat terhubung ke cluster yang mengaktifkan peniruan Livy. Solusinya adalah memulai server HTTPFS sebelum menghubungkan notebook EMR ke cluster menggunakan. `sudo systemctl start hadoop-httpfs` + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.34.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.14.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.4.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.18.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.7.0 | EMR S3Select Connector | | emrfs | 2.48.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.13.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.13.1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.1-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.1-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.1-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.1-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.1-amzn-2 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.1-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.1-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.1-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.1-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.1-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.1-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.8-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.8-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.8-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.8-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.8-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.8-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.8-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.9.0-amzn-0 | Kerangka pemrosesan tambahan untuk memberi daya pada pipa data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.9.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.9.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.9.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.4.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.1-inkubasi | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.13.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.8.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68 | Server basis data MySQL. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.1 | Klien baris perintah Oozie. | | oozie-server | 5.2.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,261-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,261-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,261-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.8-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 2.4.8-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.8-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.8-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.10.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.34.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-5.34.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | Should not be reconfigured. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Restarts HiveServer2 and HiveMetastore. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server. | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server. | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | Restarts EMR record server. | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | Restarts EMR record server. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | Restarts EMR record server. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restarts Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 5.33.1 ## 5.33.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.33.1 | emr-5.33.0 | emr-5.32.1 | emr-5.32.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.970 | 1.11.970 | 1.11.890 | 1.11.890 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.12.1 | 1.12.1 | 1.11.2 | 1.11.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.7-amzn-4 | 2.3.7-amzn-4 | 2.3.7-amzn-3 | 2.3.7-amzn-3 | | Hadoop | 2.10.1-amzn-1.1 | 2.10.1-amzn-1 | 2.10.1-amzn-0.1 | 2.10.1-amzn-0 | | Hive | 2.3.7-amzn-4 | 2.3.7-amzn-4 | 2.3.7-amzn-3 | 2.3.7-amzn-3 | | Hudi | 0.7.0-amzn-1 | 0.7.0-amzn-1 | 0.6.0-amzn-0 | 0.6.0-amzn-0 | | Hue | 4.9.0 | 4.9.0 | 4.8.0 | 4.8.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | JupyterHub | 1.2.2 | 1.2.2 | 1.1.0 | 1.1.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.7.0 | 1.7.0 | 1.7.0 | 1.7.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.245.1-amzn-0 | 0.245.1-amzn-0 | 0.240.1-amzn-0 | 0.240.1-amzn-0 | | Spark | 2.4.7-amzn-1.1 | 2.4.7-amzn-1 | 2.4.7-amzn-0.1 | 2.4.7-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.4.1 | 2.3.1 | 2.3.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.9.0 | 0.9.0 | 0.8.2 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.33.1 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.33.0/5.33.1. Perubahan bersifat relatif terhadap 5.32.0. Tanggal rilis awal: 19 April 2021 Terakhir dimutakhirkan tanggal: Agustus 9, 2021 **Upgrade** + Konektor Amazon Glue telah di-upgrade ke versi 1.15.0 + Diupgrade AWS SDK untuk Java ke versi 1.11.970 + EMRFS telah di-upgrade ke versi 2.46.0 + EMR Goodies telah di-upgrade ke versi 2.14.0 + EMR Record Server telah di-upgrade ke versi 1.9.0 + EMR S3 Dist CP telah di-upgrade ke versi 2.18.0 + EMR Secret Agent telah di-upgrade ke versi 1.8.0 + Flink telah di-upgrade ke versi 1.12.1 + Hadoop telah di-upgrade ke versi 2.10.1-amzn-1 + Hive telah di-upgrade ke versi 2.3.7-amzn-4 + Hudi telah di-upgrade ke versi 0.7.0 + Hue telah di-upgrade ke versi 4.9.0 + OpenCV telah di-upgrade ke versi 4.5.0 + Presto telah di-upgrade ke versi 0.245.1-amzn-0 + R telah di-upgrade ke versi 4.0.2 + Spark telah di-upgrade ke versi 2.4.7-amzn-1 + Upgrade TensorFlow ke versi 2.4.1 + Zeppelin telah di-upgrade ke versi 0.9.0 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [PERCIKAN API 29683.](https://issues.apache.org/jira/browse/SPARK-29683) Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG-9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan otentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + **Mengkonfigurasi cluster untuk memperbaiki masalah kinerja Apache YARN Timeline Server versi 1 dan 1.5** Apache YARN Timeline Server versi 1 dan 1.5 dapat menyebabkan masalah kinerja dengan cluster EMR yang sangat aktif dan besar, terutama dengan`yarn.resourcemanager.system-metrics-publisher.enabled=true`, yang merupakan pengaturan default di Amazon EMR. YARN Timeline Server v2 open source memecahkan masalah kinerja yang terkait dengan skalabilitas YARN Timeline Server. Solusi lain untuk masalah ini meliputi: + Mengkonfigurasi yarn.resourcemanager. system-metrics-publisher.enabled=false di yarn-site.xml. + Mengaktifkan perbaikan untuk masalah ini saat membuat cluster, seperti yang dijelaskan di bawah ini. Rilis EMR Amazon berikut berisi perbaikan untuk masalah kinerja Server Timeline YARN ini. EMR 5.30.2, 5.31.1, 5.32.1, 5.33.1, 5.34.x, 6.0.1, 6.1.1, 6.2.1, 6.3.1, 6.4.x [Untuk mengaktifkan perbaikan pada salah satu rilis EMR Amazon yang ditentukan di atas, setel properti ini ke `true` dalam file JSON konfigurasi yang diteruskan menggunakan parameter perintah:. `aws emr create-cluster`](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps-create-cluster.html) `--configurations file://./configurations.json` Atau aktifkan perbaikan menggunakan [UI konsol konfigurasi ulang](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps-running-cluster.html). Contoh isi file configurations.json: ``` [ { "Classification": "yarn-site", "Properties": { "yarn.resourcemanager.system-metrics-publisher.timeline-server-v1.enable-batch": "true", "yarn.resourcemanager.system-metrics-publisher.enabled": "true" }, "Configurations": [] } ] ``` + Spark runtime sekarang lebih cepat saat mengambil lokasi partisi dari Hive Metastore untuk kueri sisipan Spark. + Versi komponen yang telah ditingkatkan. Untuk daftar versi komponen, lihat [Tentang Rilis Amazon EMR](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-components.html) dalam panduan ini. + Menginstal AWS Java SDK Bundle pada setiap cluster baru. Ini adalah toples tunggal yang berisi semua layanan SDKs dan dependensinya, bukan stoples komponen individual. Untuk informasi selengkapnya, lihat [Java SDK Bundled](https://aws.amazon.com/blogs/developer/java-sdk-bundle/) Dependency. + Memperbaiki masalah Penskalaan Terkelola dalam rilis EMR Amazon sebelumnya dan melakukan peningkatan sehingga tingkat kegagalan aplikasi berkurang secara signifikan. + HTTPS sekarang diaktifkan secara default untuk repositori Amazon Linux. Jika Anda menggunakan kebijakan Amazon S3 VPCE untuk membatasi akses ke bucket tertentu, Anda harus menambahkan ARN bucket Amazon Linux baru `arn:aws:s3:::amazonlinux-2-repos-$region/*` ke kebijakan Anda (ganti `$region` dengan wilayah tempat titik akhir berada). Untuk informasi lebih lanjut, lihat topik ini di forum AWS diskusi. [Pengumuman: Amazon Linux 2 sekarang mendukung kemampuan untuk menggunakan HTTPS saat menghubungkan ke repositori paket](https://forums.aws.amazon.com/ann.jspa?annID=8528). **Fitur baru** + Amazon EMR mendukung Poin Akses Amazon S3, fitur Amazon S3 yang memungkinkan Anda mengelola akses untuk danau data bersama dengan mudah. Dengan menggunakan alias Titik Akses Amazon S3, Anda dapat menyederhanakan akses data dalam skala besar di Amazon EMR. Anda dapat menggunakan Titik Akses Amazon S3 dengan semua versi Amazon EMR tanpa biaya tambahan di semua wilayah di mana AWS Amazon EMR tersedia. *Untuk mempelajari selengkapnya tentang Alias Titik Akses Amazon S3 dan Titik Akses, lihat [Menggunakan alias gaya ember untuk titik akses Anda di Panduan Pengguna](https://docs.aws.amazon.com/AmazonS3/latest/userguide/access-points-alias.html) Amazon S3.* + Amazon EMR-5.33 mendukung tipe instans Amazon EC2 baru: c5a, c5ad, c6gn, c6gd, m6gd, d3, d3en, m5zn, r5b, r6gd. Lihat [Tipe Instans yang Di-Support](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-supported-instance-types.html). **Masalah yang diketahui** + **Turunkan batas “Maks open files” pada yang lebih lama AL2 [diperbaiki dalam rilis yang lebih baru].** Rilis Amazon EMR: emr-5.30.x, emr-5.31.0, emr-5.32.0, emr-6.0.0, emr-6.1.0, dan emr-6.2.0 didasarkan pada versi lama dari Amazon Linux 2 (), yang memiliki pengaturan ulimit yang lebih rendah untuk “File terbuka maksimum” ketika kluster Amazon EMR dibuat dengan AMI default. AL2 Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. Rilis dengan batas file terbuka yang lebih rendah menyebabkan kesalahan “Terlalu banyak file terbuka” saat mengirimkan pekerjaan Spark. Dalam rilis yang terkena dampak, AMI default Amazon EMR memiliki pengaturan ulimit default 4096 untuk “File terbuka maksimum,” yang lebih rendah dari batas file 65536 di AMI Amazon Linux 2 terbaruAmazon. Pengaturan ulimit yang lebih rendah untuk "Maksimal file terbuka" menyebabkan kegagalan tugas Spark ketika driver dan pelaksana mencoba untuk membuka lebih dari 4096 file. Untuk memperbaiki masalah, Amazon EMR memiliki skrip tindakan bootstrap (BA) yang menyesuaikan pengaturan ulimit saat pembuatan klaster. Jika Anda menggunakan versi EMR Amazon yang lebih lama yang tidak memiliki perbaikan permanen untuk masalah ini, solusi berikut memungkinkan Anda untuk secara eksplisit mengatur ulimit pengontrol instans ke maksimum 65536 file. **Mengatur secara eksplisit ulimit dari baris perintah** 1. Edit `/etc/systemd/system/instance-controller.service` untuk menambahkan parameter berikut ke bagian Layanan. `LimitNOFILE=65536` `LimitNPROC=65536` 1. Mulai ulang InstanceController `$ sudo systemctl daemon-reload` `$ sudo systemctl restart instance-controller` **Tetapkan ulimit menggunakan tindakan bootstrap (BA)** Anda juga dapat menggunakan skrip tindakan bootstrap (BA) untuk mengkonfigurasi ulimit instans-pengendali menjadi 65536 file saat pembuatan klaster. ``` #!/bin/bash for user in hadoop spark hive; do sudo tee /etc/security/limits.d/$user.conf << EOF $user - nofile 65536 $user - nproc 65536 EOF done for proc in instancecontroller logpusher; do sudo mkdir -p /etc/systemd/system/$proc.service.d/ sudo tee /etc/systemd/system/$proc.service.d/override.conf << EOF [Service] LimitNOFILE=65536 LimitNPROC=65536 EOF pid=$(pgrep -f aws157.$proc.Main) sudo prlimit --pid $pid --nofile=65535:65535 --nproc=65535:65535 done sudo systemctl daemon-reload ``` + Untuk Amazon EMR 6.3.0 dan 6.2.0 kluster subnet pribadi, Anda tidak dapat mengakses UI web Ganglia. Anda akan mendapatkan pesan kesalahan "akses ditolak (403)". Web lain UIs, seperti Spark, Hue,, Zeppelin JupyterHub, Livy, dan Tez bekerja secara normal. Akses UI web Ganglia pada klaster subnet publik juga bekerja secara normal. Untuk mengatasi masalah ini, mulai ulang layanan httpd pada node utama dengan`sudo systemctl restart httpd`. Masalah ini diperbaiki di Amazon EMR 6.4.0. + **penting** Cluster EMR yang menjalankan Amazon Linux atau Amazon Linux 2 Amazon Machine Images (AMI) menggunakan perilaku default Amazon Linux, dan tidak secara otomatis mengunduh dan menginstal pembaruan kernel penting dan kritis yang memerlukan reboot. Ini adalah perilaku yang sama dengan instans Amazon EC2 lainnya yang menjalankan AMI Amazon Linux default. Jika pembaruan perangkat lunak Amazon Linux baru yang memerlukan reboot (seperti pembaruan kernel, NVIDIA, dan CUDA) tersedia setelah rilis EMR Amazon tersedia, instance cluster EMR yang menjalankan AMI default tidak secara otomatis mengunduh dan menginstal pembaruan tersebut. Untuk mendapatkan pembaruan kernel, Anda dapat [menyesuaikan Amazon EMR AMI](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-custom-ami.html) menjadi [gunakan Amazon Linux AMI terbaru](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/finding-an-ami.html). + Dukungan konsol untuk membuat konfigurasi keamanan yang menentukan opsi integrasi AWS Ranger saat ini tidak didukung di GovCloud Wilayah. Konfigurasi keamanan dapat dilakukan dengan menggunakan CLI. Lihat [Membuat Konfigurasi Keamanan EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-ranger-security-config.html) di *Panduan Pengelolaan Amazon EMR*. + Kebijakan terkelola cakupan: Untuk menyelaraskan dengan praktik AWS terbaik, Amazon EMR telah memperkenalkan kebijakan terkelola default cakupan EMR v2 sebagai pengganti kebijakan yang tidak digunakan lagi. Lihat [Kebijakan Terkelola Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-iam-policies.html). + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.33.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.14.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.2.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.18.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.6.0 | EMR S3Select Connector | | emrfs | 2.46.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.12.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.12.1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.1-amzn-1.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.1-amzn-1.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.1-amzn-1.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.1-amzn-1.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.1-amzn-1.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.1-amzn-1.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.1-amzn-1.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.1-amzn-1.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.1-amzn-1.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.1-amzn-1.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.1-amzn-1.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.7-amzn-4 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.7-amzn-4 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.7-amzn-4 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.7-amzn-4 | Klien baris perintah Hive. | | hive-hbase | 2.3.7-amzn-4 | Klien Hive-hbase. | | hive-metastore-server | 2.3.7-amzn-4 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.7-amzn-4 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.7.0-amzn-1 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.7.0-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.7.0-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.9.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.2.2 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.7.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MySQL. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.245.1-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.245.1-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.245.1-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.7-amzn-1.1 | Klien baris perintah Spark. | | spark-history-server | 2.4.7-amzn-1.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.7-amzn-1.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.7-amzn-1.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.33.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-5.33.1** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | Should not be reconfigured. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Restarts HiveServer2 and HiveMetastore. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server. | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server. | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | Restarts EMR record server. | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | Restarts EMR record server. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | Restarts EMR record server. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restarts Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 5.33.0 ## 5.33.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.33.0 | emr-5.32.1 | emr-5.32.0 | emr-5.31.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.970 | 1.11.890 | 1.11.890 | 1.11.852 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.12.1 | 1.11.2 | 1.11.2 | 1.11.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.7-amzn-4 | 2.3.7-amzn-3 | 2.3.7-amzn-3 | 2.3.7-amzn-1 | | Hadoop | 2.10.1-amzn-1 | 2.10.1-amzn-0.1 | 2.10.1-amzn-0 | 2.10.0-amzn-0.1 | | Hive | 2.3.7-amzn-4 | 2.3.7-amzn-3 | 2.3.7-amzn-3 | 2.3.7-amzn-1 | | Hudi | 0.7.0-amzn-1 | 0.6.0-amzn-0 | 0.6.0-amzn-0 | 0.6.0-amzn-0 | | Hue | 4.9.0 | 4.8.0 | 4.8.0 | 4.7.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | 2.1.0 | - | | JupyterHub | 1.2.2 | 1.1.0 | 1.1.0 | 1.1.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.7.0 | 1.7.0 | 1.7.0 | 1.6.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.245.1-amzn-0 | 0.240.1-amzn-0 | 0.240.1-amzn-0 | 0.238.3-amzn-0 | | Spark | 2.4.7-amzn-1 | 2.4.7-amzn-0.1 | 2.4.7-amzn-0 | 2.4.6-amzn-0.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.4.1 | 2.3.1 | 2.3.1 | 2.1.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.9.0 | 0.8.2 | 0.8.2 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan rilis 5.33.0 ## 5.33.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.14.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.2.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.18.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.6.0 | EMR S3Select Connector | | emrfs | 2.46.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.12.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.12.1 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.1-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.1-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.1-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.1-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.1-amzn-1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.1-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.1-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.1-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.1-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.1-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.1-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.7-amzn-4 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.7-amzn-4 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.7-amzn-4 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.7-amzn-4 | Klien baris perintah Hive. | | hive-hbase | 2.3.7-amzn-4 | Klien Hive-hbase. | | hive-metastore-server | 2.3.7-amzn-4 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.7-amzn-4 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.7.0-amzn-1 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.7.0-amzn-1 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.7.0-amzn-1 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.9.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.2.2 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.7.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68 | Server basis data MySQL. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.5.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.245.1-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.245.1-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.245.1-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 4.0.2 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.7-amzn-1 | Klien baris perintah Spark. | | spark-history-server | 2.4.7-amzn-1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.7-amzn-1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.7-amzn-1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.4.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.9.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.33.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-5.33.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-session | Ubah pengaturan Flink log4j-session.properties untuk sesi. Kubernetes/Yarn | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | Should not be reconfigured. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Restarts HiveServer2 and HiveMetastore. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server. | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server. | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | Restarts EMR record server. | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | Restarts EMR record server. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | Restarts EMR record server. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restarts Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zeppelin-site | Ubah pengaturan konfigurasi di zeppelin-site.xml. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 5.32.1 ## 5.32.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.32.1 | emr-5.32.0 | emr-5.31.1 | emr-5.31.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.890 | 1.11.890 | 1.11.852 | 1.11.852 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.2 | 1.11.2 | 1.11.0 | 1.11.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.7-amzn-3 | 2.3.7-amzn-3 | 2.3.7-amzn-1 | 2.3.7-amzn-1 | | Hadoop | 2.10.1-amzn-0.1 | 2.10.1-amzn-0 | 2.10.0-amzn-0.1 | 2.10.0-amzn-0 | | Hive | 2.3.7-amzn-3 | 2.3.7-amzn-3 | 2.3.7-amzn-1 | 2.3.7-amzn-1 | | Hudi | 0.6.0-amzn-0 | 0.6.0-amzn-0 | 0.6.0-amzn-0 | 0.6.0-amzn-0 | | Hue | 4.8.0 | 4.8.0 | 4.7.1 | 4.7.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | 2.1.0 | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.7.0 | 1.7.0 | 1.6.0 | 1.6.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.240.1-amzn-0 | 0.240.1-amzn-0 | 0.238.3-amzn-0 | 0.238.3-amzn-0 | | Spark | 2.4.7-amzn-0.1 | 2.4.7-amzn-0 | 2.4.6-amzn-0.1 | 2.4.6-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.3.1 | 2.3.1 | 2.1.0 | 2.1.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.32.1 Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [PERCIKAN API 29683.](https://issues.apache.org/jira/browse/SPARK-29683) Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG-9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan otentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + HTTPS sekarang diaktifkan secara default untuk repositori Amazon Linux. Jika Anda menggunakan kebijakan Amazon S3 VPCE untuk membatasi akses ke bucket tertentu, Anda harus menambahkan ARN bucket Amazon Linux baru `arn:aws:s3:::amazonlinux-2-repos-$region/*` ke kebijakan Anda (ganti `$region` dengan wilayah tempat titik akhir berada). Untuk informasi lebih lanjut, lihat topik ini di forum AWS diskusi. [Pengumuman: Amazon Linux 2 sekarang mendukung kemampuan untuk menggunakan HTTPS saat menghubungkan ke repositori paket](https://forums.aws.amazon.com/ann.jspa?annID=8528). **Masalah yang diketahui** + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.32.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.13.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.1.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.17.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.6.0 | EMR S3Select Connector | | emrfs | 2.45.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.11.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.11.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.1-amzn-0.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.1-amzn-0.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.1-amzn-0.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.1-amzn-0.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.1-amzn-0.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.1-amzn-0.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.1-amzn-0.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.1-amzn-0.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.1-amzn-0.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.1-amzn-0.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.1-amzn-0.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.7-amzn-3 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.7-amzn-3 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.7-amzn-3 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.7-amzn-3 | Klien baris perintah Hive. | | hive-hbase | 2.3.7-amzn-3 | Klien Hive-hbase. | | hive-metastore-server | 2.3.7-amzn-3 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.7-amzn-3 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.6.0-amzn-0 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.6.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.6.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.8.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.7.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68\$1 | Server basis data MySQL. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.240.1-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.240.1-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.240.1-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.7-amzn-0.1 | Klien baris perintah Spark. | | spark-history-server | 2.4.7-amzn-0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.7-amzn-0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.7-amzn-0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.3.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.32.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-5.32.1** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | Should not be reconfigured. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Restarts HiveServer2 and HiveMetastore. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server. | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server. | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | Restarts EMR record server. | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | Restarts EMR record server. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | Restarts EMR record server. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restarts Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 5.32.0 ## 5.32.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyter-enterprise-gateway.readthedocs.io/en/latest/](https://jupyter-enterprise-gateway.readthedocs.io/en/latest/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.32.0 | emr-5.31.1 | emr-5.31.0 | emr-5.30.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.890 | 1.11.852 | 1.11.852 | 1.11.759 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.2 | 1.11.0 | 1.11.0 | 1.10.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.7-amzn-3 | 2.3.7-amzn-1 | 2.3.7-amzn-1 | 2.3.6-amzn-2 | | Hadoop | 2.10.1-amzn-0 | 2.10.0-amzn-0.1 | 2.10.0-amzn-0 | 2.8.5-amzn-6.1 | | Hive | 2.3.7-amzn-3 | 2.3.7-amzn-1 | 2.3.7-amzn-1 | 2.3.6-amzn-2 | | Hudi | 0.6.0-amzn-0 | 0.6.0-amzn-0 | 0.6.0-amzn-0 | 0.5.2-incubating | | Hue | 4.8.0 | 4.7.1 | 4.7.1 | 4.6.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | 2.1.0 | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.7.0 | 1.6.0 | 1.6.0 | 1.5.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.240.1-amzn-0 | 0.238.3-amzn-0 | 0.238.3-amzn-0 | 0,232 | | Spark | 2.4.7-amzn-0 | 2.4.6-amzn-0.1 | 2.4.6-amzn-0 | 2.4.5-amzn-0.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.3.1 | 2.1.0 | 2.1.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.32.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.32.0. Perubahan bersifat relatif terhadap 5.31.0. Tanggal rilis awal: 8 Januari 2021 **Upgrade** + Konektor Amazon Glue telah di-upgrade ke versi 1.14.0 + Upgrade Amazon SageMaker Spark SDK ke versi 1.4.1 + Diupgrade AWS SDK untuk Java ke versi 1.11.890 + EMR DynamoDB Connector telah di-upgrade ke versi 4.16.0 + EMRFS telah di-upgrade ke versi 2.45.0 + EMR Log Analytics Metrics telah di-upgrade ke versi 1.18.0 + Klien MetricsAndEventsApiGateway EMR yang ditingkatkan ke versi 1.5.0 + EMR Record Server telah di-upgrade ke versi 1.8.0 + EMR S3 Dist CP telah di-upgrade ke versi 2.17.0 + EMR Secret Agent telah di-upgrade ke versi 1.7.0 + Flink telah di-upgrade ke versi 1.11.2 + Hadoop telah di-upgrade ke versi 2.10.1-amzn-0 + Hive telah di-upgrade ke versi 2.3.7-amzn-3 + Hue telah di-upgrade ke versi 4.8.0 + Mxnet telah di-upgrade ke versi 1.7.0 + OpenCV telah di-upgrade ke versi 4.4.0 + Presto telah di-upgrade ke versi 0.240.1-amzn-0 + Spark telah di-upgrade ke versi 2.4.7-amzn-0 + Upgrade TensorFlow ke versi 2.3.1 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [PERCIKAN API 29683.](https://issues.apache.org/jira/browse/SPARK-29683) Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG-9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan otentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + Versi komponen yang telah ditingkatkan. + Untuk daftar versi komponen, lihat [Tentang Rilis Amazon EMR](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-components.html) dalam panduan ini. **Fitur baru** + Dimulai dengan Amazon EMR 5.32.0 dan 6.5.0, ukuran pelaksana dinamis untuk Apache Spark diaktifkan secara default. Untuk mengaktifkan atau menonaktifkan fitur ini, Anda dapat menggunakan parameter `spark.yarn.heterogeneousExecutors.enabled` konfigurasi. + Status dukungan Instance Metadata Service (IMDS) V2: Amazon EMR 5.23.1, 5.27.1 dan 5.32 atau komponen yang lebih baru digunakan untuk semua panggilan IMDS. IMDSv2 Untuk panggilan IMDS dalam kode aplikasi Anda, Anda dapat menggunakan keduanya IMDSv1 dan IMDSv2, atau mengkonfigurasi IMDS untuk digunakan hanya IMDSv2 untuk keamanan tambahan. Untuk rilis EMR 5.x lainnya, IMDSv1 penonaktifan menyebabkan kegagalan startup cluster. + Dimulai dengan Amazon EMR 5.32.0, Anda dapat meluncurkan sebuah klaster yang terintegrasi secara asli dengan Apache Ranger. Apache Ranger adalah kerangka kerja sumber terbuka untuk mengaktifkan, memantau, dan mengelola keamanan data komprehensif di seluruh platform Hadoop. Untuk informasi selengkapnya, lihat [Apache Ranger](https://ranger.apache.org/). Dengan integrasi asli, Anda dapat membawa Apache Ranger Anda sendiri untuk memberlakukan kendali akses data halus di Amazon EMR. Lihat [Mengintegrasikan Amazon EMR dengan Apache Ranger](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-ranger.html) di *Panduan Rilis Amazon EMR*. + Amazon EMR Rilis 5.32.0 mendukung Amazon EMR di EKS. Untuk rincian lebih lanjut tentang memulai dengan EMR pada EKS, lihat [Apa itu Amazon EMR di EKS](https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks.html). + Amazon EMR Rilis 5.32.0 mendukung Amazon EMR Studio (Pratinjau). Untuk detail lebih lanjut tentang memulai EMR Studio, lihat [Amazon EMR Studio (Pratinjau)](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-studio.html). + Kebijakan terkelola cakupan: Untuk menyelaraskan dengan praktik AWS terbaik, Amazon EMR telah memperkenalkan kebijakan terkelola default cakupan EMR v2 sebagai pengganti kebijakan yang tidak digunakan lagi. Lihat [Kebijakan Terkelola Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-iam-policies.html). **Masalah yang diketahui** + Untuk Amazon EMR 6.3.0 dan 6.2.0 kluster subnet pribadi, Anda tidak dapat mengakses UI web Ganglia. Anda akan mendapatkan pesan kesalahan "akses ditolak (403)". Web lain UIs, seperti Spark, Hue,, Zeppelin JupyterHub, Livy, dan Tez bekerja secara normal. Akses UI web Ganglia pada klaster subnet publik juga bekerja secara normal. Untuk mengatasi masalah ini, mulai ulang layanan httpd pada node utama dengan`sudo systemctl restart httpd`. Masalah ini diperbaiki di Amazon EMR 6.4.0. + **Turunkan batas “Maks open files” pada yang lebih lama AL2 [diperbaiki dalam rilis yang lebih baru].** Rilis Amazon EMR: emr-5.30.x, emr-5.31.0, emr-5.32.0, emr-6.0.0, emr-6.1.0, dan emr-6.2.0 didasarkan pada versi lama dari Amazon Linux 2 (), yang memiliki pengaturan ulimit yang lebih rendah untuk “File terbuka maksimum” ketika kluster Amazon EMR dibuat dengan AMI default. AL2 Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. Rilis dengan batas file terbuka yang lebih rendah menyebabkan kesalahan “Terlalu banyak file terbuka” saat mengirimkan pekerjaan Spark. Dalam rilis yang terkena dampak, AMI default Amazon EMR memiliki pengaturan ulimit default 4096 untuk “File terbuka maksimum,” yang lebih rendah dari batas file 65536 di AMI Amazon Linux 2 terbaruAmazon. Pengaturan ulimit yang lebih rendah untuk "Maksimal file terbuka" menyebabkan kegagalan tugas Spark ketika driver dan pelaksana mencoba untuk membuka lebih dari 4096 file. Untuk memperbaiki masalah, Amazon EMR memiliki skrip tindakan bootstrap (BA) yang menyesuaikan pengaturan ulimit saat pembuatan klaster. Jika Anda menggunakan versi EMR Amazon yang lebih lama yang tidak memiliki perbaikan permanen untuk masalah ini, solusi berikut memungkinkan Anda untuk secara eksplisit mengatur ulimit pengontrol instans ke maksimum 65536 file. **Mengatur secara eksplisit ulimit dari baris perintah** 1. Edit `/etc/systemd/system/instance-controller.service` untuk menambahkan parameter berikut ke bagian Layanan. `LimitNOFILE=65536` `LimitNPROC=65536` 1. Mulai ulang InstanceController `$ sudo systemctl daemon-reload` `$ sudo systemctl restart instance-controller` **Tetapkan ulimit menggunakan tindakan bootstrap (BA)** Anda juga dapat menggunakan skrip tindakan bootstrap (BA) untuk mengkonfigurasi ulimit instans-pengendali menjadi 65536 file saat pembuatan klaster. ``` #!/bin/bash for user in hadoop spark hive; do sudo tee /etc/security/limits.d/$user.conf << EOF $user - nofile 65536 $user - nproc 65536 EOF done for proc in instancecontroller logpusher; do sudo mkdir -p /etc/systemd/system/$proc.service.d/ sudo tee /etc/systemd/system/$proc.service.d/override.conf << EOF [Service] LimitNOFILE=65536 LimitNPROC=65536 EOF pid=$(pgrep -f aws157.$proc.Main) sudo prlimit --pid $pid --nofile=65535:65535 --nproc=65535:65535 done sudo systemctl daemon-reload ``` + **penting** Cluster EMR yang menjalankan Amazon Linux atau Amazon Linux 2 Amazon Machine Images (AMI) menggunakan perilaku default Amazon Linux, dan tidak secara otomatis mengunduh dan menginstal pembaruan kernel penting dan kritis yang memerlukan reboot. Ini adalah perilaku yang sama dengan instans Amazon EC2 lainnya yang menjalankan AMI Amazon Linux default. Jika pembaruan perangkat lunak Amazon Linux baru yang memerlukan reboot (seperti pembaruan kernel, NVIDIA, dan CUDA) tersedia setelah rilis EMR Amazon tersedia, instance cluster EMR yang menjalankan AMI default tidak secara otomatis mengunduh dan menginstal pembaruan tersebut. Untuk mendapatkan pembaruan kernel, Anda dapat [menyesuaikan Amazon EMR AMI](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-custom-ami.html) menjadi [gunakan Amazon Linux AMI terbaru](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/finding-an-ami.html). + Dukungan konsol untuk membuat konfigurasi keamanan yang menentukan opsi integrasi AWS Ranger saat ini tidak didukung di GovCloud Wilayah. Konfigurasi keamanan dapat dilakukan dengan menggunakan CLI. Lihat [Membuat Konfigurasi Keamanan EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-ranger-security-config.html) di *Panduan Pengelolaan Amazon EMR*. + Saat AtRestEncryption enkripsi HDFS diaktifkan pada klaster yang menggunakan Amazon EMR 5.31.0 atau 5.32.0, kueri Hive menghasilkan pengecualian runtime berikut. ``` TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) : attempt_1604112648850_0001_1_01_000000_3:java.lang.RuntimeException: java.lang.RuntimeException: Hive Runtime Error while closing operators: java.io.IOException: java.util.ServiceConfigurationError: org.apache.hadoop.security.token.TokenIdentifier: Provider org.apache.hadoop.hbase.security.token.AuthenticationTokenIdentifier not found ``` + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.32.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.16.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.13.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.1.0 | Conda env untuk emr notebook yang mencakup gateway jupyter korporasi | | emr-s3-dist-cp | 2.17.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.6.0 | EMR S3Select Connector | | emrfs | 2.45.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.11.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.11.2 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.1-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.1-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.1-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.1-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.1-amzn-0 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.1-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.1-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.1-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.1-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.1-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.1-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.7-amzn-3 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.7-amzn-3 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.7-amzn-3 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.7-amzn-3 | Klien baris perintah Hive. | | hive-hbase | 2.3.7-amzn-3 | Klien Hive-hbase. | | hive-metastore-server | 2.3.7-amzn-3 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.7-amzn-3 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.6.0-amzn-0 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.6.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.6.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.8.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.7.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.68 | Server basis data MySQL. | | nvidia-cuda | 10.1.243 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.240.1-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.240.1-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.240.1-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.7-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 2.4.7-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.7-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.7-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.3.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.32.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Tindakan konfigurasi ulang terjadi ketika Anda menentukan konfigurasi untuk grup instans di klaster yang sedang berjalan. Amazon EMR hanya memulai tindakan konfigurasi ulang untuk klasifikasi yang Anda modifikasi. Untuk informasi selengkapnya, lihat [Lakukan konfigurasi ulang pada grup instans di klaster yang sedang berjalan](emr-configure-apps-running-cluster.md). **klasifikasi emr-5.32.0** | Klasifikasi | Deskripsi | Tindakan Konfigurasi Ulang | | --- | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | Restarts the ResourceManager service. | | container-executor | Ubah nilai dalam file container-executor.cfg Hadoop YARN ini. | Not available. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | Not available. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Ranger KMS, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | docker-conf | Ubah pengaturan terkait docker. | Not available. | | emrfs-site | Ubah pengaturan EMRFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts HBaseRegionserver, HBaseMaster, HBaseThrift, HBaseRest, HiveServer2, Hive MetaStore, Hadoop Httpfs, and MapReduce-HistoryServer. | | flink-conf | Ubah pengaturan flink-conf.yaml. | Restarts Flink history server. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | Restarts Flink history server. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | Not available. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | Restarts Flink history server. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts PhoenixQueryserver, HiveServer2, Hive MetaStore, and MapReduce-HistoryServer. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Hadoop KMS, Hadoop Httpfs, and MapReduce-HistoryServer. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | Not available. | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | Not available. | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | Custom EMR specific property. Sets emrfs-site and hbase-site configs. See those for their associated restarts. | | hbase-env | Ubah nilai HBase di lingkungan. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | Not available. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | Restarts the HBase services RegionServer, HBaseMaster, ThriftServer, RestServer. Additionally restarts Phoenix QueryServer. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | Should not be reconfigured. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | Restarts the Hadoop HDFS services Namenode, SecondaryNamenode, Datanode, ZKFC, and Journalnode. Additionally restarts Hadoop Httpfs. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | Restarts Hive HCatalog Server. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | Restarts Hive HCatalog Server. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | Restarts Hive HCatalog Server. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | Restarts Hive WebHCat Server. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | Restarts Hive WebHCat Server. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | Not available. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | Not available. | | hive-env | Ubah nilai dalam lingkungan Hive. | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | Restarts HiveServer2 and HiveMetastore. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | Not available. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | Not available. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | Restarts HiveServer2 and HiveMetastore. Runs Hive schemaTool CLI commands to verify hive-metastore. Also restarts Oozie and Zeppelin. | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | Not available. | | hue-ini | Ubah nilai dalam file ini Hue | Restarts Hue. Also activates Hue config override CLI commands to pick up new configurations. | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | Restarts Hadoop Httpfs service. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | Restarts Hadoop Httpfs service. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | Not available. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | Restarts Hadoop-KMS service. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | Not available. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | Restarts Hadoop-KMS and Ranger-KMS service. | | hudi-env | Ubah nilai di lingkungan Hudi. | Not available. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | Not available. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | Not available. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | Not available. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | Not available. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | Restarts Livy Server. | | livy-env | Ubah nilai di lingkungan Livy. | Restarts Livy Server. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | Restarts Livy Server. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | Restarts Hadoop MapReduce-HistoryServer. | | oozie-env | Ubah nilai di lingkungan Oozie. | Restarts Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | Restarts Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | Restarts Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | Not available. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | Not available. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | Restarts Phoenix-QueryServer. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | Not available. | | pig-env | Ubah nilai di lingkungan Pig. | Not available. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | Restarts Oozie. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | Not available. | | presto-log | Ubah nilai dalam file log.properties Presto. | Restarts Presto-Server. | | presto-config | Ubah nilai dalam file config.properties Presto. | Restarts Presto-Server. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | Not available. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | Restarts Presto-Server. | | presto-node | Ubah nilai dalam file node.properties Presto. | Not available. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | Not available. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | Not available. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | Restarts Presto-Server. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | Not available. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | Not available. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | Not available. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | Not available. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | Not available. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | Not available. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | Not available. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | Not available. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | Not available. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | Not available. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | Not available. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | Not available. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | Restarts Ranger KMS Server. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | Not available. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | Not available. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | Restarts EMR record server. | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | Restarts EMR record server. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | Restarts EMR record server. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | This property modifies spark-defaults. See actions there. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | Restarts Spark history server and Spark thrift server. | | spark-env | Ubah nilai di lingkungan Spark. | Restarts Spark history server and Spark thrift server. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | Not available. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | Restarts Spark history server and Spark thrift server. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | Restarts Spark history server and Spark thrift server. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | Not available. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | Not available. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | Not available. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | Restarts Oozie. | | yarn-env | Ubah nilai di lingkungan YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts MapReduce-HistoryServer. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | Restarts the Hadoop YARN services ResourceManager, NodeManager, ProxyServer, and TimelineServer. Additionally restarts Livy Server and MapReduce-HistoryServer. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | Restarts Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | Restarts Zookeeper server. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | Restarts Zookeeper server. | # Amazon EMR rilis 5.31.1 ## 5.31.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.31.1 | emr-5.31.0 | emr-5.30.2 | emr-5.30.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.852 | 1.11.852 | 1.11.759 | 1.11.759 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.0 | 1.11.0 | 1.10.0 | 1.10.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.7-amzn-1 | 2.3.7-amzn-1 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | | Hadoop | 2.10.0-amzn-0.1 | 2.10.0-amzn-0 | 2.8.5-amzn-6.1 | 2.8.5-amzn-6 | | Hive | 2.3.7-amzn-1 | 2.3.7-amzn-1 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | | Hudi | 0.6.0-amzn-0 | 0.6.0-amzn-0 | 0.5.2-incubating | 0.5.2-incubating | | Hue | 4.7.1 | 4.7.1 | 4.6.0 | 4.6.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.6.0 | 1.6.0 | 1.5.1 | 1.5.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.238.3-amzn-0 | 0.238.3-amzn-0 | 0,232 | 0,232 | | Spark | 2.4.6-amzn-0.1 | 2.4.6-amzn-0 | 2.4.5-amzn-0.1 | 2.4.5-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.1.0 | 2.1.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.31.1 Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [PERCIKAN API 29683.](https://issues.apache.org/jira/browse/SPARK-29683) Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG-9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan otentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + HTTPS sekarang diaktifkan secara default untuk repositori Amazon Linux. Jika Anda menggunakan kebijakan Amazon S3 VPCE untuk membatasi akses ke bucket tertentu, Anda harus menambahkan ARN bucket Amazon Linux baru `arn:aws:s3:::amazonlinux-2-repos-$region/*` ke kebijakan Anda (ganti `$region` dengan wilayah tempat titik akhir berada). Untuk informasi lebih lanjut, lihat topik ini di forum AWS diskusi. [Pengumuman: Amazon Linux 2 sekarang mendukung kemampuan untuk menggunakan HTTPS saat menghubungkan ke repositori paket](https://forums.aws.amazon.com/ann.jspa?annID=8528). **Masalah yang diketahui** + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.31.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.15.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.13.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.15.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.6.0 | EMR S3Select Connector | | emrfs | 2.43.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.11.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.11.0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.0-amzn-0.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.0-amzn-0.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.0-amzn-0.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.0-amzn-0.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.0-amzn-0.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.0-amzn-0.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.0-amzn-0.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.0-amzn-0.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.0-amzn-0.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.0-amzn-0.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.0-amzn-0.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.7-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.7-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.7-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.7-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.7-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.7-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.7-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.6.0-amzn-0 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.6.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.6.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.7.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.6.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.3.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.238.3-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.238.3-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.238.3-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.6-amzn-0.1 | Klien baris perintah Spark. | | spark-history-server | 2.4.6-amzn-0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.6-amzn-0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.6-amzn-0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.1.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.31.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.31.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | hudi-env | Ubah nilai di lingkungan Hudi. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.31.0 ## 5.31.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.31.0 | emr-5.30.2 | emr-5.30.1 | emr-5.30.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.852 | 1.11.759 | 1.11.759 | 1.11.759 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.11.0 | 1.10.0 | 1.10.0 | 1.10.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.13 | | HCatalog | 2.3.7-amzn-1 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | | Hadoop | 2.10.0-amzn-0 | 2.8.5-amzn-6.1 | 2.8.5-amzn-6 | 2.8.5-amzn-6 | | Hive | 2.3.7-amzn-1 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | | Hudi | 0.6.0-amzn-0 | 0.5.2-incubating | 0.5.2-incubating | 0.5.2-incubating | | Hue | 4.7.1 | 4.6.0 | 4.6.0 | 4.6.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | | MXNet | 1.6.0 | 1.5.1 | 1.5.1 | 1.5.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.0 | 5.2.0 | 5.2.0 | 5.2.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.238.3-amzn-0 | 0,232 | 0,232 | 0,232 | | Spark | 2.4.6-amzn-0 | 2.4.5-amzn-0.1 | 2.4.5-amzn-0 | 2.4.5-amzn-0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 2.1.0 | 1.14.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.31.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.31.0. Perubahan bersifat relatif terhadap 5.30.1. Tanggal rilis awal: 9 Oktober 2020 Tanggal terakhir diperbarui: 15 Oktober 2020 **Upgrade** + Konektor Amazon Glue telah di-upgrade ke versi 1.13.0 + Upgrade Amazon SageMaker Spark SDK ke versi 1.4.0 + Konektor Amazon Kinesis telah di-upgrade ke versi 3.5.9 + Diupgrade AWS SDK untuk Java ke versi 1.11.852 + Bigtop-tomcat telah di-upgrade ke versi 8.5.56 + EMR FS telah di-upgrade ke versi 2.43.0 + Klien MetricsAndEventsApiGateway EMR yang ditingkatkan ke versi 1.4.0 + EMR S3 Dist CP telah di-upgrade ke versi 2.15.0 + EMR S3 Select telah di-upgrade ke versi 1.6.0 + Flink telah di-upgrade ke versi 1.11.0 + Hadoop telah di-upgrade ke versi 2.10.0 + Hive telah di-upgrade ke versi 2.3.7 + Hudi telah di-upgrade ke versi 0.6.0 + Hue telah di-upgrade ke versi 4.7.1 + Upgrade JupyterHub ke versi 1.1.0 + Mxnet telah di-upgrade ke versi 1.6.0 + OpenCV telah di-upgrade ke versi 4.3.0 + Presto telah di-upgrade ke versi 0.238.3 + Upgrade TensorFlow ke versi 2.1.0 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [PERCIKAN API 29683.](https://issues.apache.org/jira/browse/SPARK-29683) Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG-9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan otentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + [Kolom statistik Hive](https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-ColumnStatistics) didukung untuk Amazon EMR versi 5.31.0 dan versi setelahnya. + Versi komponen yang telah ditingkatkan. + Support EMRFS S3EC V2 di Amazon EMR 5.31.0. Di S3 Java SDK rilis 1.11.837 dan versi setelahnya, klien enkripsi Versi 2 (S3EC V2) telah diperkenalkan dengan berbagai peningkatan keamanan. Untuk informasi lebih lanjut, lihat hal berikut: + Posting blog S3: [Pembaruan untuk klien enkripsi Amazon S3](https://aws.amazon.com/blogs/developer/updates-to-the-amazon-s3-encryption-client/). + AWS SDK untuk Java Panduan Pengembang: [Migrasikan enkripsi dan dekripsi klien](https://docs.aws.amazon.com/sdk-for-java/v1/developer-guide/s3-encryption-migration.html#s3-cse-update-code) ke V2. + Panduan Manajemen EMR: Enkripsi sisi klien [Amazon S3](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-emrfs-encryption-cse.html). Enkripsi Klien V1 masih tersedia di SDK untuk kompatibilitas mundur. **Fitur baru** + **Turunkan batas “Maks open files” pada yang lebih lama AL2 [diperbaiki dalam rilis yang lebih baru].** Rilis Amazon EMR: emr-5.30.x, emr-5.31.0, emr-5.32.0, emr-6.0.0, emr-6.1.0, dan emr-6.2.0 didasarkan pada versi lama dari Amazon Linux 2 (), yang memiliki pengaturan ulimit yang lebih rendah untuk “File terbuka maksimum” ketika kluster Amazon EMR dibuat dengan AMI default. AL2 Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. Rilis dengan batas file terbuka yang lebih rendah menyebabkan kesalahan “Terlalu banyak file terbuka” saat mengirimkan pekerjaan Spark. Dalam rilis yang terkena dampak, AMI default Amazon EMR memiliki pengaturan ulimit default 4096 untuk “File terbuka maksimum,” yang lebih rendah dari batas file 65536 di AMI Amazon Linux 2 terbaruAmazon. Pengaturan ulimit yang lebih rendah untuk "Maksimal file terbuka" menyebabkan kegagalan tugas Spark ketika driver dan pelaksana mencoba untuk membuka lebih dari 4096 file. Untuk memperbaiki masalah, Amazon EMR memiliki skrip tindakan bootstrap (BA) yang menyesuaikan pengaturan ulimit saat pembuatan klaster. Jika Anda menggunakan versi EMR Amazon yang lebih lama yang tidak memiliki perbaikan permanen untuk masalah ini, solusi berikut memungkinkan Anda untuk secara eksplisit mengatur ulimit pengontrol instans ke maksimum 65536 file. **Mengatur secara eksplisit ulimit dari baris perintah** 1. Edit `/etc/systemd/system/instance-controller.service` untuk menambahkan parameter berikut ke bagian Layanan. `LimitNOFILE=65536` `LimitNPROC=65536` 1. Mulai ulang InstanceController `$ sudo systemctl daemon-reload` `$ sudo systemctl restart instance-controller` **Tetapkan ulimit menggunakan tindakan bootstrap (BA)** Anda juga dapat menggunakan skrip tindakan bootstrap (BA) untuk mengkonfigurasi ulimit instans-pengendali menjadi 65536 file saat pembuatan klaster. ``` #!/bin/bash for user in hadoop spark hive; do sudo tee /etc/security/limits.d/$user.conf << EOF $user - nofile 65536 $user - nproc 65536 EOF done for proc in instancecontroller logpusher; do sudo mkdir -p /etc/systemd/system/$proc.service.d/ sudo tee /etc/systemd/system/$proc.service.d/override.conf << EOF [Service] LimitNOFILE=65536 LimitNPROC=65536 EOF pid=$(pgrep -f aws157.$proc.Main) sudo prlimit --pid $pid --nofile=65535:65535 --nproc=65535:65535 done sudo systemctl daemon-reload ``` + Dengan Amazon EMR 5.31.0, Anda dapat melakukan peluncuran klaster yang terintegrasi dengan Lake Formation. Integrasi ini menyediakan pemfilteran data tingkat kolom berbutir halus ke database dan tabel di Katalog Data Glue. AWS Hal ini juga mengaktifkan sistem masuk tunggal federasi ke EMR Notebooks atau Apache Zeppelin dari sistem identitas korporasi. Untuk informasi selengkapnya, lihat [Meng-integrasi-kan EMR dengan AWS Lake Formation](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-lake-formation.html) di *Panduan Pengelolaan Amazon EMR*. Amazon EMR dengan Lake Formation saat ini tersedia di 16 AWS Wilayah: AS Timur (Ohio dan Virginia N.), AS Barat (California N. dan Oregon), Asia Pasifik (Mumbai, Seoul, Singapura, Sydney, dan Tokyo), Kanada (Tengah), Eropa (Frankfurt, Irlandia, London, Paris, dan Stockholm), Amerika Selatan (São Paulo). **Masalah yang diketahui** + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. + Saat AtRestEncryption enkripsi HDFS diaktifkan pada klaster yang menggunakan Amazon EMR 5.31.0 atau 5.32.0, kueri Hive menghasilkan pengecualian runtime berikut. ``` TaskAttempt 3 failed, info=[Error: Error while running task ( failure ) : attempt_1604112648850_0001_1_01_000000_3:java.lang.RuntimeException: java.lang.RuntimeException: Hive Runtime Error while closing operators: java.io.IOException: java.util.ServiceConfigurationError: org.apache.hadoop.security.token.TokenIdentifier: Provider org.apache.hadoop.hbase.security.token.AuthenticationTokenIdentifier not found ``` + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.31.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.4.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.15.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.13.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.15.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.6.0 | EMR S3Select Connector | | emrfs | 2.43.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.11.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | flink-jobmanager-config | 1.11.0 | Mengelola sumber daya pada node EMR untuk Apache Flink. JobManager | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.10.0-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.10.0-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.10.0-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.10.0-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.10.0-amzn-0 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.10.0-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.10.0-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.10.0-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.10.0-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.10.0-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.10.0-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.7-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.7-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.7-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.7-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.7-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.7-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.7-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.6.0-amzn-0 | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-spark | 0.6.0-amzn-0 | Perpustakaan paket untuk menjalankan Spark dengan Hudi. | | hudi-presto | 0.6.0-amzn-0 | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.7.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.6.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 4.3.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.238.3-amzn-0 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.238.3-amzn-0 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0.238.3-amzn-0 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.6-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 2.4.6-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.6-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.6-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 2.1.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.31.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.31.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | hudi-env | Ubah nilai di lingkungan Hudi. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.30.2 ## 5.30.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.30.2 | emr-5.30.1 | emr-5.30.0 | emr-5.29.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.759 | 1.11.759 | 1.11.759 | 1.11.682 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.10.0 | 1.10.0 | 1.10.0 | 1.9.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.13 | 1.4.10 | | HCatalog | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-1 | | Hadoop | 2.8.5-amzn-6.1 | 2.8.5-amzn-6 | 2.8.5-amzn-6 | 2.8.5-amzn-5 | | Hive | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-1 | | Hudi | 0.5.2-incubating | 0.5.2-incubating | 0.5.2-incubating | 0.5.0-incubating | | Hue | 4.6.0 | 4.6.0 | 4.6.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.1.0 | 1.0.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.7.0-incubating | 0.6.0-incubating | | MXNet | 1.5.1 | 1.5.1 | 1.5.1 | 1.5.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.0 | 5.2.0 | 5.2.0 | 5.1.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,232 | 0,232 | 0,232 | 0,227 | | Spark | 2.4.5-amzn-0.1 | 2.4.5-amzn-0 | 2.4.5-amzn-0 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.30.2 Ini adalah rilis untuk memperbaiki masalah dengan Amazon EMR Scaling ketika gagal up/scale menurunkan skala cluster dengan sukses atau menyebabkan kegagalan aplikasi. **Perubahan, Penyempurnaan, dan Masalah Terselesaikan** + Memperbaiki masalah saat permintaan penskalaan gagal untuk klaster besar yang sangat dimanfaatkan saat daemon on-cluster Amazon EMR menjalankan aktivitas pemeriksaan kesehatan, seperti mengumpulkan status node YARN dan status node HDFS. Ini terjadi karena daemon on-cluster tidak dapat mengkomunikasikan data status kesehatan node ke komponen EMR Amazon internal. + Peningkatan daemon EMR on-cluster untuk melacak status node dengan benar saat alamat IP digunakan kembali untuk meningkatkan keandalan selama operasi penskalaan. + [PERCIKAN API 29683.](https://issues.apache.org/jira/browse/SPARK-29683) Memperbaiki masalah di mana kegagalan pekerjaan terjadi selama penskalaan klaster karena Spark mengasumsikan semua node yang tersedia tidak terdaftar. + [BENANG-9011.](https://issues.apache.org/jira/browse/YARN-9011) Memperbaiki masalah di mana kegagalan pekerjaan terjadi karena kondisi balapan dalam penonaktifan YARN saat cluster mencoba menaikkan atau menurunkan skala. + Memperbaiki masalah dengan kegagalan langkah atau pekerjaan selama penskalaan klaster dengan memastikan bahwa status node selalu konsisten antara daemon on-cluster EMR Amazon dan YARN/HDFS. + Memperbaiki masalah saat operasi klaster seperti pengurangan skala dan pengiriman langkah gagal untuk kluster EMR Amazon yang diaktifkan dengan otentikasi Kerberos. Ini karena daemon on-cluster EMR Amazon tidak memperbarui tiket Kerberos, yang diperlukan untuk berkomunikasi dengan aman dengan berjalan di node utama. HDFS/YARN + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + HTTPS sekarang diaktifkan secara default untuk repositori Amazon Linux. Jika Anda menggunakan kebijakan Amazon S3 VPCE untuk membatasi akses ke bucket tertentu, Anda harus menambahkan ARN bucket Amazon Linux baru `arn:aws:s3:::amazonlinux-2-repos-$region/*` ke kebijakan Anda (ganti `$region` dengan wilayah tempat titik akhir berada). Untuk informasi lebih lanjut, lihat topik ini di forum AWS diskusi. [Pengumuman: Amazon Linux 2 sekarang mendukung kemampuan untuk menggunakan HTTPS saat menghubungkan ke repositori paket](https://forums.aws.amazon.com/ann.jspa?annID=8528). **Masalah yang diketahui** + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.30.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.3.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.14.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.13.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.14.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.5.0 | EMR S3Select Connector | | emrfs | 2.40.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.10.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-6.1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-6.1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-6.1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-6.1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-6.1 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-6.1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-6.1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-6.1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-6.1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-6.1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-6.1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.6-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.6-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.6-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.6-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.6-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.6-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.6-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.2-incubating | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.2-incubating | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.6.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.5.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,232 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,232 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,232 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.5-amzn-0.1 | Klien baris perintah Spark. | | spark-history-server | 2.4.5-amzn-0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.5-amzn-0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.5-amzn-0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.30.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.30.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | hudi-env | Ubah nilai di lingkungan Hudi. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.30.1 ## 5.30.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.30.1 | emr-5.30.0 | emr-5.29.0 | emr-5.28.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.759 | 1.11.759 | 1.11.682 | 1.11.659 | | Python | 2.7, 3.7 | 2.7, 3.7 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.10.0 | 1.10.0 | 1.9.1 | 1.9.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.13 | 1.4.10 | 1.4.10 | | HCatalog | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-1 | 2.3.6-amzn-0 | | Hadoop | 2.8.5-amzn-6 | 2.8.5-amzn-6 | 2.8.5-amzn-5 | 2.8.5-amzn-5 | | Hive | 2.3.6-amzn-2 | 2.3.6-amzn-2 | 2.3.6-amzn-1 | 2.3.6-amzn-0 | | Hudi | 0.5.2-incubating | 0.5.2-incubating | 0.5.0-incubating | 0.5.0-incubating | | Hue | 4.6.0 | 4.6.0 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.1.0 | 1.1.0 | 1.0.0 | 1.0.0 | | Livy | 0.7.0-incubating | 0.7.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.5.1 | 1.5.1 | 1.5.1 | 1.5.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.0 | 5.2.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,232 | 0,232 | 0,227 | 0,227 | | Spark | 2.4.5-amzn-0 | 2.4.5-amzn-0 | 2.4.4 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.30.1 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.30.1. Perubahan bersifat relatif terhadap 5.30.0. Tanggal rilis awal: 30 Juni 2020 Tanggal terakhir diperbarui: 24 Agustus 2020 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Rilis Amazon EMR yang lebih baru memperbaiki masalah dengan batas “Max open files” yang lebih rendah pada yang lebih lama AL2 di Amazon EMR. Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru sekarang menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. + Masalah di mana proses pengendali instans melahirkan jumlah proses yang tak terbatas telah diperbaiki. + Masalah di mana Hue tidak dapat menjalankan kueri Hive, menampilkan pesan "basis data terkunci" dan mencegah eksekusi kueri telah diperbaiki. + Perbaikan terhadap masalah Spark dalam mengaktifkan lebih banyak tugas untuk dijalankan secara bersamaan di klaster EMR. + Perbaikan terhadap masalah notebook Jupyter yang menyebabkan "kesalahan terlalu banyak file terbuka" di server Jupyter. + Perbaikan terhadap masalah dengan waktu mulai klaster. **Fitur baru** + Antarmuka aplikasi persisten server linimasa Tez UI dan YARN tersedia dengan Amazon EMR versi 6.x, dan EMR versi 5.30.1 dan versi setelahnya. Akses tautan satu klik ke riwayat aplikasi persisten memungkinkan Anda mengakses riwayat tugas dengan cepat tanpa perlu menyiapkan proxy web melalui koneksi SSH. Log untuk klaster aktif dan yang dihentikan tersedia selama 30 hari setelah aplikasi berakhir. Untuk informasi selengkapnya, lihat [Melihat Antarmuka Pengguna Aplikasi Persisten](https://docs.aws.amazon.com/emr/latest/ManagementGuide/app-history-spark-UI.html) di *Panduan Pengelolaan Amazon EMR*. + Eksekusi EMR Notebook APIs tersedia untuk mengeksekusi notebook EMR melalui skrip atau baris perintah. Kemampuan untuk memulai, menghentikan, daftar, dan menjelaskan eksekusi notebook EMR tanpa AWS konsol memungkinkan Anda mengontrol notebook EMR secara terprogram. Menggunakan sel notebook parameter, Anda dapat memberikan nilai parameter yang berbeda ke notebook tanpa harus membuat salinan notebook untuk setiap set baru nilai paramter. Lihat [Tindakan API EMR.](https://docs.aws.amazon.com/emr/latest/APIReference/API_Operations.html) Untuk kode sampel, lihat [Contoh perintah untuk menjalankan EMR Notebooks secara pemrograman.](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-notebooks-headless.html) **Masalah yang diketahui** + **Turunkan batas “Maks open files” pada yang lebih lama AL2 [diperbaiki dalam rilis yang lebih baru].** Rilis Amazon EMR: emr-5.30.x, emr-5.31.0, emr-5.32.0, emr-6.0.0, emr-6.1.0, dan emr-6.2.0 didasarkan pada versi lama dari Amazon Linux 2 (), yang memiliki pengaturan ulimit yang lebih rendah untuk “File terbuka maksimum” ketika kluster Amazon EMR dibuat dengan AMI default. AL2 Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. Rilis dengan batas file terbuka yang lebih rendah menyebabkan kesalahan “Terlalu banyak file terbuka” saat mengirimkan pekerjaan Spark. Dalam rilis yang terkena dampak, AMI default Amazon EMR memiliki pengaturan ulimit default 4096 untuk “File terbuka maksimum,” yang lebih rendah dari batas file 65536 di AMI Amazon Linux 2 terbaruAmazon. Pengaturan ulimit yang lebih rendah untuk "Maksimal file terbuka" menyebabkan kegagalan tugas Spark ketika driver dan pelaksana mencoba untuk membuka lebih dari 4096 file. Untuk memperbaiki masalah, Amazon EMR memiliki skrip tindakan bootstrap (BA) yang menyesuaikan pengaturan ulimit saat pembuatan klaster. Jika Anda menggunakan versi EMR Amazon yang lebih lama yang tidak memiliki perbaikan permanen untuk masalah ini, solusi berikut memungkinkan Anda untuk secara eksplisit mengatur ulimit pengontrol instans ke maksimum 65536 file. **Mengatur secara eksplisit ulimit dari baris perintah** 1. Edit `/etc/systemd/system/instance-controller.service` untuk menambahkan parameter berikut ke bagian Layanan. `LimitNOFILE=65536` `LimitNPROC=65536` 1. Mulai ulang InstanceController `$ sudo systemctl daemon-reload` `$ sudo systemctl restart instance-controller` **Tetapkan ulimit menggunakan tindakan bootstrap (BA)** Anda juga dapat menggunakan skrip tindakan bootstrap (BA) untuk mengkonfigurasi ulimit instans-pengendali menjadi 65536 file saat pembuatan klaster. ``` #!/bin/bash for user in hadoop spark hive; do sudo tee /etc/security/limits.d/$user.conf << EOF $user - nofile 65536 $user - nproc 65536 EOF done for proc in instancecontroller logpusher; do sudo mkdir -p /etc/systemd/system/$proc.service.d/ sudo tee /etc/systemd/system/$proc.service.d/override.conf << EOF [Service] LimitNOFILE=65536 LimitNPROC=65536 EOF pid=$(pgrep -f aws157.$proc.Main) sudo prlimit --pid $pid --nofile=65535:65535 --nproc=65535:65535 done sudo systemctl daemon-reload ``` + **EMR Notebooks** Fitur yang memungkinkan Anda untuk menginstal kernel dan pustaka Python tambahan pada node utama cluster dinonaktifkan secara default pada EMR versi 5.30.1. Untuk informasi selengkapnya tentang fitur ini, lihat [Menginstal Kernel dan Pustaka Python pada](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-notebooks-installing-libraries-and-kernels.html) Node Utama Cluster. Untuk mengaktifkan fitur, lakukan hal berikut ini: 1. Pastikan bahwa kebijakan izin yang dilampirkan ke peran layanan untuk EMR Notebooks mengizinkan tindakan berikut ini: `elasticmapreduce:ListSteps` Untuk informasi selengkapnya, lihat [Peran Layanan untuk EMR Notebooks](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-notebooks-service-role.html). 1. Gunakan AWS CLI untuk menjalankan langkah pada cluster yang mengatur EMR Notebooks seperti yang ditunjukkan pada contoh berikut. Ganti *us-east-1* dengan Wilayah tempat klaster Anda berada. Untuk informasi selengkapnya, lihat [Menambahkan Langkah-langkah untuk Klaster Menggunakan AWS CLI](https://docs.aws.amazon.com/emr/latest/ManagementGuide/add-step-cli.html). ``` aws emr add-steps --cluster-id MyClusterID --steps Type=CUSTOM_JAR,Name=EMRNotebooksSetup,ActionOnFailure=CONTINUE,Jar=s3://us-east-1.elasticmapreduce/libs/script-runner/script-runner.jar,Args=["s3://awssupportdatasvcs.com/bootstrap-actions/EMRNotebooksSetup/emr-notebooks-setup.sh"] ``` + **Penskalaan terkelola** Operasi penskalaan terkelola pada klaster 5.30.0 dan 5.30.1 tanpa Presto yang diinstal dapat menyebabkan gagal aplikasi atau menyebabkan grup instans seragam atau armada instans tetap berada di negara `ARRESTED`, terutama ketika operasi menurunkan skala diikuti dengan cepat oleh operasi menaikkan skala. Sebagai solusinya, pilih Presto sebagai aplikasi untuk diinstal saat Anda membuat cluster dengan Amazon EMR rilis 5.30.0 dan 5.30.1, bahkan jika pekerjaan Anda tidak memerlukan Presto. + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.30.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.3.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.14.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.13.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.14.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.5.0 | EMR S3Select Connector | | emrfs | 2.40.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.10.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-6 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-6 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-6 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-6 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-6 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-6 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-6 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-6 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-6 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-6 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-6 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.6-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.6-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.6-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.6-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.6-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.6-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.6-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.2-incubating | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.2-incubating | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.6.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.5.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,232 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,232 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,232 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.5-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 2.4.5-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.5-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.5-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.30.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.30.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | hudi-env | Ubah nilai di lingkungan Hudi. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.30.0 ## 5.30.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.30.0 | emr-5.29.0 | emr-5.28.1 | emr-5.28.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.759 | 1.11.682 | 1.11.659 | 1.11.659 | | Python | 2.7, 3.7 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.10.0 | 1.9.1 | 1.9.0 | 1.9.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.13 | 1.4.10 | 1.4.10 | 1.4.10 | | HCatalog | 2.3.6-amzn-2 | 2.3.6-amzn-1 | 2.3.6-amzn-0 | 2.3.6-amzn-0 | | Hadoop | 2.8.5-amzn-6 | 2.8.5-amzn-5 | 2.8.5-amzn-5 | 2.8.5-amzn-5 | | Hive | 2.3.6-amzn-2 | 2.3.6-amzn-1 | 2.3.6-amzn-0 | 2.3.6-amzn-0 | | Hudi | 0.5.2-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | Hue | 4.6.0 | 4.4.0 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.1.0 | 1.0.0 | 1.0.0 | 1.0.0 | | Livy | 0.7.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.5.1 | 1.5.1 | 1.5.1 | 1.5.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.2.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,232 | 0,227 | 0,227 | 0,227 | | Spark | 2.4.5-amzn-0 | 2.4.4 | 2.4.4 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.2 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.30.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.30.0. Perubahan bersifat relatif terhadap 5.29.0. Tanggal rilis awal: 13 Mei 2020 Tanggal terakhir diperbarui: 25 Juni 2020 **Upgrade** + Diupgrade AWS SDK untuk Java ke versi 1.11.759 + Upgrade Amazon SageMaker Spark SDK ke versi 1.3.0 + EMR Record Server telah di-upgrade ke versi 1.6.0 + Flink telah di-upgrade ke versi 1.10.0 + Ganglia telah di-upgrade ke versi 3.7.2 + Diupgrade HBase ke versi 1.4.13 + Hudi telah di-upgrade ke versi 0.5.2-incubating + Hue telah di-upgrade ke versi 4.6.0 + Upgrade JupyterHub ke versi 1.1.0 + Livy telah di-upgrade ke versi 0.7.0-incubating + Oozie telah di-upgrade ke versi 5.2.0 + Presto telah di-upgrade ke versi 0.232 + Spark telah di-upgrade ke versi 2.4.5 + Konektor dan Driver yang ditingkatkan: Glue Amazon Connector 1.12.0; Amazon Kinesis Connector 3.5.0; EMR DynamoDB Connector 4.14.0 **Fitur baru** + **EMR Notebooks** – Bila digunakan dengan klaster EMR yang dibuat menggunakan 5.30.0, kernel EMR notebooks akan berjalan di klaster. Hal ini meningkatkan performa notebook dan mengizinkan Anda untuk menginstal dan menyesuaikan kernel. Anda juga dapat menginstal pustaka Python pada node utama cluster. Untuk informasi selengkapnya, lihat [Menginstal dan Menggunakan Kernel dan Perpustakaan](https://docs.aws.amazon.com//emr/latest/ManagementGuide/emr-managed-notebooks-installing-libraries-and-kernels.html) di *Panduan Manajemen EMR*. + **Penskalaan Terkelola** – Dengan Amazon EMR versi 5.30.0 dan versi yang lebih baru, Anda dapat mengaktifkan penskalaan terkelola EMR untuk secara otomatis menambah atau mengurangi jumlah instans atau unit di klaster Anda berdasarkan beban kerja. Amazon EMR terus mengevaluasi metrik klaster untuk membuat keputusan penskalaan yang mengoptimalkan kluster Anda untuk biaya dan kecepatan. Untuk informasi selengkapnya, lihat [Penskalaan Sumber Daya Klaster](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-scale-on-demand.html) di *Panduan Pengelolaan Amazon EMR*. + **Enkripsi file log yang disimpan di Amazon S3 - Dengan Amazon** EMR versi 5.30.0 dan yang lebih baru, Anda dapat mengenkripsi file log yang disimpan di Amazon S3 dengan kunci yang dikelola pelanggan. AWS KMS Untuk informasi selengkapnya, lihat [Mengenkripsi berkas log yang disimpan di Amazon S3](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-debugging.html#emr-log-encryption) di *Panduan Pengelolaan Amazon EMR*. + **Support Amazon Linux 2** – Dalam EMR versi 5.30.0 dan setelahnya, EMR UseSamazon Linux 2 OS. Kustom baru AMIs (Amazon Machine Image) harus didasarkan padaAmazon Linux 2 AMI. Untuk informasi selengkapnya, lihat [Menggunakan AMI Kustom](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-custom-ami.html). + **Penskalaan Otomatis Presto Graceful** – Klaster EMR menggunakan 5.30.0 dapat diatur dengan periode waktu habis penskalaan otomatis yang memberikan Presto waktu tugas untuk menyelesaikan running-nya sebelum simpul mereka dinonaktifkan. Untuk informasi selengkapnya, lihat [Menggunakan penskalaan otomatis Presto dengan Graceful Decommission](presto-graceful-autoscale.md). + **Pembuatan Instans Armada dengan opsi strategi alokasi baru** – Opsi strategi alokasi baru tersedia di EMR versi 5.12.1 dan versi setelahnya. Ia menawarkan penyediaan klaster yang lebih cepat, alokasi tempat yang lebih akurat, dan interupsi instans spot yang sedikit. Pembaruan untuk peran layanan EMR non-default diperlukan. Lihat [Mengkonfigurasi Armada Instans](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-instance-fleet.html). + **sudo systemctl berhenti dan sudo systemctl memulai perintah** – Dalam EMR versi 5.30.0 dan versi setelahnya, yang menggunakan Amazon Linux 2 OS, EMR menggunakan perintah `sudo systemctl stop` dan `sudo systemctl start` untuk memulai ulang layanan. Untuk informasi selengkapnya, lihat [Bagaimana cara me-restart layanan di Amazon EMR?](https://aws.amazon.com/premiumsupport/knowledge-center/restart-service-emr/). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + EMR versi 5.30.0 tidak menginstal Ganglia secara default. Anda dapat secara eksplisit memilih Ganglia untuk menginstalnya ketika Anda membuat sebuah klaster. + Optimalisasi performa Spark. + Optimalisasi performa Presto. + Python 3 adalah default untuk Amazon EMR versi 5.30.0 dan versi setelahnya. + Grup keamanan terkelola default untuk akses layanan di subnet privat telah diperbarui dengan aturan baru. Jika Anda menggunakan grup keamanan kustom untuk akses layanan, Anda harus menyertakan aturan yang sama sesuai grup keamanan terkelola default. Untuk informasi selengkapnya, lihat [Grup Keamanan Terkelola-Amazon EMR untuk Akses Layanan (Subnet Privat)](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-man-sec-groups.html#emr-sg-elasticmapreduce-sa-private). Jika Anda menggunakan peran layanan kustom untuk Amazon EMR, Anda harus memberikan izin untuk `ec2:describeSecurityGroups` sehingga EMR dapat melakukan validasi apakah grup keamanan dibuat dengan benar. Jika Anda menggunakan `EMR_DefaultRole`, izin ini telah disertakan dalam kebijakan terkelola default. **Masalah yang diketahui** + **Turunkan batas “Maks open files” pada yang lebih lama AL2 [diperbaiki dalam rilis yang lebih baru].** Rilis Amazon EMR: emr-5.30.x, emr-5.31.0, emr-5.32.0, emr-6.0.0, emr-6.1.0, dan emr-6.2.0 didasarkan pada versi lama dari Amazon Linux 2 (), yang memiliki pengaturan ulimit yang lebih rendah untuk “File terbuka maksimum” ketika kluster Amazon EMR dibuat dengan AMI default. AL2 Amazon EMR merilis 5.30.1, 5.30.2, 5.31.1, 5.32.1, 6.0.1, 6.1.1, 6.2.1, 5.33.0, 6.3.0 dan yang lebih baru menyertakan perbaikan permanen dengan pengaturan “Max open files” yang lebih tinggi. Rilis dengan batas file terbuka yang lebih rendah menyebabkan kesalahan “Terlalu banyak file terbuka” saat mengirimkan pekerjaan Spark. Dalam rilis yang terkena dampak, AMI default Amazon EMR memiliki pengaturan ulimit default 4096 untuk “File terbuka maksimum,” yang lebih rendah dari batas file 65536 di AMI Amazon Linux 2 terbaruAmazon. Pengaturan ulimit yang lebih rendah untuk "Maksimal file terbuka" menyebabkan kegagalan tugas Spark ketika driver dan pelaksana mencoba untuk membuka lebih dari 4096 file. Untuk memperbaiki masalah, Amazon EMR memiliki skrip tindakan bootstrap (BA) yang menyesuaikan pengaturan ulimit saat pembuatan klaster. Jika Anda menggunakan versi EMR Amazon yang lebih lama yang tidak memiliki perbaikan permanen untuk masalah ini, solusi berikut memungkinkan Anda untuk secara eksplisit mengatur ulimit pengontrol instans ke maksimum 65536 file. **Mengatur secara eksplisit ulimit dari baris perintah** 1. Edit `/etc/systemd/system/instance-controller.service` untuk menambahkan parameter berikut ke bagian Layanan. `LimitNOFILE=65536` `LimitNPROC=65536` 1. Mulai ulang InstanceController `$ sudo systemctl daemon-reload` `$ sudo systemctl restart instance-controller` **Tetapkan ulimit menggunakan tindakan bootstrap (BA)** Anda juga dapat menggunakan skrip tindakan bootstrap (BA) untuk mengkonfigurasi ulimit instans-pengendali menjadi 65536 file saat pembuatan klaster. ``` #!/bin/bash for user in hadoop spark hive; do sudo tee /etc/security/limits.d/$user.conf << EOF $user - nofile 65536 $user - nproc 65536 EOF done for proc in instancecontroller logpusher; do sudo mkdir -p /etc/systemd/system/$proc.service.d/ sudo tee /etc/systemd/system/$proc.service.d/override.conf << EOF [Service] LimitNOFILE=65536 LimitNPROC=65536 EOF pid=$(pgrep -f aws157.$proc.Main) sudo prlimit --pid $pid --nofile=65535:65535 --nproc=65535:65535 done sudo systemctl daemon-reload ``` + **Penskalaan terkelola** Operasi penskalaan terkelola pada klaster 5.30.0 dan 5.30.1 tanpa Presto yang diinstal dapat menyebabkan gagal aplikasi atau menyebabkan grup instans seragam atau armada instans tetap berada di negara `ARRESTED`, terutama ketika operasi menurunkan skala diikuti dengan cepat oleh operasi menaikkan skala. Sebagai solusinya, pilih Presto sebagai aplikasi untuk diinstal saat Anda membuat cluster dengan Amazon EMR rilis 5.30.0 dan 5.30.1, bahkan jika pekerjaan Anda tidak memerlukan Presto. + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. + Mesin database default untuk Hue 4.6.0 adalah SQLite, yang menyebabkan masalah ketika Anda mencoba menggunakan Hue dengan database eksternal. Untuk memperbaikinya, atur `engine` di klasifikasi konfigurasi `hue-ini` Anda menjadi `mysql`. Masalah ini telah diperbaiki di Amazon EMR versi 5.30.1. + Saat Anda menggunakan format lokasi partisi Spark dengan Hive untuk membaca data di Amazon S3, dan Anda menjalankan Spark di Amazon EMR rilis 5.30.0 hingga 5.36.0, dan 6.2.0 hingga 6.9.0, Anda mungkin mengalami masalah yang mencegah klaster membaca data dengan benar. Ini dapat terjadi jika partisi Anda memiliki semua karakteristik berikut: + Dua atau lebih partisi dipindai dari tabel yang sama. + Setidaknya satu jalur direktori partisi adalah awalan dari setidaknya satu jalur direktori partisi lainnya, misalnya, `s3://bucket/table/p=a` adalah awalan dari. `s3://bucket/table/p=a b` + Karakter pertama yang mengikuti awalan di direktori partisi lain memiliki nilai UTF-8 yang kurang dari `/` karakter (U\$1002F). Misalnya, karakter spasi (U\$10020) yang terjadi antara a dan b masuk `s3://bucket/table/p=a b` termasuk dalam kategori ini. Perhatikan bahwa ada 14 karakter non-kontrol lainnya:`!"#$%&‘()*+,-`. Untuk informasi selengkapnya, lihat [tabel pengkodean UTF-8 dan](https://www.utf8-chartable.de/) karakter Unicode. Sebagai solusi untuk masalah ini, atur `spark.sql.sources.fastS3PartitionDiscovery.enabled` konfigurasi ke `false` dalam klasifikasi. `spark-defaults` ## 5.30.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.3.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.14.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.13.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.5.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-notebook-env | 1.0.0 | Conda env untuk emr notebook | | emr-s3-dist-cp | 2.14.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.5.0 | EMR S3Select Connector | | emrfs | 2.40.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.10.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-6 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-6 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-6 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-6 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-6 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-6 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-6 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-6 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-6 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-6 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-6 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.13 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.13 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.13 | HBase klien baris perintah. | | hbase-rest-server | 1.4.13 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.13 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.6-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.6-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.6-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.6-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.6-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.6-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.6-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.2-incubating | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.2-incubating | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.6.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.1.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.7.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.5.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mariadb-server | 5.5.64 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.2.0 | Klien baris perintah Oozie. | | oozie-server | 5.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,232 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,232 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,232 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.3 | Proyek R untuk Komputasi Statistik | | ranger-kms-server | 1.2.0 | Sistem Pengelolaan Kunci Ranger Apache | | spark-client | 2.4.5-amzn-0 | Klien baris perintah Spark. | | spark-history-server | 2.4.5-amzn-0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.5-amzn-0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.5-amzn-0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.30.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.30.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | hudi-env | Ubah nilai di lingkungan Hudi. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.29.0 ## Versi aplikasi 5.29.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.29.0 | emr-5.28.1 | emr-5.28.0 | emr-5.27.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.682 | 1.11.659 | 1.11.659 | 1.11.615 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.9.1 | 1.9.0 | 1.9.0 | 1.8.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.10 | 1.4.10 | 1.4.10 | 1.4.10 | | HCatalog | 2.3.6-amzn-1 | 2.3.6-amzn-0 | 2.3.6-amzn-0 | Versi 2.3.5 amzn-1 | | Hadoop | 2.8.5-amzn-5 | 2.8.5-amzn-5 | 2.8.5-amzn-5 | 2.8.5-amzn-4 | | Hive | 2.3.6-amzn-1 | 2.3.6-amzn-0 | 2.3.6-amzn-0 | Versi 2.3.5 amzn-1 | | Hudi | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | - | | Hue | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | | Livy | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.5.1 | 1.5.1 | 1.5.1 | 1.4.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.2- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,227 | 0,227 | 0,227 | 0,224 | | Spark | 2.4.4 | 2.4.4 | 2.4.4 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.2 | 0.8.2 | 0.8.1 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan rilis 5.29.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.29.0. Perubahan bersifat relatif terhadap 5.28.1. Tanggal rilis awal: 17 Januari 2020 **Upgrade** + Diupgrade AWS SDK untuk Java ke versi 1.11.682 + Hive telah di-upgrade ke versi 2.3.6 + Flink telah di-upgrade ke versi 1.9.1 + EmrFS telah di-upgrade ke versi 2.38.0 + EMR DynamoDB Connector telah di-upgrade ke versi 4.13.0 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Spark + Optimalisasi performa Spark. + EMRFS + Pembaruan Panduan Pengelolaan untuk pengaturan default emrfs-site.xml untuk tampilan konsisten. **Masalah yang diketahui** + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## Versi komponen 5.29.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.6 | Amazon SageMaker Spark SDK | | emr-ddb | 4.13.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.12.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.13.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.4.0 | EMR S3Select Connector | | emrfs | 2.38.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.9.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-5 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-5 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-5 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-5 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-5 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-5 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-5 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-5 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-5 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-5 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-5 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.10 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.10 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.10 | HBase klien baris perintah. | | hbase-rest-server | 1.4.10 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.10 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.6-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.6-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.6-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.6-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.6-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.6-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.6-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.0-incubating | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.0-incubating | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.0.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.5.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,227 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,227 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,227 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.4 | Klien baris perintah Spark. | | spark-history-server | 2.4.4 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.4 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.4 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.29.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.29.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.28.1 ## 5.28.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.28.1 | emr-5.28.0 | emr-5.27.1 | emr-5.27.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.659 | 1.11.659 | 1.11.615 | 1.11.615 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.9.0 | 1.9.0 | 1.8.1 | 1.8.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.10 | 1.4.10 | 1.4.10 | 1.4.10 | | HCatalog | 2.3.6-amzn-0 | 2.3.6-amzn-0 | Versi 2.3.5 amzn-1 | Versi 2.3.5 amzn-1 | | Hadoop | 2.8.5-amzn-5 | 2.8.5-amzn-5 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | | Hive | 2.3.6-amzn-0 | 2.3.6-amzn-0 | Versi 2.3.5 amzn-1 | Versi 2.3.5 amzn-1 | | Hudi | 0.5.0-incubating | 0.5.0-incubating | - | - | | Hue | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | | Livy | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.5.1 | 1.5.1 | 1.4.0 | 1.4.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.3- -1.4 HBase | 4.14.2- -1.4 HBase | 4.14.2- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,227 | 0,227 | 0,224 | 0,224 | | Spark | 2.4.4 | 2.4.4 | 2.4.4 | 2.4.4 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.14.0 | 1.14.0 | 1.14.0 | 1.14.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.2 | 0.8.1 | 0.8.1 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan rilis 5.28.1 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.28.1. Perubahan bersifat relatif terhadap 5.28.0. Tanggal rilis awal: 10 Januari 2020 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Spark + Masalah kompatibilitas Spark yang telah diperbaiki. + CloudWatch Metrik + Memperbaiki penerbitan Amazon CloudWatch Metrics pada kluster EMR dengan beberapa node utama. + Pesan log telah dinonaktifkan + Pesan log SALAH, "... menggunakan versi lama (<4.5.8) dari Apache http client." telah dinonaktifkan **Masalah yang diketahui** + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## 5.28.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.6 | Amazon SageMaker Spark SDK | | emr-ddb | 4.12.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.11.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.13.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.3.0 | EMR S3Select Connector | | emrfs | 2.37.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.9.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-5 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-5 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-5 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-5 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-5 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-5 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-5 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-5 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-5 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-5 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-5 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.10 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.10 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.10 | HBase klien baris perintah. | | hbase-rest-server | 1.4.10 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.10 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.6-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.6-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.6-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.6-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.6-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.6-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.6-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.0-incubating | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.0-incubating | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.0.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.5.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,227 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,227 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,227 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.4 | Klien baris perintah Spark. | | spark-history-server | 2.4.4 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.4 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.4 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.28.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.28.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 5.28.0 ## 5.28.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [https://hudi.apache.org](https://hudi.apache.org), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.28.0 | emr-5.27.1 | emr-5.27.0 | emr-5.26.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.659 | 1.11.615 | 1.11.615 | 1.11.595 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.9.0 | 1.8.1 | 1.8.1 | 1.8.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.10 | 1.4.10 | 1.4.10 | 1.4.10 | | HCatalog | 2.3.6-amzn-0 | Versi 2.3.5 amzn-1 | Versi 2.3.5 amzn-1 | 2.3.5 amzn-0 | | Hadoop | 2.8.5-amzn-5 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | | Hive | 2.3.6-amzn-0 | Versi 2.3.5 amzn-1 | Versi 2.3.5 amzn-1 | 2.3.5 amzn-0 | | Hudi | 0.5.0-incubating | - | - | - | | Hue | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.0.0 | 1.0.0 | 1.0.0 | 0.9.6 | | Livy | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.5.1 | 1.4.0 | 1.4.0 | 1.4.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.3- -1.4 HBase | 4.14.2- -1.4 HBase | 4.14.2- -1.4 HBase | 4.14.2- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,227 | 0,224 | 0,224 | 0,220 | | Spark | 2.4.4 | 2.4.4 | 2.4.4 | 2.4.3 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.14.0 | 1.14.0 | 1.14.0 | 1.13.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.2 | 0.8.1 | 0.8.1 | 0.8.1 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan rilis 5.28.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.28.0. Perubahan bersifat relatif terhadap 5.27.0. Tanggal rilis awal: 12 November 2019 **Upgrade** + Flink telah di-upgrade ke versi 1.9.0 + Hive telah di-upgrade ke versi 2.3.6 + Upgrade MXNet ke versi 1.5.1 + Phoenix telah di-upgrade ke versi 4.14.3 + Presto telah di-upgrade ke versi 0.227 + Zeppelin telah di-upgrade ke versi 0.8.2 **Fitur baru** + [Apache Hudi](https://hudi.apache.org/) sekarang tersedia untuk diinstall Amazon EMR ketika Anda membuat sebuah klaster. Untuk informasi selengkapnya, lihat [Hudi](emr-hudi.md). + (25 November 2019) Sekarang Anda dapat memilih untuk menjalankan beberapa langkah secara paralel untuk meningkatkan pemanfaatan klaster dan menghemat biaya. Anda juga dapat membatalkan langkah-langkah yang tertunda dan sedang berjalan. Untuk informasi selengkapnya, lihat [Bekerja dengan Langkah Menggunakan AWS CLI dan Konsol](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-work-with-steps.html). + (3 Des 2019) Anda sekarang dapat membuat dan menjalankan kluster EMR di. AWS Outposts AWS Outposts memungkinkan AWS layanan asli, infrastruktur, dan model operasi di fasilitas lokal. Di AWS Outposts lingkungan, Anda dapat menggunakan alat AWS APIs, dan infrastruktur yang sama yang Anda gunakan di AWS cloud. Untuk informasi selengkapnya, lihat [kluster EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-outposts.html) di. AWS Outposts + (11 Mar 2020) Dimulai dengan Amazon EMR versi 5.28.0, Anda dapat membuat dan menjalankan klaster EMR Amazon di subnet Local AWS Zones sebagai ekstensi logis dari Wilayah yang mendukung Local Zones. AWS Zona Lokal memungkinkan fitur EMR Amazon dan subset AWS layanan, seperti layanan komputasi dan penyimpanan, ditempatkan lebih dekat ke pengguna, menyediakan akses latensi yang sangat rendah ke aplikasi yang berjalan secara lokal. Untuk daftar Local Zones yang tersedia, lihat [AWS Local Zones](https://aws.amazon.com/about-aws/global-infrastructure/localzones/). Untuk informasi tentang mengakses AWS Local Zones yang tersedia, lihat [Wilayah, Availability Zone, dan Local Zones](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-regions-availability-zones.html). Local Zones saat ini tidak mendukung Amazon EMR Notebooks dan tidak mendukung koneksi langsung ke Amazon EMR menggunakan antarmuka VPC endpoint ().AWS PrivateLink **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Support Aplikasi yang Diperluas untuk klaster ketersediaan tinggi + Untuk informasi selengkapnya, lihat [Aplikasi yang didukung dalam klaster EMR dengan Beberapa Node Utama](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-ha-applications.html#emr-plan-ha-applications-list) di Panduan Manajemen *EMR* Amazon. + Spark + Optimalisasi performa + Hive + Optimalisasi performa + Presto + Optimalisasi performa **Masalah yang diketahui** + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## 5.28.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.6 | Amazon SageMaker Spark SDK | | emr-ddb | 4.12.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.11.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.13.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.3.0 | EMR S3Select Connector | | emrfs | 2.37.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.9.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-5 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-5 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-5 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-5 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-5 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-5 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-5 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-5 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-5 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-5 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-5 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.10 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.10 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.10 | HBase klien baris perintah. | | hbase-rest-server | 1.4.10 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.10 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.6-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.6-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.6-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.6-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.6-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.6-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.6-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hudi | 0.5.0-incubating | Kerangka kerja pemrosesan tambahan untuk menyalakan alur data pada latensi rendah dan efisiensi tinggi. | | hudi-presto | 0.5.0-incubating | Perpustakaan paket untuk menjalankan Presto dengan Hudi. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.0.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.5.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.3- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.3- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,227 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,227 | Layanan untuk mengeksekusi potongan kueri. | | presto-client | 0,227 | Klien baris perintah Presto yang diinstal pada master klaster HA yang siaga di mana server Presto server tidak dimulai. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.4 | Klien baris perintah Spark. | | spark-history-server | 2.4.4 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.4 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.4 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.28.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.28.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.27.1 ## 5.27.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.27.1 | emr-5.27.0 | emr-5.26.0 | emr-5.25.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.615 | 1.11.615 | 1.11.595 | 1.11.566 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.8.1 | 1.8.1 | 1.8.0 | 1.8.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.10 | 1.4.10 | 1.4.10 | 1.4.9 | | HCatalog | Versi 2.3.5 amzn-1 | Versi 2.3.5 amzn-1 | 2.3.5 amzn-0 | 2.3.5 amzn-0 | | Hadoop | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | | Hive | Versi 2.3.5 amzn-1 | Versi 2.3.5 amzn-1 | 2.3.5 amzn-0 | 2.3.5 amzn-0 | | Hudi | - | - | - | - | | Hue | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.0.0 | 1.0.0 | 0.9.6 | 0.9.6 | | Livy | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.2- -1.4 HBase | 4.14.2- -1.4 HBase | 4.14.2- -1.4 HBase | 4.14.1- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,224 | 0,224 | 0,220 | 0,220 | | Spark | 2.4.4 | 2.4.4 | 2.4.3 | 2.4.3 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.14.0 | 1.14.0 | 1.13.1 | 1.13.1 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.2 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.14 | ## Catatan terbitan 5.27.1 Ini adalah rilis patch. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. Status dukungan Instance Metadata Service (IMDS) V2: Amazon EMR 5.23.1, 5.27.1 dan 5.32 atau komponen yang lebih baru digunakan untuk semua panggilan IMDS. IMDSv2 Untuk panggilan IMDS dalam kode aplikasi Anda, Anda dapat menggunakan keduanya IMDSv1 dan IMDSv2, atau mengkonfigurasi IMDS untuk digunakan hanya IMDSv2 untuk keamanan tambahan. Untuk rilis EMR 5.x lainnya, IMDSv1 penonaktifan menyebabkan kegagalan startup cluster. ## 5.27.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.4 | Amazon SageMaker Spark SDK | | emr-ddb | 4.12.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.11.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.13.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.3.0 | EMR S3Select Connector | | emrfs | 2.36.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.8.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.10 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.10 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.10 | HBase klien baris perintah. | | hbase-rest-server | 1.4.10 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.10 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | Versi 2.3.5 amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | Versi 2.3.5 amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | Versi 2.3.5 amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | Versi 2.3.5 amzn-1 | Klien baris perintah Hive. | | hive-hbase | Versi 2.3.5 amzn-1 | Klien Hive-hbase. | | hive-metastore-server | Versi 2.3.5 amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | Versi 2.3.5 amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.0.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.4.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.2- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.2- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,224 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,224 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.4 | Klien baris perintah Spark. | | spark-history-server | 2.4.4 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.4 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.4 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## 5.27.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.27.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.27.0 ## Versi aplikasi 5.27.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.27.0 | emr-5.26.0 | emr-5.25.0 | emr-5.24.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.615 | 1.11.595 | 1.11.566 | 1.11.546 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.8.1 | 1.8.0 | 1.8.0 | 1.8.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.10 | 1.4.10 | 1.4.9 | 1.4.9 | | HCatalog | Versi 2.3.5 amzn-1 | 2.3.5 amzn-0 | 2.3.5 amzn-0 | 2.3.4-amzn-2 | | Hadoop | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | | Hive | Versi 2.3.5 amzn-1 | 2.3.5 amzn-0 | 2.3.5 amzn-0 | 2.3.4-amzn-2 | | Hudi | - | - | - | - | | Hue | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 1.0.0 | 0.9.6 | 0.9.6 | 0.9.6 | | Livy | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.2- -1.4 HBase | 4.14.2- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,224 | 0,220 | 0,220 | 0,219 | | Spark | 2.4.4 | 2.4.3 | 2.4.3 | 2.4.2 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.14.0 | 1.13.1 | 1.13.1 | 1.12.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.2 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.14 | 3.4.13 | ## Catatan rilis 5.27.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.27.0. Perubahan bersifat relatif terhadap 5.26.0. Tanggal rilis awal: 23 September 2019 **Upgrade** + AWS SDK untuk Java 1.11.615 + Flink versi 1.8.1 + JupyterHub 1.0.0 + Spark versi 2.4.4 + Tensorflow versi 1.14.0 + Konektor dan driver: + DynamoDB Connector 4.12.0 **Fitur baru** + (24 Oktober 2019) Fitur baru berikut di notebook EMR tersedia dengan semua rilis Amazon EMR. + Anda sekarang dapat mengasosiasikan repositori Git dengan EMR notebooks untuk menyimpan notebook Anda dalam lingkungan terkendali versi. Anda dapat berbagi kode dengan rekan-rekan dan menggunakan kembali notebook Jupyter yang ada melalui repositori Git jauh. Untuk informasi selengkapnya, lihat [Associate Repositori Git dengan Amazon EMR Notebooks](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-git-repo.html) di *Panduan Pengelolaan Amazon EMR*. + [Utilitas nbdime](https://github.com/jupyter/nbdime) sekarang tersedia di notebook EMR untuk menyederhanakan membandingkan dan menggabungkan notebook. + Notebook EMR sekarang mendukung. JupyterLab JupyterLab adalah lingkungan pengembangan interaktif berbasis web yang sepenuhnya kompatibel dengan notebook Jupyter. Anda sekarang dapat memilih untuk membuka buku catatan Anda di salah satu JupyterLab atau editor notebook Jupyter. + (30 Oktober 2019) Dengan Amazon EMR versi 5.25.0 dan versi setelahnya, Anda dapat terhubung ke UI server riwayat Spark dari halaman klaster **Ringkasan** atau tab **Riwayat aplikasi** di konsol. Alih-alih menyiapkan proxy web melalui koneksi SSH, Anda dapat dengan cepat mengakses UI server riwayat Spark untuk melihat metrik aplikasi dan mengakses berkas log yang relevan untuk klaster aktif dan yang dihentikan. Untuk informasi selengkapnya, lihat [Akses off-klaster ke antarmuka pengguna aplikasi persisten](https://docs.aws.amazon.com/emr/latest/ManagementGuide/app-history-spark-UI.html) di *Panduan Pengelolaan Amazon EMR*. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Cluster EMR Amazon dengan beberapa node utama + Anda dapat menginstal dan menjalankan Flink di cluster EMR Amazon dengan beberapa node utama. Untuk informasi selengkapnya, lihat [Aplikasi dan fitur yang didukung](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-ha-applications.html). + Anda dapat mengonfigurasi enkripsi transparan HDFS pada kluster EMR Amazon dengan beberapa node utama. Untuk informasi selengkapnya, lihat [Enkripsi Transparan HDFS pada kluster EMR dengan](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-encryption-tdehdfs.html#emr-hadoop-kms-multi-master) Multiple Primary Nodes. + Anda sekarang dapat memodifikasi konfigurasi aplikasi yang berjalan pada cluster EMR Amazon dengan beberapa node utama. Untuk informasi selengkapnya, lihat [Menyediakan Konfigurasi untuk Grup Instans dalam Klaster Berjalan](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps-running-cluster.html). + Konektor Amazon EMR-DynamoDB + Konector Amazon EMR-DynamodB sekarang mendukung jenis data DynamoDB berikut: boolean, daftar, peta, item, null. Untuk informasi selengkapnya, lihat [Mengatur Tabel Hive untuk Menjalankan Perintah Hive](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/EMR_Interactive_Hive.html). **Masalah yang diketahui** + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## Versi komponen 5.27.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.4 | Amazon SageMaker Spark SDK | | emr-ddb | 4.12.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.11.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.13.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.3.0 | EMR S3Select Connector | | emrfs | 2.36.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.8.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.10 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.10 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.10 | HBase klien baris perintah. | | hbase-rest-server | 1.4.10 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.10 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | Versi 2.3.5 amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | Versi 2.3.5 amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | Versi 2.3.5 amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | Versi 2.3.5 amzn-1 | Klien baris perintah Hive. | | hive-hbase | Versi 2.3.5 amzn-1 | Klien Hive-hbase. | | hive-metastore-server | Versi 2.3.5 amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | Versi 2.3.5 amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 1.0.0 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.4.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.2- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.2- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,224 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,224 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.4 | Klien baris perintah Spark. | | spark-history-server | 2.4.4 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.4 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.4 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.14.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.27.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.27.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | ranger-kms-dbks-site | Ubah nilai dalam file dbks-site.xml Ranger KMS. | | ranger-kms-site | Ubah nilai dalam ranger-kms-site file.xml. dari Ranger KMS. | | ranger-kms-env | Ubah nilai di lingkungan Ranger KMS. | | ranger-kms-log4j | Ubah nilai dalam file kms-log4j.properties Ranger KMS. | | ranger-kms-db-ca | Ubah nilai untuk file CA pada S3 untuk koneksi MySQL SSL dengan Ranger KMS. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.26.0 ## Versi aplikasi 5.26.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.26.0 | emr-5.25.0 | emr-5.24.1 | emr-5.24.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.595 | 1.11.566 | 1.11.546 | 1.11.546 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.8.0 | 1.8.0 | 1.8.0 | 1.8.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.10 | 1.4.9 | 1.4.9 | 1.4.9 | | HCatalog | 2.3.5 amzn-0 | 2.3.5 amzn-0 | 2.3.4-amzn-2 | 2.3.4-amzn-2 | | Hadoop | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | | Hive | 2.3.5 amzn-0 | 2.3.5 amzn-0 | 2.3.4-amzn-2 | 2.3.4-amzn-2 | | Hudi | - | - | - | - | | Hue | 4.4.0 | 4.4.0 | 4.4.0 | 4.4.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.6 | 0.9.6 | 0.9.6 | 0.9.6 | | Livy | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | | MXNet | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.2- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,220 | 0,220 | 0,219 | 0,219 | | Spark | 2.4.3 | 2.4.3 | 2.4.2 | 2.4.2 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.13.1 | 1.13.1 | 1.12.0 | 1.12.0 | | Tez | 0.9.2 | 0.9.2 | 0.9.1 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | ZooKeeper | 3.4.14 | 3.4.14 | 3.4.13 | 3.4.13 | ## Catatan rilis 5.26.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.26.0. Perubahan relatif terhadap 5.25.0. Tanggal rilis awal: 8 Agustus 2019 Tanggal diperbarui terakhir: 19 Agustus 2019 **Upgrade** + AWS SDK untuk Java 1.11.595 + HBase 1.4.10 + Phoenix versi 4.14.2 + Konektor dan driver: + DynamoDB Connector versi 4.11.0 + MariaDB Connector versi 2.4.2 + Amazon Redshift JDBC Driver versi 1.2.32.1056 **Fitur baru** + (Beta) Dengan Amazon EMR 5.26.0, Anda dapat melakukan peluncuran klaster yang terintegrasi dengan Lake Formation. Integrasi ini menyediakan akses tingkat kolom berbutir halus ke database dan tabel di Katalog Data Glue. AWS Hal ini juga mengaktifkan sistem masuk tunggal federasi ke EMR Notebooks atau Apache Zeppelin dari sistem identitas korporasi. Untuk informasi selengkapnya, lihat [Mengintegrasikan EMR Amazon AWS Lake Formation dengan (](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-lake-formation.html)Beta). + (19 Agustus 2019) Blok akses publik Amazon EMR sekarang tersedia dengan semua rilis Amazon EMR yang mendukung grup keamanan. Blokir akses publik adalah pengaturan seluruh akun yang diterapkan ke setiap AWS Wilayah. Blokir akses publik mencegah cluster diluncurkan ketika grup keamanan apa pun yang terkait dengan cluster memiliki aturan yang memungkinkan lalu lintas masuk dari IPv4 0.0.0.0/0 atau IPv6 : :/0 (akses publik) pada port, kecuali port ditentukan sebagai pengecualian. Port 22 adalah pengecualian secara default. Untuk informasi lebih lanjut, lihat [Menggunakan Blok Publik Akses Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-block-public-access.html) dalam *Panduan Pengelolaan EMR Amazon*. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + EMR Notebooks + Dengan EMR 5.26.0 dan versi yang lebih baru, EMR Notebooks mendukung perpustakaan Python notebook-scoped selain perpustakaan Python default. Anda dapat menginstal perpustakaan notebook-scoped dari dalam notebook editor tanpa harus membuat ulang klaster atau melampirkan ulang notebook untuk klaster. Perpustakaan notebook-scoped dibuat dalam lingkungan virtual Python, sehingga mereka hanya berlaku untuk sesi notebook saat ini. Ini mengizinkan Anda mengisolasi dependensi notebook. Untuk informasi selengkapnya, lihat [Menggunakan Perpustakaan Notebook Scoped](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-notebooks-custom-libraries-limitations.html) di *Panduan Pengelolaan Amazon EMR*. + EMRFS + Anda dapat mengaktifkan fitur ETag verifikasi (Beta) dengan menyetel `fs.s3.consistent.metadata.etag.verification.enabled` ke`true`. Dengan fitur ini, EMRFS menggunakan Amazon ETags S3 untuk memverifikasi bahwa objek yang dibaca adalah versi terbaru yang tersedia. Fitur ini berguna untuk kasus read-after-update penggunaan di mana file di Amazon S3 ditimpa sambil mempertahankan nama yang sama. Kemampuan ETag verifikasi ini saat ini tidak berfungsi dengan S3 Select. Untuk informasi selengkapnya, lihat [Mengkonfigurasi Tampilan Konsisten](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emrfs-configure-consistent-view.html). + Spark + Optimasi berikut sekarang diaktifkan secara default: partisi pemangkasan dinamis, DISTINCT sebelum INTERSECT, perbaikan dalam inferensi statistik rencana SQL untuk JOIN diikuti oleh kueri DISTINCT, meratakan sub-kueri scalar, join reorder yang dioptimalkan, dan bloom filter join. Untuk informasi selengkapnya, lihat [Mengoptimalkan Performa Spark](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-performance.html). + Peningkatan seluruh pembuatan kode tahap untuk Sort Merge Join. + Peningkatan fragmen kueri dan penggunaan kembali subkueri. + Perbaikan untuk melakukan pra-alokasi pelaksana pada saat memulai Spark. + Bloom filter join tidak lagi diterapkan ketika join sisi yang lebih kecil mencakup petunjuk siaran. + Tez + Menyelesaikan masalah dengan Tez. Tez UI sekarang bekerja pada cluster EMR Amazon dengan beberapa node utama. **Masalah yang diketahui** + Peningkatan seluruh kemampuan tahap kode generasi untuk Sort Merge Join dapat meningkatkan tekanan memori ketika diaktifkan. Optimalisasi ini meningkatkan performa, tetapi dapat mengakibatkan coba lagi atau gagal tugas jika `spark.yarn.executor.memoryOverheadFactor` tidak disetel untuk memberikan memori yang cukup. Untuk menonaktifkan fitur ini, atur `spark.sql.sortMergeJoinExec.extendedCodegen.enabled` ke SALAH. + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## Versi komponen 5.26.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.4 | Amazon SageMaker Spark SDK | | emr-ddb | 4.11.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.10.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.12.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.3.0 | EMR S3Select Connector | | emrfs | 2.35.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.8.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.10 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.10 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.10 | HBase klien baris perintah. | | hbase-rest-server | 1.4.10 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.10 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.5 amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.5 amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.5 amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.5 amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.5 amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.5 amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.5 amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.6 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.4.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.2- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.2- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,220 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,220 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.3 | Klien baris perintah Spark. | | spark-history-server | 2.4.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.13.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.26.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.26.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 5.25.0 ## Versi aplikasi 5.25.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.25.0 | emr-5.24.1 | emr-5.24.0 | emr-5.23.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.566 | 1.11.546 | 1.11.546 | 1.11.519 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.8.0 | 1.8.0 | 1.8.0 | 1.7.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.9 | 1.4.9 | 1.4.9 | 1.4.9 | | HCatalog | 2.3.5 amzn-0 | 2.3.4-amzn-2 | 2.3.4-amzn-2 | 2.3.4-amzn-1 | | Hadoop | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-3 | | Hive | 2.3.5 amzn-0 | 2.3.4-amzn-2 | 2.3.4-amzn-2 | 2.3.4-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.4.0 | 4.4.0 | 4.4.0 | 4.3.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.6 | 0.9.6 | 0.9.6 | 0.9.4 | | Livy | 0.6.0-incubating | 0.6.0-incubating | 0.6.0-incubating | 0.5.0-incubating | | MXNet | 1.4.0 | 1.4.0 | 1.4.0 | 1.3.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,220 | 0,219 | 0,219 | 0,215 | | Spark | 2.4.3 | 2.4.2 | 2.4.2 | 2.4.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.13.1 | 1.12.0 | 1.12.0 | 1.12.0 | | Tez | 0.9.2 | 0.9.1 | 0.9.1 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | ZooKeeper | 3.4.14 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan rilis 5.25.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.25.0. Perubahan bersifat relatif terhadap 5.24.1. Tanggal rilis awal: 17 Juli 2019 Tanggal terakhir diperbarui: 30 Oktober 2019 **Amazon EMR 5.25.0** **Upgrade** + AWS SDK untuk Java 1.11.566 + Hive versi 2.3.5 + Presto versi 0.220 + Spark versi 2.4.3 + TensorFlow 1.13.1 + Tez versi 0.9.2 + Zookeeper versi 3.4.14 **Fitur baru** + (30 Oktober 2019) Dimulai dengan Amazon EMR versi 5.25.0, Anda dapat terhubung ke UI server riwayat Spark dari halaman klaster **Ringkasan** atau tab **Riwayat aplikasi** di konsol. Alih-alih menyiapkan proxy web melalui koneksi SSH, Anda dapat dengan cepat mengakses UI server riwayat Spark untuk melihat metrik aplikasi dan mengakses berkas log yang relevan untuk klaster aktif dan yang dihentikan. Untuk informasi selengkapnya, lihat [Akses off-klaster ke antarmuka pengguna aplikasi persisten](https://docs.aws.amazon.com/emr/latest/ManagementGuide/app-history-spark-UI.html) di *Panduan Pengelolaan Amazon EMR*. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Spark + Peningkatan performa beberapa join dengan menggunakan filter Bloom untuk melakukan pra-filter input. Optimalisasi dinonaktifkan secara default dan dapat diaktifkan dengan mengatur parameter konfigurasi Spark dari `spark.sql.bloomFilterJoin.enabled` ke `true`. + Peningkatan performa pembuatan grup menurut kolom tipe string. + Meningkatkan memori pelaksana Spark default dan konfigurasi inti tipe instans R4 untuk cluster tanpa diinstal. HBase + Penyelesaian masalah sebelumnya terkait dengan fitur pemangkasan partisi dinamis di mana tabel yang dipangkas harus berada di sisi kiri join. + Peningkatan DISTINCT sebelum optimasi INTERSECT untuk diterapkan pada kasus tambahan yang melibatkan nama alias. + Peningkatan inferensi statistik rencana SQL untuk JOIN yang diikuti oleh kueri DISTINCT. Perbaikan ini dinonaktifkan secara default dan dapat diaktifkan dengan mengatur parameter konfigurasi Spark dari `spark.sql.statsImprovements.enabled` ke `true`. Optimasi ini diperlukan oleh fitur Distinct before Intersect dan akan diaktifkan secara otomatis ketika `spark.sql.optimizer.distinctBeforeIntersect.enabled` diatur ke `true`. + Join order telah dioptimalkan berdasarkan ukuran tabel dan filter. Optimalisasi ini dinonaktifkan secara default dan dapat diaktifkan dengan menetapkan parameter konfigurasi Spark dari `spark.sql.optimizer.sizeBasedJoinReorder.enabled` ke `true`. Untuk informasi selengkapnya, lihat [Mengoptimalkan Performa Spark](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-performance.html). + EMRFS + Pengaturan EMRFS, `fs.s3.buckets.create.enabled`, sekarang dinonaktifkan secara default. Dengan pengujian, kami menemukan bahwa dengan menonaktifkan pengaturan ini akan meningkatkan performa dan mencegah pembuatan bucket S3 yang tidak disengaja. Jika aplikasi Anda bergantung pada fungsi ini, maka Anda dapat mengaktifkannya dengan mengatur properti `fs.s3.buckets.create.enabled` ke `true` di klasifikasi konfigurasi `emrfs-site`. Untuk informasi, lihat [Menyediakan Konfigurasi saat Membuat Klaster](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps-create-cluster.html). + Enkripsi Disk Lokal dan Peningkatan Enkripsi S3 dalam Konfigurasi Keamanan (5 Agustus 2019) + Pemisahan pengaturan enkripsi Amazon S3 dari pengaturan enkripsi disk lokal dalam pengaturan konfigurasi keamanan. + Penambahan opsi untuk mengaktifkan enkripsi EBS dengan rilis 5.24.0 dan versi setelahnya. Memilih opsi ini akan mengenkripsi volume perangkat asal selain volume penyimpanan. Versi sebelumnya diharuskan menggunakan AMI kustom untuk mengenkripsi volume perangkat asal. + Untuk informasi selengkapnya, lihat [Opsi Enkripsi](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-data-encryption-options.html) di *Panduan Pengelolaan Amazon EMR*. **Masalah yang diketahui** + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## Versi komponen 5.25.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.4 | Amazon SageMaker Spark SDK | | emr-ddb | 4.10.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.9.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.11.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.3.0 | EMR S3Select Connector | | emrfs | 2.34.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.8.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.9 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.9 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.9 | HBase klien baris perintah. | | hbase-rest-server | 1.4.9 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.9 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.5 amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.5 amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.5 amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.5 amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.5 amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.5 amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.5 amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.6 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.4.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.1- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.1- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,220 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,220 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.3 | Klien baris perintah Spark. | | spark-history-server | 2.4.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.13.1 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.2 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.14 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.14 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.25.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.25.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | recordserver-env | Ubah nilai di lingkungan EMR RecordServer . | | recordserver-conf | Ubah nilai dalam file erver.properties EMR RecordServer. | | recordserver-log4j | Ubah nilai dalam file log4j.properties EMR RecordServer. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.24.1 ## 5.24.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.24.1 | emr-5.24.0 | emr-5.23.1 | emr-5.23.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.546 | 1.11.546 | 1.11.519 | 1.11.519 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.8.0 | 1.8.0 | 1.7.1 | 1.7.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.9 | 1.4.9 | 1.4.9 | 1.4.9 | | HCatalog | 2.3.4-amzn-2 | 2.3.4-amzn-2 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | | Hadoop | 2.8.5-amzn-4 | 2.8.5-amzn-4 | 2.8.5-amzn-3 | 2.8.5-amzn-3 | | Hive | 2.3.4-amzn-2 | 2.3.4-amzn-2 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.4.0 | 4.4.0 | 4.3.0 | 4.3.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.6 | 0.9.6 | 0.9.4 | 0.9.4 | | Livy | 0.6.0-incubating | 0.6.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.4.0 | 1.4.0 | 1.3.1 | 1.3.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,219 | 0,219 | 0,215 | 0,215 | | Spark | 2.4.2 | 2.4.2 | 2.4.0 | 2.4.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | | Tez | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan rilis 5.24.1 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.24.1. Perubahan bersifat relatif terhadap 5.24.0. Tanggal rilis awal: 26 Juni 2019 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + [Memperbarui AMI Linux Amazon default untuk Amazon EMR untuk menyertakan pembaruan keamanan kernel Linux yang penting, termasuk TCP SACK Denial of Service Issue (AWS-2019-005).](https://aws.amazon.com/security/security-bulletins/AWS-2019-005/) **Masalah yang diketahui** + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## 5.24.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.9.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.8.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.11.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.3.0 | EMR S3Select Connector | | emrfs | 2.33.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.8.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.9 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.9 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.9 | HBase klien baris perintah. | | hbase-rest-server | 1.4.9 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.9 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.6 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.4.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.1- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.1- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,219 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,219 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.2 | Klien baris perintah Spark. | | spark-history-server | 2.4.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## 5.24.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.24.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 5.24.0 ## 5.24.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.24.0 | emr-5.23.1 | emr-5.23.0 | emr-5.22.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.546 | 1.11.519 | 1.11.519 | 1.11.510 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.8.0 | 1.7.1 | 1.7.1 | 1.7.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.9 | 1.4.9 | 1.4.9 | 1.4.9 | | HCatalog | 2.3.4-amzn-2 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | | Hadoop | 2.8.5-amzn-4 | 2.8.5-amzn-3 | 2.8.5-amzn-3 | 2.8.5-amzn-2 | | Hive | 2.3.4-amzn-2 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.4.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.6 | 0.9.4 | 0.9.4 | 0.9.4 | | Livy | 0.6.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.4.0 | 1.3.1 | 1.3.1 | 1.3.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.1.0 | | Phoenix | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,219 | 0,215 | 0,215 | 0,215 | | Spark | 2.4.2 | 2.4.0 | 2.4.0 | 2.4.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | | Tez | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan terbitan 5.24.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.24.0. Perubahan bersifat relatif terhadap 5.23.0. Tanggal rilis awal: 11 Juni 2019 Terakhir diperbarui tanggal: 5 Agustus 2019 **Upgrade** + Flink versi 1.8.0 + Hue versi 4.4.0 + JupyterHub 0.9.6 + Livy versi 0.6.0 + MxNet 1.4.0 + Presto versi 0.219 + Spark versi 2.4.2 + AWS SDK untuk Java 1.11.546 + Konektor dan driver: + DynamoDB Connector versi 4.9.0 + MariaDB Connector versi 2.4.1 + Amazon Redshift JDBC Driver versi 1.2.27.1051 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Spark + Penambahan optimasi untuk memangkas partisi secara dinamis. Optimalisasi dinonaktifkan secara default. Untuk mengaktifkannya, atur parameter konfigurasi Spark dari `spark.sql.dynamicPartitionPruning.enabled` ke `true`. + Peningkatan performa kueri `INTERSECT`. Optimalisasi ini dinonaktifkan secara default. Untuk mengaktifkannya, atur parameter konfigurasi Spark dari `spark.sql.optimizer.distinctBeforeIntersect.enabled` ke `true`. + Penambahan optimalisasi untuk meratakan subkueri scalar dengan agregat yang menggunakan relasi yang sama. Optimalisasi dinonaktifkan secara default. Untuk mengaktifkannya, atur parameter konfigurasi Spark dari `spark.sql.optimizer.flattenScalarSubqueriesWithAggregates.enabled` ke `true`. + Peningkatan seluruh pembuatan kode tahap. Untuk informasi selengkapnya, lihat [Mengoptimalkan Performa Spark](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-performance.html). + Enkripsi Disk Lokal dan Peningkatan Enkripsi S3 dalam Konfigurasi Keamanan (5 Agustus 2019) + Pemisahan pengaturan enkripsi Amazon S3 dari pengaturan enkripsi disk lokal dalam pengaturan konfigurasi keamanan. + Penambahan opsi untuk mengaktifkan enkripsi EBS. Memilih opsi ini akan mengenkripsi volume perangkat asal selain volume penyimpanan. Versi sebelumnya diharuskan menggunakan AMI kustom untuk mengenkripsi volume perangkat asal. + Untuk informasi selengkapnya, lihat [Opsi Enkripsi](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-data-encryption-options.html) di *Panduan Pengelolaan Amazon EMR*. **Masalah yang diketahui** + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## 5.24.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.9.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.8.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.11.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.3.0 | EMR S3Select Connector | | emrfs | 2.33.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.8.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-4 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.9 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.9 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.9 | HBase klien baris perintah. | | hbase-rest-server | 1.4.9 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.9 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.4.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.6 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.6.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.4.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.1- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.1- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,219 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,219 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.2 | Klien baris perintah Spark. | | spark-history-server | 2.4.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## 5.24.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.24.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.23.1 ## 5.23.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.23.1 | emr-5.23.0 | emr-5.22.0 | emr-5.21.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.519 | 1.11.519 | 1.11.510 | 1.11.479 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.7.1 | 1.7.1 | 1.7.1 | 1.7.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.9 | 1.4.9 | 1.4.9 | 1.4.8 | | HCatalog | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-0 | | Hadoop | 2.8.5-amzn-3 | 2.8.5-amzn-3 | 2.8.5-amzn-2 | 2.8.5-amzn-1 | | Hive | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.1.0 | 5.0.0 | | Phoenix | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,215 | 0,215 | 0,215 | 0,215 | | Spark | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | | Tez | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.0 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan terbitan 5.23.1 Ini adalah rilis patch. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. Status dukungan Instance Metadata Service (IMDS) V2: Amazon EMR 5.23.1, 5.27.1 dan 5.32 atau komponen yang lebih baru digunakan untuk semua panggilan IMDS. IMDSv2 Untuk panggilan IMDS dalam kode aplikasi Anda, Anda dapat menggunakan keduanya IMDSv1 dan IMDSv2, atau mengkonfigurasi IMDS untuk digunakan hanya IMDSv2 untuk keamanan tambahan. Untuk rilis EMR 5.x lainnya, IMDSv1 penonaktifan menyebabkan kegagalan startup cluster. ## 5.23.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.8.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.7.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.11.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.2.0 | EMR S3Select Connector | | emrfs | 2.32.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.7.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-3 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.9 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.9 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.9 | HBase klien baris perintah. | | hbase-rest-server | 1.4.9 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.9 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.3.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.1- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.1- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,215 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,215 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.0 | Klien baris perintah Spark. | | spark-history-server | 2.4.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## 5.23.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.23.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.23.0 ## Versi aplikasi 5.23.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.23.0 | emr-5.22.0 | emr-5.21.2 | emr-5.21.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.519 | 1.11.510 | 1.11.479 | 1.11.479 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.7.1 | 1.7.1 | 1.7.0 | 1.7.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.9 | 1.4.9 | 1.4.8 | 1.4.8 | | HCatalog | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | | Hadoop | 2.8.5-amzn-3 | 2.8.5-amzn-2 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | | Hive | 2.3.4-amzn-1 | 2.3.4-amzn-1 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.1.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.1- -1.4 HBase | 4.14.1- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,215 | 0,215 | 0,215 | 0,215 | | Spark | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | | Tez | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.1 | 0.8.1 | 0.8.0 | 0.8.0 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan rilis 5.23.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.23.0. Perubahan bersifat relatif terhadap 5.22.0. Tanggal rilis awal: 01 April 2019 Tanggal terakhir diperbarui: 30 April 2019 **Upgrade** + AWS SDK untuk Java 1.11.519 **Fitur baru** + (30 April 2019) Dengan Amazon EMR 5.23.0 dan yang lebih baru, Anda dapat meluncurkan cluster dengan tiga node utama untuk mendukung ketersediaan aplikasi yang tinggi seperti YARN Resource Manager, HDFS NameNode, Spark, Hive, dan Ganglia. Node primer tidak lagi menjadi titik kegagalan tunggal potensial dengan fitur ini. Jika salah satu node primer gagal, Amazon EMR secara otomatis gagal ke node primer siaga dan mengganti node primer yang gagal dengan yang baru dengan konfigurasi dan tindakan bootstrap yang sama. Untuk informasi selengkapnya, lihat [Merencanakan dan Mengkonfigurasi Node Utama](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-ha.html). **Masalah yang diketahui** + Tez UI (Diperbaiki di Amazon EMR rilis 5.26.0) Tez UI tidak berfungsi pada cluster EMR dengan beberapa node primer. + Hue (Diperbaiki di Amazon EMR rilis 5.24.0) + Hue yang berjalan di Amazon EMR tidak mendukung Solr. Dimulai dengan rilis Amazon EMR 5.20.0, masalah kesalahan konfigurasi menyebabkan Solr diaktifkan dan pesan kesalahan yang tidak berbahaya muncul mirip dengan yang berikut ini: `Solr server could not be contacted properly: HTTPConnectionPool('host=ip-xx-xx-xx-xx.ec2.internal', port=1978): Max retries exceeded with url: /solr/admin/info/system?user.name=hue&doAs=administrator&wt=json (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused',))` **Untuk mencegah pesan kesalahan Solr muncul:** 1. Connect ke baris perintah node primer menggunakan SSH. 1. Gunakan editor teks untuk membuka file `hue.ini`. Contoh: `sudo vim /etc/hue/conf/hue.ini` 1. Cari istilah `appblacklist` dan ubah baris menjadi yang berikut: ``` appblacklist = search ``` 1. Simpan perubahan dan mulai ulang Hue seperti yang ditunjukkan dalam contoh berikut: ``` sudo stop hue; sudo start hue ``` + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## Versi komponen 5.23.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.8.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.7.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.11.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.2.0 | EMR S3Select Connector | | emrfs | 2.32.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.7.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-hdfs-journalnode | 2.8.5-amzn-3 | Layanan HDFS untuk mengelola jurnal filesystem Hadoop pada klaster HA. | | hadoop-httpfs-server | 2.8.5-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.9 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.9 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.9 | HBase klien baris perintah. | | hbase-rest-server | 1.4.9 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.9 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.3.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.1- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.1- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,215 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,215 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.0 | Klien baris perintah Spark. | | spark-history-server | 2.4.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.23.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.23.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.22.0 ## Versi aplikasi 5.22.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.22.0 | emr-5.21.2 | emr-5.21.1 | emr-5.21.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.510 | 1.11.479 | 1.11.479 | 1.11.479 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.7.1 | 1.7.0 | 1.7.0 | 1.7.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.9 | 1.4.8 | 1.4.8 | 1.4.8 | | HCatalog | 2.3.4-amzn-1 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | | Hadoop | 2.8.5-amzn-2 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | | Hive | 2.3.4-amzn-1 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.1.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.1- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,215 | 0,215 | 0,215 | 0,215 | | Spark | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | | Tez | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.1 | 0.8.0 | 0.8.0 | 0.8.0 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan rilis 5.22.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.22.0. Perubahan bersifat relatif terhadap 5.21.0. **penting** Dimulai dengan rilis Amazon EMR 5.22.0, Amazon EMR AWS menggunakan Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Rilis Amazon EMR sebelumnya menggunakan AWS Signature Version 2 dalam beberapa kasus, kecuali catatan rilis menunjukkan bahwa Signature Version 4 digunakan secara eksklusif. Untuk informasi selengkapnya, lihat [Mengautentikasi Permintaan (Versi AWS Tanda Tangan 4)](https://docs.aws.amazon.com/AmazonS3/latest/API/sig-v4-authenticating-requests.html) dan [Permintaan Otentikasi (Versi AWS Tanda Tangan 2)](https://docs.aws.amazon.com/AmazonS3/latest/API/auth-request-sig-v2.html) di Panduan *Pengembang Layanan Penyimpanan Sederhana Amazon*. Tanggal rilis awal: 20 Maret 2019 **Upgrade** + Flink versi 1.7.1 + HBase 1.4.9 + Oozie versi 5.1.0 + Phoenix versi 4.14.1 + Zeppelin versi 0.8.1 + Konektor dan driver: + DynamoDB Connector versi 4.8.0 + MariaDB Connector versi 2.2.6 + Amazon Redshift JDBC Driver versi 1.2.20.1043 **Fitur baru** + Konfigurasi EBS default yang telah dimodifikasi untuk tipe instans EC2 dengan penyimpanan EBS saja. Saat Anda membuat klaster menggunakan Amazon EMR rilis 5.22.0 dan yang lebih baru, jumlah penyimpanan EBS default akan meningkat berdasarkan ukuran instans. Selain itu, kami membagi penyimpanan yang meningkat di beberapa volume, sehingga menghasilkan peningkatan performa IOPS. Jika Anda ingin menggunakan konfigurasi penyimpanan instans EBS yang berbeda, Anda dapat menentukannya ketika Anda membuat klaster EMR atau menambahkan simpul ke klaster yang ada. Untuk informasi selengkapnya tentang jumlah penyimpanan dan jumlah volume yang dialokasikan secara default untuk setiap jenis instans, lihat [Default Penyimpanan EBS untuk Instans](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-storage.html#emr-plan-storage-ebs-storage-default) di *Panduan Pengelolaan Amazon EMR*. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Spark + Memperkenalkan properti konfigurasi baru untuk Spark di YARN, `spark.yarn.executor.memoryOverheadFactor`. Nilai properti ini adalah faktor menskalakan yang menentukan nilai overhead memori ke persentase memori pelaksana, dengan minimal 384 MB. Jika overhead memori diatur secara eksplisit menggunakan `spark.yarn.executor.memoryOverhead`, maka properti ini tidak berpengaruh. Nilai default-nya adalah `0.1875`, mewakili 18,75%. Default ini, bagi Amazon EMR menghasilkan lebih banyak ruang dalam kontainer YARN untuk overhead memori pelaksana sebesar 10% dari default yang diatur secara internal oleh Spark. Default Amazon EMR sebesar 18,75% secara empiris menunjukkan lebih sedikit terjadinya gagal terkait memori dalam tolok ukur TPC-DS. + [SPARK-26316](https://issues.apache.org/jira/browse/SPARK-26316) telah di-backporting untuk meningkatkan performa. + Di Amazon EMR versi 5.19.0, 5.20.0, dan 5.21.0, label simpul YARN disimpan dalam direktori HDFS. Dalam beberapa situasi, hal ini menyebabkan penundaan mulai simpul inti dan kemudian menyebabkan klaster mengalami habis waktu dan gagal peluncuran. Dimulai dengan Amazon EMR 5.22.0, masalah ini telah diselesaikan. Label simpul YARN disimpan pada disk lokal dari setiap simpul klaster, menghindari dependensi pada HDFS. **Masalah yang diketahui** + Hue (Diperbaiki di Amazon EMR rilis 5.24.0) + Hue yang berjalan di Amazon EMR tidak mendukung Solr. Dimulai dengan rilis Amazon EMR 5.20.0, masalah kesalahan konfigurasi menyebabkan Solr diaktifkan dan pesan kesalahan yang tidak berbahaya muncul mirip dengan yang berikut ini: `Solr server could not be contacted properly: HTTPConnectionPool('host=ip-xx-xx-xx-xx.ec2.internal', port=1978): Max retries exceeded with url: /solr/admin/info/system?user.name=hue&doAs=administrator&wt=json (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused',))` **Untuk mencegah pesan kesalahan Solr muncul:** 1. Connect ke baris perintah node primer menggunakan SSH. 1. Gunakan editor teks untuk membuka file `hue.ini`. Contoh: `sudo vim /etc/hue/conf/hue.ini` 1. Cari istilah `appblacklist` dan ubah baris menjadi yang berikut: ``` appblacklist = search ``` 1. Simpan perubahan dan mulai ulang Hue seperti yang ditunjukkan dalam contoh berikut: ``` sudo stop hue; sudo start hue ``` + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## Versi komponen 5.22.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.8.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.6.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.11.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.2.0 | EMR S3Select Connector | | emrfs | 2.31.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.7.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.5-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.9 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.9 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.9 | HBase klien baris perintah. | | hbase-rest-server | 1.4.9 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.9 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.3.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.1.0 | Klien baris perintah Oozie. | | oozie-server | 5.1.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.1- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.1- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,215 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,215 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.0 | Klien baris perintah Spark. | | spark-history-server | 2.4.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.22.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.22.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.21.2 ## 5.21.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.21.2 | emr-5.21.1 | emr-5.21.0 | emr-5.20.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.479 | 1.11.479 | 1.11.479 | 1.11.461 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.7.0 | 1.7.0 | 1.7.0 | 1.6.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.8 | 1.4.8 | 1.4.8 | 1.4.8 | | HCatalog | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | | Hadoop | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | | Hive | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,215 | 0,215 | 0,215 | 0,214 | | Spark | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | | Tez | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan terbitan 5.21.2 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.21.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.1 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.11.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.2.0 | EMR S3Select Connector | | emrfs | 2.30.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.7.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.5-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.8 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.8 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.8 | HBase klien baris perintah. | | hbase-rest-server | 1.4.8 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.8 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.3.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,215 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,215 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.0 | Klien baris perintah Spark. | | spark-history-server | 2.4.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## 5.21.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.21.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.21.1 ## 5.21.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.21.1 | emr-5.21.0 | emr-5.20.1 | emr-5.20.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.479 | 1.11.479 | 1.11.461 | 1.11.461 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.12 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.7.0 | 1.7.0 | 1.6.2 | 1.6.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.8 | 1.4.8 | 1.4.8 | 1.4.8 | | HCatalog | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | | Hadoop | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | | Hive | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,215 | 0,215 | 0,214 | 0,214 | | Spark | 2.4.0 | 2.4.0 | 2.4.0 | 2.4.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.12.0 | 1.12.0 | 1.12.0 | | Tez | 0.9.1 | 0.9.1 | 0.9.1 | 0.9.1 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan terbitan 5.21.1 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.21.1. Perubahan bersifat relatif terhadap 5.21.0. Tanggal rilis awal: 18 Juli 2019 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + [Memperbarui AMI Linux Amazon default untuk Amazon EMR untuk menyertakan pembaruan keamanan kernel Linux yang penting, termasuk TCP SACK Denial of Service Issue (AWS-2019-005).](https://aws.amazon.com/security/security-bulletins/AWS-2019-005/) **Masalah yang diketahui** + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## 5.21.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.1 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.11.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.2.0 | EMR S3Select Connector | | emrfs | 2.30.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.7.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.5-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.8 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.8 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.8 | HBase klien baris perintah. | | hbase-rest-server | 1.4.8 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.8 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.3.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,215 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,215 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.0 | Klien baris perintah Spark. | | spark-history-server | 2.4.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## 5.21.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.21.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.21.0 ## 5.21.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.21.0 | emr-5.20.1 | emr-5.20.0 | emr-5.19.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.479 | 1.11.461 | 1.11.461 | 1.11.433 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.4 | | Skala | 2.11.12 | 2.11.12 | 2.11.12 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.7.0 | 1.6.2 | 1.6.2 | 1.6.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.8 | 1.4.8 | 1.4.8 | 1.4.7 | | HCatalog | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.3-amzn-2 | | Hadoop | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-0 | | Hive | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.3-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.3.0 | 4.3.0 | 4.3.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,215 | 0,214 | 0,214 | 0,212 | | Spark | 2.4.0 | 2.4.0 | 2.4.0 | 2.3.2 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.12.0 | 1.12.0 | 1.11.0 | | Tez | 0.9.1 | 0.9.1 | 0.9.1 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan terbitan 5.21.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.21.0. Perubahan bersifat relatif terhadap 5.20.0. Tanggal rilis awal: 18 Februari 2019 Tanggal terakhir diperbarui: 3 April 2019 **Upgrade** + Flink versi 1.7.0 + Presto versi 0.215 + AWS SDK untuk Java 1.11.479 **Fitur baru** + (3 April 2019) Dengan Amazon EMR versi 5.21.0 dan versi setelahnya, Anda dapat mengganti konfigurasi klaster dan menentukan klasifikasi konfigurasi tambahan untuk setiap grup instans di klaster yang berjalan. Anda melakukannya dengan menggunakan konsol EMR Amazon, AWS Command Line Interface (AWS CLI), atau SDK AWS . Untuk informasi selengkapnya, lihat [Menyediakan Konfigurasi untuk Grup Instans dalam Klaster Berjalan](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps-running-cluster.html). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Zeppelin + [ZEPPELIN-3878](https://issues.apache.org/jira/browse/ZEPPELIN-3878) yang telah di-backport. **Masalah yang diketahui** + Hue (Diperbaiki di Amazon EMR rilis 5.24.0) + Hue yang berjalan di Amazon EMR tidak mendukung Solr. Dimulai dengan rilis Amazon EMR 5.20.0, masalah kesalahan konfigurasi menyebabkan Solr diaktifkan dan pesan kesalahan yang tidak berbahaya muncul mirip dengan yang berikut ini: `Solr server could not be contacted properly: HTTPConnectionPool('host=ip-xx-xx-xx-xx.ec2.internal', port=1978): Max retries exceeded with url: /solr/admin/info/system?user.name=hue&doAs=administrator&wt=json (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused',))` **Untuk mencegah pesan kesalahan Solr muncul:** 1. Connect ke baris perintah node primer menggunakan SSH. 1. Gunakan editor teks untuk membuka file `hue.ini`. Contoh: `sudo vim /etc/hue/conf/hue.ini` 1. Cari istilah `appblacklist` dan ubah baris menjadi yang berikut: ``` appblacklist = search ``` 1. Simpan perubahan dan mulai ulang Hue seperti yang ditunjukkan dalam contoh berikut: ``` sudo stop hue; sudo start hue ``` + Tez + Masalah ini telah diperbaiki di Amazon EMR 5.22.0. Saat Anda terhubung ke UI Tez di http: //:8080/tez-ui *MasterDNS* melalui koneksi SSH ke node utama cluster, kesalahan “Operasi adaptor gagal - Server Timeline (ATS) berada di luar jangkauan. Entah karena rusak, atau CORS tidak diaktifkan" muncul, atau tugas tiba-tiba menunjukkan N/A. Hal ini disebabkan oleh UI Tez membuat permintaan ke YARN Timeline Server menggunakan `localhost` bukan nama host dari node utama. Solusinya, skrip tersedia untuk menjalankan sebagai tindakan bootstrap atau langkah. Skrip memperbarui nama host di file `configs.env` Tez. Untuk informasi selengkapnya dan lokasi skrip, lihat [Petunjuk Bootstrap](http://awssupportdatasvcs.com/bootstrap-actions/fix_tez_ui_0-9-1/). + Di Amazon EMR versi 5.19.0, 5.20.0, dan 5.21.0, label simpul YARN disimpan dalam direktori HDFS. Dalam beberapa situasi, hal ini menyebabkan penundaan mulai simpul inti dan kemudian menyebabkan klaster mengalami habis waktu dan gagal peluncuran. Dimulai dengan Amazon EMR 5.22.0, masalah ini telah diselesaikan. Label simpul YARN disimpan pada disk lokal dari setiap simpul klaster, menghindari dependensi pada HDFS. + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## 5.21.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.1 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.11.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.2.0 | EMR S3Select Connector | | emrfs | 2.30.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.7.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.5-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.8 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.8 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.8 | HBase klien baris perintah. | | hbase-rest-server | 1.4.8 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.8 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.3.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,215 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,215 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.0 | Klien baris perintah Spark. | | spark-history-server | 2.4.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## 5.21.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.21.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.20.1 ## 5.20.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.20.1 | emr-5.20.0 | emr-5.19.1 | emr-5.19.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.461 | 1.11.461 | 1.11.433 | 1.11.433 | | Python | 2.7, 3.6 | 2.7, 3.6 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.12 | 2.11.12 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.6.2 | 1.6.2 | 1.6.1 | 1.6.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.8 | 1.4.8 | 1.4.7 | 1.4.7 | | HCatalog | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.3-amzn-2 | 2.3.3-amzn-2 | | Hadoop | 2.8.5-amzn-1 | 2.8.5-amzn-1 | 2.8.5-amzn-0 | 2.8.5-amzn-0 | | Hive | 2.3.4-amzn-0 | 2.3.4-amzn-0 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.3.0 | 4.3.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.9.4 | 0.9.4 | 0.9.4 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.1 | 1.3.1 | 1.3.0 | 1.3.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,214 | 0,214 | 0,212 | 0,212 | | Spark | 2.4.0 | 2.4.0 | 2.3.2 | 2.3.2 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.12.0 | 1.11.0 | 1.11.0 | | Tez | 0.9.1 | 0.9.1 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.13 | ## Catatan terbitan 5.20.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.20.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.1 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.2.0 | EMR S3Select Connector | | emrfs | 2.29.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.6.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.5-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.8 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.8 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.8 | HBase klien baris perintah. | | hbase-rest-server | 1.4.8 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.8 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.3.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,214 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,214 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.0 | Klien baris perintah Spark. | | spark-history-server | 2.4.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## 5.20.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.20.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.20.0 ## Versi aplikasi 5.20.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.20.0 | emr-5.19.1 | emr-5.19.0 | emr-5.18.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.461 | 1.11.433 | 1.11.433 | 1.11.393 | | Python | 2.7, 3.6 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.12 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.6.2 | 1.6.1 | 1.6.1 | 1.6.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.8 | 1.4.7 | 1.4.7 | 1.4.7 | | HCatalog | 2.3.4-amzn-0 | 2.3.3-amzn-2 | 2.3.3-amzn-2 | 2.3.3-amzn-2 | | Hadoop | 2.8.5-amzn-1 | 2.8.5-amzn-0 | 2.8.5-amzn-0 | 2.8.4-amzn-1 | | Hive | 2.3.4-amzn-0 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.3.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.9.4 | 0.9.4 | 0.8.1 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.1 | 1.3.0 | 1.3.0 | 1.2.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,214 | 0,212 | 0,212 | 0.210 | | Spark | 2.4.0 | 2.3.2 | 2.3.2 | 2.3.2 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.12.0 | 1.11.0 | 1.11.0 | 1.9.0 | | Tez | 0.9.1 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.13 | 3.4.12 | ## Catatan rilis 5.20.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.20.0. Perubahan bersifat relatif terhadap 5.19.0. Tanggal rilis awal: 18 Desember 2018 Tanggal diperbarui: 22 Januari 2019 **Upgrade** + Flink versi 1.6.2 + HBase 1.4.8 + Hive versi 2.3.4 + Hue versi 4.3.0 + MXNet 1.3.1 + Presto versi 0.214 + Spark versi 2.4.0 + TensorFlow 1.12.0 + Tez versi 0.9.1 + AWS SDK untuk Java 1.11.461 **Fitur baru** + (22 Januari 2019) Kerberos di Amazon EMR telah ditingkatkan untuk mendukung autentikasi prinsipal utama dari KDC eksternal. Ini memusatkan manajemen prinsipal utama karena beberapa klaster dapat berbagi satu KDC eksternal. Selain itu, KDC eksternal dapat memiliki kepercayaan lintas-alam dengan domain Direktori Aktif. Hal ini mengizinkan semua klaster untuk melakukan autentikasi prinsipal utama dari Direktori Aktif. Untuk informasi selengkapnya, lihat [Menggunakan Autentikasi Kerberos](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-kerberos.html) di *Panduan Pengelolaan Amazon EMR*. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Default Amazon Linux AMI para Amazon EMR + Paket Python3 sudah ditingkatkan dari python 3.4 ke 3.6. + EMRFS S3-optimized committer + EMRFS S3-optimized committer sekarang sudah diaktifkan secara default, yang akan meningkatkan performa tulis. Untuk informasi selengkapnya, lihat [Gunakan committer yang dioptimalkan EMRFS S3](emr-spark-s3-optimized-committer.md). + Hive + [HIVE-16686](https://issues.apache.org/jira/browse/HIVE-16686) yang telah di-backport. + Glue dengan Spark dan Hive + Di EMR 5.20.0 atau yang lebih baru, pemangkasan partisi paralel diaktifkan secara otomatis untuk Spark dan Hive saat AWS Glue Data Catalog digunakan sebagai metastore. Perubahan ini secara signifikan mengurangi waktu perencanaan kueri dengan mengeksekusi beberapa permintaan secara paralel untuk mengambil partisi. Jumlah segmen yang dapat dieksekusi secara bersamaan berkisar antara 1 dan 10. Nilai default-nya adalah 5, yang merupakan pengaturan yang disarankan. Anda dapat mengubahnya dengan menentukan properti `aws.glue.partition.num.segments` dalam klasifikasi konfigurasi `hive-site`. Jika terjadi throttling, Anda dapat mematikan fitur ini dengan mengubah nilai-nya menjadi 1. Untuk informasi selengkapnya, lihat [Struktur Segmen Glue AWS](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-api-catalog-partitions.html#aws-glue-api-catalog-partitions-Segment). **Masalah yang diketahui** + Hue (Diperbaiki di Amazon EMR rilis 5.24.0) + Hue yang berjalan di Amazon EMR tidak mendukung Solr. Dimulai dengan rilis Amazon EMR 5.20.0, masalah kesalahan konfigurasi menyebabkan Solr diaktifkan dan pesan kesalahan yang tidak berbahaya muncul mirip dengan yang berikut ini: `Solr server could not be contacted properly: HTTPConnectionPool('host=ip-xx-xx-xx-xx.ec2.internal', port=1978): Max retries exceeded with url: /solr/admin/info/system?user.name=hue&doAs=administrator&wt=json (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused',))` **Untuk mencegah pesan kesalahan Solr muncul:** 1. Connect ke baris perintah node primer menggunakan SSH. 1. Gunakan editor teks untuk membuka file `hue.ini`. Contoh: `sudo vim /etc/hue/conf/hue.ini` 1. Cari istilah `appblacklist` dan ubah baris menjadi yang berikut: ``` appblacklist = search ``` 1. Simpan perubahan dan mulai ulang Hue seperti yang ditunjukkan dalam contoh berikut: ``` sudo stop hue; sudo start hue ``` + Tez + Masalah ini telah diperbaiki di Amazon EMR 5.22.0. Saat Anda terhubung ke UI Tez di http: //:8080/tez-ui *MasterDNS* melalui koneksi SSH ke node utama cluster, kesalahan “Operasi adaptor gagal - Server Timeline (ATS) berada di luar jangkauan. Entah karena rusak, atau CORS tidak diaktifkan" muncul, atau tugas tiba-tiba menunjukkan N/A. Hal ini disebabkan oleh UI Tez membuat permintaan ke YARN Timeline Server menggunakan `localhost` bukan nama host dari node utama. Solusinya, skrip tersedia untuk menjalankan sebagai tindakan bootstrap atau langkah. Skrip memperbarui nama host di file `configs.env` Tez. Untuk informasi selengkapnya dan lokasi skrip, lihat [Petunjuk Bootstrap](http://awssupportdatasvcs.com/bootstrap-actions/fix_tez_ui_0-9-1/). + Di Amazon EMR versi 5.19.0, 5.20.0, dan 5.21.0, label simpul YARN disimpan dalam direktori HDFS. Dalam beberapa situasi, hal ini menyebabkan penundaan mulai simpul inti dan kemudian menyebabkan klaster mengalami habis waktu dan gagal peluncuran. Dimulai dengan Amazon EMR 5.22.0, masalah ini telah diselesaikan. Label simpul YARN disimpan pada disk lokal dari setiap simpul klaster, menghindari dependensi pada HDFS. + Masalah yang diketahui dalam cluster dengan beberapa node primer dan otentikasi Kerberos Jika Anda menjalankan cluster dengan beberapa node utama dan otentikasi Kerberos di Amazon EMR rilis 5.20.0 dan yang lebih baru, Anda mungkin mengalami masalah dengan operasi klaster seperti penurunan skala atau pengiriman langkah, setelah klaster berjalan selama beberapa waktu. Periode waktunya tergantung pada masa validitas tiket Kerberos yang Anda tetapkan. Masalah menurunkan skala akan berdampak pada permintaan menurunkan skala otomatis dan permintaan menurunkan skala eksplisit yang Anda kirimkan. Operasi klaster tambahan juga dapat terkena dampak. Pemecahan masalah: + SSH sebagai `hadoop` pengguna ke node utama utama dari cluster EMR dengan beberapa node primer. + Jalankan perintah berikut untuk memperbarui tiket Kerberos untuk pengguna `hadoop`. ``` kinit -kt ``` Biasanya, fail keytab terletak di `/etc/hadoop.keytab` dan file utama-nya dalam bentuk `hadoop/@`. **catatan** Pemecahan masalah ini akan efektif untuk jangka waktu selama tiket Kerberos berlaku. Durasi ini adalah 10 jam secara default, tetapi dapat dikonfigurasi dengan pengaturan Kerberos Anda. Anda harus menjalankan kembali perintah di atas setelah tiket Kerberos berakhir. ## Versi komponen 5.20.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.1 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.2.0 | EMR S3Select Connector | | emrfs | 2.29.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.6.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.5-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.8 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.8 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.8 | HBase klien baris perintah. | | hbase-rest-server | 1.4.8 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.8 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.4-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.4-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.4-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.4-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.4-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.4-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.4-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.3.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.1 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,214 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,214 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.4.0 | Klien baris perintah Spark. | | spark-history-server | 2.4.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.4.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.4.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.12.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.9.1 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.20.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.20.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.19.1 ## 5.19.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.19.1 | emr-5.19.0 | emr-5.18.1 | emr-5.18.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.433 | 1.11.433 | 1.11.393 | 1.11.393 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.6.1 | 1.6.1 | 1.6.0 | 1.6.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | HCatalog | 2.3.3-amzn-2 | 2.3.3-amzn-2 | 2.3.3-amzn-2 | 2.3.3-amzn-2 | | Hadoop | 2.8.5-amzn-0 | 2.8.5-amzn-0 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | | Hive | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.9.4 | 0.8.1 | 0.8.1 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.0 | 1.3.0 | 1.2.0 | 1.2.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,212 | 0,212 | 0.210 | 0.210 | | Spark | 2.3.2 | 2.3.2 | 2.3.2 | 2.3.2 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.11.0 | 1.11.0 | 1.9.0 | 1.9.0 | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.0 | 0.8.0 | 0.8.0 | 0.8.0 | | ZooKeeper | 3.4.13 | 3.4.13 | 3.4.12 | 3.4.12 | ## Catatan terbitan 5.19.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.19.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.1 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.1.0 | EMR S3Select Connector | | emrfs | 2.28.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.6.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.5-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.7 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.7 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.7 | HBase klien baris perintah. | | hbase-rest-server | 1.4.7 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.7 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,212 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,212 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.2 | Klien baris perintah Spark. | | spark-history-server | 2.3.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## 5.19.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.19.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 5.19.0 ## Versi aplikasi 5.19.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.19.0 | emr-5.18.1 | emr-5.18.0 | emr-5.17.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.433 | 1.11.393 | 1.11.393 | 1.11.336 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.6.1 | 1.6.0 | 1.6.0 | 1.5.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.6 | | HCatalog | 2.3.3-amzn-2 | 2.3.3-amzn-2 | 2.3.3-amzn-2 | 2.3.3-amzn-1 | | Hadoop | 2.8.5-amzn-0 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | | Hive | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.9.4 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.3.0 | 1.2.0 | 1.2.0 | 1.2.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,212 | 0.210 | 0.210 | 0,206 | | Spark | 2.3.2 | 2.3.2 | 2.3.2 | 2.3.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.11.0 | 1.9.0 | 1.9.0 | 1.9.0 | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.0 | 0.8.0 | 0.8.0 | 0.7.3 | | ZooKeeper | 3.4.13 | 3.4.12 | 3.4.12 | 3.4.12 | ## Catatan rilis 5.19.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.19.0. Perubahan bersifat relatif terhadap 5.18.0. Tanggal rilis awal: 7 November 2018 Tanggal diperbarui: 19 November 2018 **Upgrade** + Hadoop versi 2.8.5 + Flink versi 1.6.1 + JupyterHub 0.9.4 + MXNet 1.3.0 + Presto versi 0.212 + TensorFlow 1.11.0 + Zookeeper versi 3.4.13 + AWS SDK untuk Java 1.11.433 **Fitur baru** + (19 November 2018) EMR Notebooks adalah lingkungan terkelola berbasis Notebook Jupyter. Ini mendukung kernel ajaib Spark untuk PySpark, Spark SQL, Spark R, dan Scala. EMR Notebooks dapat digunakan dengan cluster yang dibuat menggunakan Amazon EMR rilis 5.18.0 dan yang lebih baru. Untuk informasi selengkapnya, lihat [Menggunakan EMR Notebooks](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-managed-notebooks.html) di *Panduan Pengelolaan Amazon EMR*. + Committer yang dioptimalkan EMRFS S3 tersedia saat menulis file Parquet menggunakan Spark dan EMRFS. Committer ini meningkatkan performa tulis. Untuk informasi selengkapnya, lihat [Gunakan committer yang dioptimalkan EMRFS S3](emr-spark-s3-optimized-committer.md). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + YARN + Logika yang telah dimodifikasi yang dapat membatasi proses utama aplikasi untuk berjalan pada simpul inti. Fungsi ini sekarang menggunakan fitur label dan properti simpul YARN di `yarn-site` dan klasifikasi konfigurasi `capacity-scheduler`. Untuk informasi, lihat [https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-instances-guidelines.html#emr-plan-spot-YARN.](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-instances-guidelines.html#emr-plan-spot-YARN.) + Default Amazon Linux AMI para Amazon EMR + `ruby18`, `php56`, dan `gcc48` tidak lagi diinstal secara default. Semua itu dapat diinstal jika diinginkan dengan menggunakan `yum`. + Permata ruby aws-sdk tidak lagi diinstal secara default. Itu dapat diinstal menggunakan `gem install aws-sdk`, jika diinginkan. Komponen khusus juga bisa diinstal. Misalnya, `gem install aws-sdk-s3`. **Masalah yang diketahui** + **EMR Notebooks**—Dalam beberapa situasi, dengan beberapa editor notebook terbuka, editor notebook mungkin sepertinya tidak dapat terhubung ke klaster. Jika hal ini terjadi, hapus cookie peramban dan kemudian buka kembali editor notebook. + **CloudWatch ContainerPending Penskalaan Metrik dan Otomatis** - (Diperbaiki di 5.20.0) Amazon EMR dapat memancarkan nilai negatif untuk. `ContainerPending` Jika `ContainerPending` digunakan dalam aturan penskalaan otomatis, maka penskalaan otomatis tidak akan berperilaku seperti yang diharapkan. Hindari penggunaan `ContainerPending` dengan penskalaan otomatis. + Di Amazon EMR versi 5.19.0, 5.20.0, dan 5.21.0, label simpul YARN disimpan dalam direktori HDFS. Dalam beberapa situasi, hal ini menyebabkan penundaan mulai simpul inti dan kemudian menyebabkan klaster mengalami habis waktu dan gagal peluncuran. Dimulai dengan Amazon EMR 5.22.0, masalah ini telah diselesaikan. Label simpul YARN disimpan pada disk lokal dari setiap simpul klaster, menghindari dependensi pada HDFS. ## Versi komponen 5.19.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.2.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.7.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.1 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.1.0 | EMR S3Select Connector | | emrfs | 2.28.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.6.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.5-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.5-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.5-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.5-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.5-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.5-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.5-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.5-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.5-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.5-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.7 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.7 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.7 | HBase klien baris perintah. | | hbase-rest-server | 1.4.7 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.7 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.9.4 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.3.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,212 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,212 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.2 | Klien baris perintah Spark. | | spark-history-server | 2.3.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.11.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.13 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.13 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.19.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.19.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-memory | Ubah nilai dalam file memory.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | presto-connector-tpcds | Ubah nilai dalam file tpcds.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.18.1 ## 5.18.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.18.1 | emr-5.18.0 | emr-5.17.2 | emr-5.17.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.393 | 1.11.393 | 1.11.336 | 1.11.336 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.6.0 | 1.6.0 | 1.5.2 | 1.5.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.7 | 1.4.7 | 1.4.6 | 1.4.6 | | HCatalog | 2.3.3-amzn-2 | 2.3.3-amzn-2 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hadoop | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | | Hive | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.210 | 0.210 | 0,206 | 0,206 | | Spark | 2.3.2 | 2.3.2 | 2.3.1 | 2.3.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.0 | 0.8.0 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | ## Catatan terbitan 5.18.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.18.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.1.3 | Amazon SageMaker Spark SDK | | emr-ddb | 4.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.1.0 | EMR S3Select Connector | | emrfs | 2.27.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.6.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.4-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.4-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.4-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.4-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.4-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.4-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.4-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.4-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.7 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.7 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.7 | HBase klien baris perintah. | | hbase-rest-server | 1.4.7 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.7 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.2.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.210 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.210 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.2 | Klien baris perintah Spark. | | spark-history-server | 2.3.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.9.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.12 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.12 | ZooKeeper klien baris perintah. | ## 5.18.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.18.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.18.0 ## Versi aplikasi 5.18.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.18.0 | emr-5.17.2 | emr-5.17.1 | emr-5.17.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.393 | 1.11.336 | 1.11.336 | 1.11.336 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.6.0 | 1.5.2 | 1.5.2 | 1.5.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.7 | 1.4.6 | 1.4.6 | 1.4.6 | | HCatalog | 2.3.3-amzn-2 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hadoop | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | | Hive | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0.210 | 0,206 | 0,206 | 0,206 | | Spark | 2.3.2 | 2.3.1 | 2.3.1 | 2.3.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.9.0 | 1.9.0 | 1.9.0 | 1.9.0 | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.8.0 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | ## Catatan rilis 5.18.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.18.0. Perubahan bersifat relatif terhadap 5.17.0. Tanggal rilis awal: 24 Oktober 2018 **Upgrade** + Flink versi 1.6.0 + HBase 1.4.7 + Presto versi 0.210 + Spark versi 2.3.2 + Zeppelin versi 0.8.0 **Fitur baru** + Dimulai dengan Amazon EMR 5.18.0, Anda dapat menggunakan repositori artefak Amazon EMR untuk membuat kode pekerjaan Anda terhadap versi pustaka dan dependensi yang tepat yang tersedia dengan rilis EMR Amazon tertentu. Untuk informasi selengkapnya, lihat [Memeriksa dependensi menggunakan repositori artefak Amazon EMR](emr-artifact-repository.md). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Hive + Penambahan support untuk S3 SelectPilih. Untuk informasi selengkapnya, lihat [Menggunakan S3 Select dengan Hive untuk meningkatkan performa](emr-hive-s3select.md). + Presto + Penambahan support untuk [S3 Select](https://aws.amazon.com/blogs/aws/s3-glacier-select/) Pushdown. Untuk informasi selengkapnya, lihat [Menggunakan S3 Pilih Pushdown dengan Presto untuk meningkatkan kinerja](emr-presto-s3select.md). + Spark + Konfigurasi log4j default untuk Spark telah diubah untuk me-roll log kontainer setiap satu jam untuk tugas Spark Streaming. Hal ini membantu mencegah penghapusan log tugas Spark Streaming dalam waktu lama. ## Versi komponen 5.18.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.1.3 | Amazon SageMaker Spark SDK | | emr-ddb | 4.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.1.0 | EMR S3Select Connector | | emrfs | 2.27.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.6.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.4-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.4-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.4-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.4-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.4-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.4-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.4-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.4-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.7 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.7 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.7 | HBase klien baris perintah. | | hbase-rest-server | 1.4.7 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.7 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | nginx | 1.12.1 | nginx [engine x] adalah server HTTP dan server proksi balik | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.2.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.210 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.210 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.2 | Klien baris perintah Spark. | | spark-history-server | 2.3.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.9.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.8.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.12 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.12 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.18.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.18.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.17.2 ## 5.17.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.17.2 | emr-5.17.1 | emr-5.17.0 | emr-5.16.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.336 | 1.11.336 | 1.11.336 | 1.11.336 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.5.2 | 1.5.2 | 1.5.2 | 1.5.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.4 | | HCatalog | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hadoop | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-0 | | Hive | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,206 | 0,206 | 0,206 | 0,203 | | Spark | 2.3.1 | 2.3.1 | 2.3.1 | 2.3.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.9.0 | 1.9.0 | 1.9.0 | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | ## Catatan terbitan 5.17.2 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.17.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.1.3 | Amazon SageMaker Spark SDK | | emr-ddb | 4.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.0.0 | EMR S3Select Connector | | emrfs | 2.26.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.5.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.4-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.4-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.4-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.4-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.4-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.4-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.4-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.4-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.6 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.6 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.6 | HBase klien baris perintah. | | hbase-rest-server | 1.4.6 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.6 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.2.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,206 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,206 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.1 | Klien baris perintah Spark. | | spark-history-server | 2.3.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.9.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.12 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.12 | ZooKeeper klien baris perintah. | ## 5.17.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.17.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.17.1 ## 5.17.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.17.1 | emr-5.17.0 | emr-5.16.1 | emr-5.16.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.336 | 1.11.336 | 1.11.336 | 1.11.336 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.5.2 | 1.5.2 | 1.5.0 | 1.5.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.6 | 1.4.6 | 1.4.4 | 1.4.4 | | HCatalog | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hadoop | 2.8.4-amzn-1 | 2.8.4-amzn-1 | 2.8.4-amzn-0 | 2.8.4-amzn-0 | | Hive | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | | MXNet | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,206 | 0,206 | 0,203 | 0,203 | | Spark | 2.3.1 | 2.3.1 | 2.3.1 | 2.3.1 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.9.0 | 1.9.0 | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | ## Catatan terbitan 5.17.1 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.17.1. Perubahan bersifat relatif terhadap 5.17.0. Tanggal rilis awal: 18 Juli 2019 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + [Memperbarui AMI Linux Amazon default untuk Amazon EMR untuk menyertakan pembaruan keamanan kernel Linux yang penting, termasuk TCP SACK Denial of Service Issue (AWS-2019-005).](https://aws.amazon.com/security/security-bulletins/AWS-2019-005/) ## 5.17.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.1.3 | Amazon SageMaker Spark SDK | | emr-ddb | 4.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.0.0 | EMR S3Select Connector | | emrfs | 2.26.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.5.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.4-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.4-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.4-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.4-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.4-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.4-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.4-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.4-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.6 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.6 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.6 | HBase klien baris perintah. | | hbase-rest-server | 1.4.6 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.6 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.2.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,206 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,206 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.1 | Klien baris perintah Spark. | | spark-history-server | 2.3.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.9.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.12 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.12 | ZooKeeper klien baris perintah. | ## 5.17.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.17.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 5.17.0 ## 5.17.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://www.tensorflow.org/](https://www.tensorflow.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.17.0 | emr-5.16.1 | emr-5.16.0 | emr-5.15.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.336 | 1.11.336 | 1.11.336 | 1.11.333 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.5.2 | 1.5.0 | 1.5.0 | 1.4.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.6 | 1.4.4 | 1.4.4 | 1.4.4 | | HCatalog | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-0 | | Hadoop | 2.8.4-amzn-1 | 2.8.4-amzn-0 | 2.8.4-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.5.0-incubating | 0.4.0-incubating | | MXNet | 1.2.0 | 1.2.0 | 1.2.0 | 1.1.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,206 | 0,203 | 0,203 | 0,194 | | Spark | 2.3.1 | 2.3.1 | 2.3.1 | 2.3.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | 1.9.0 | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | ## Catatan terbitan 5.17.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.17.0. Perubahan bersifat relatif terhadap 5.16.0. Tanggal rilis awal: 30 Agustus 2018 **Upgrade** + Flink versi 1.5.2 + HBase 1.4.6 + Presto versi 0.206 **Fitur baru** + Penambahan support untuk Tensorflow. Untuk informasi selengkapnya, lihat [TensorFlow](emr-tensorflow.md). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + JupyterHub + Penambahan support untuk persistensi notebook di Amazon S3. Untuk informasi selengkapnya, lihat [Mengonfigurasi ketekunan untuk notebook di Amazon S3](emr-jupyterhub-s3.md). + Spark + Dukungan tambahan untuk [S3 Select](https://aws.amazon.com/blogs/aws/s3-glacier-select/). Untuk informasi selengkapnya, lihat [Gunakan S3 Select dengan Spark untuk meningkatkan kinerja kueri](emr-spark-s3select.md). + Penyelesaian masalah dengan metrik Cloudwatch dan fitur penskalaan otomatis di Amazon EMR versi 5.14.0, 5.15.0, atau 5.16.0. **Masalah yang diketahui** + Ketika Anda membuat klaster kerberized dengan Livy yang diinstal, maka Livy akan gagal dengan pesan kesalahan bahwa autentikasi sederhana tidak diaktifkan. Melakukan reboot server Livy akan menyelesaikan masalah ini. Sebagai solusinya, tambahkan langkah selama pembuatan cluster yang berjalan `sudo restart livy-server` pada node utama. + Jika Anda menggunakan AMI Amazon Linux khusus berdasarkan AMI Amazon Linux dengan tanggal pembuatan 2018-08-11, server Oozie gagal memulai. Jika Anda menggunakan Oozie, buat AMI kustom berdasarkan ID AMI Amazon Linux dengan tanggal pembuatan yang berbeda. Anda dapat menggunakan AWS CLI perintah berikut untuk mengembalikan daftar Gambar IDs untuk semua HVM Amazon Linux AMIs dengan versi 2018.03, bersama dengan tanggal rilis, sehingga Anda dapat memilih AMI Amazon Linux yang sesuai sebagai basis Anda. Ganti MyRegion dengan pengenal Wilayah Anda, seperti us-west-2. ``` aws ec2 --region MyRegion describe-images --owner amazon --query 'Images[?Name!=`null`]|[?starts_with(Name, `amzn-ami-hvm-2018.03`) == `true`].[CreationDate,ImageId,Name]' --output text | sort -rk1 ``` ## 5.17.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.1.3 | Amazon SageMaker Spark SDK | | emr-ddb | 4.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.5.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emr-s3-select | 1.0.0 | EMR S3Select Connector | | emrfs | 2.26.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.5.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.4-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.4-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.4-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.4-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.4-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.4-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.4-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.4-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.4-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.6 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.6 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.6 | HBase klien baris perintah. | | hbase-rest-server | 1.4.6 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.6 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.2.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,206 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,206 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.1 | Klien baris perintah Spark. | | spark-history-server | 2.3.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tensorflow | 1.9.0 | TensorFlow pustaka perangkat lunak open source untuk perhitungan numerik kinerja tinggi. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.12 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.12 | ZooKeeper klien baris perintah. | ## 5.17.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.17.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-s3-conf | Konfigurasikan persistensi Jupyter Notebook S3. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.16.1 ## 5.16.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.16.1 | emr-5.16.0 | emr-5.15.1 | emr-5.15.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.336 | 1.11.336 | 1.11.333 | 1.11.333 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.5.0 | 1.5.0 | 1.4.2 | 1.4.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.4 | 1.4.4 | 1.4.4 | 1.4.4 | | HCatalog | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-0 | 2.3.3-amzn-0 | | Hadoop | 2.8.4-amzn-0 | 2.8.4-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.3-amzn-1 | 2.3.3-amzn-1 | 2.3.3-amzn-0 | 2.3.3-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.5.0-incubating | 0.5.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.2.0 | 1.2.0 | 1.1.0 | 1.1.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 5.0.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.14.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,203 | 0,203 | 0,194 | 0,194 | | Spark | 2.3.1 | 2.3.1 | 2.3.0 | 2.3.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.12 | ## Catatan terbitan 5.16.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.16.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.1.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.25.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.5.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.4-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.4-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.4-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.4-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.4-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.4-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.4-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.4-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.4-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.4-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.4 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.4 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.4 | HBase klien baris perintah. | | hbase-rest-server | 1.4.4 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.4 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.2.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,203 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,203 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.1 | Klien baris perintah Spark. | | spark-history-server | 2.3.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.12 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.12 | ZooKeeper klien baris perintah. | ## 5.16.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.16.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 5.16.0 ## Versi aplikasi 5.16.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.16.0 | emr-5.15.1 | emr-5.15.0 | emr-5.14.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.336 | 1.11.333 | 1.11.333 | 1.11.297 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.5.0 | 1.4.2 | 1.4.2 | 1.4.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.4 | 1.4.4 | 1.4.4 | 1.4.2 | | HCatalog | 2.3.3-amzn-1 | 2.3.3-amzn-0 | 2.3.3-amzn-0 | 2.3.2-amzn-2 | | Hadoop | 2.8.4-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.3-amzn-1 | 2.3.3-amzn-0 | 2.3.3-amzn-0 | 2.3.2-amzn-2 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.2.0 | 4.1.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.5.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.2.0 | 1.1.0 | 1.1.0 | 1.1.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 5.0.0 | 4.3.0 | | Phoenix | 4.14.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,203 | 0,194 | 0,194 | 0,194 | | Spark | 2.3.1 | 2.3.0 | 2.3.0 | 2.3.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.12 | 3.4.12 | 3.4.12 | 3.4.10 | ## Catatan rilis 5.16.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.16.0. Perubahan bersifat relatif terhadap 5.15.0. Tanggal rilis awal: 19 Juli 2018 **Upgrade** + Hadoop versi 2.8.4 + Flink versi 1.5.0 + Livy versi 0.5.0 + MXNet 1.2.0 + Phoenix versi 4.14.0 + Presto versi 0.203 + Spark versi 2.3.1 + AWS SDK untuk Java 1.11.336 + CUDA 9.2 + Redshift JDBC Driver 1.2.15.1025 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + HBase + [HBASE-20723](https://issues.apache.org/jira/browse/HBASE-20723) yang telah di-backporting + Presto + Perubahan konfigurasi untuk mendukung autentikasi LDAP. Untuk informasi selengkapnya, lihat [Menggunakan otentikasi LDAP untuk Presto on Amazon EMR](emr-presto-ldap.md). + Spark + [https://nvd.nist.gov/vuln/detail/CVE-2018-8024](https://nvd.nist.gov/vuln/detail/CVE-2018-8024) Kami merekomendasikan Anda memigrasi versi Spark sebelumnya ke Spark versi 2.3.1 atau versi yang lebih baru. **Masalah yang diketahui** + Versi rilis ini tidak mendukung tipe instans c1.medium atau m1.small. Klaster yang menggunakan salah satu dari tipe instans tersebut gagal memulai. Sebagai solusi, tentukan tipe instans yang berbeda atau gunakan versi rilis yang berbeda. + Ketika Anda membuat klaster kerberized dengan Livy yang diinstal, maka Livy akan gagal dengan pesan kesalahan bahwa autentikasi sederhana tidak diaktifkan. Melakukan reboot server Livy akan menyelesaikan masalah ini. Sebagai solusinya, tambahkan langkah selama pembuatan cluster yang berjalan `sudo restart livy-server` pada node utama. + Setelah node primer reboot atau pengontrol instans dimulai ulang, CloudWatch metrik tidak akan dikumpulkan dan fitur penskalaan otomatis tidak akan tersedia di Amazon EMR versi 5.14.0, 5.15.0, atau 5.16.0. Masalah ini telah diperbaiki di Amazon EMR 5.17.0. ## Versi komponen 5.16.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.1.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.6.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.25.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.5.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.4-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.4-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.4-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.4-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.4-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.4-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.4-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.4-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.4-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.4-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.4 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.4 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.4 | HBase klien baris perintah. | | hbase-rest-server | 1.4.4 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.4 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.5.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.2.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.2.88 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.14.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.14.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,203 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,203 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.1 | Klien baris perintah Spark. | | spark-history-server | 2.3.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.12 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.12 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.16.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.16.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-password-authenticator | Ubah nilai dalam file password-authenticator.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.15.1 ## 5.15.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.15.1 | emr-5.15.0 | emr-5.14.2 | emr-5.14.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.333 | 1.11.333 | 1.11.297 | 1.11.297 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.4 | 1.4.4 | 1.4.2 | 1.4.2 | | HCatalog | 2.3.3-amzn-0 | 2.3.3-amzn-0 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.3-amzn-0 | 2.3.3-amzn-0 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.2.0 | 4.1.0 | 4.1.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 5.0.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,194 | 0,194 | 0,194 | 0,194 | | Spark | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.12 | 3.4.12 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.15.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.15.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.24.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.4 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.4 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.4 | HBase klien baris perintah. | | hbase-rest-server | 1.4.4 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.4 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.1.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,194 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,194 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.0 | Klien baris perintah Spark. | | spark-history-server | 2.3.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.12 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.12 | ZooKeeper klien baris perintah. | ## 5.15.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.15.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 5.15.0 ## Versi aplikasi 5.15.0 Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.15.0 | emr-5.14.2 | emr-5.14.1 | emr-5.14.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.333 | 1.11.297 | 1.11.297 | 1.11.297 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.4 | 1.4.2 | 1.4.2 | 1.4.2 | | HCatalog | 2.3.3-amzn-0 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.3-amzn-0 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | | Hudi | - | - | - | - | | Hue | 4.2.0 | 4.1.0 | 4.1.0 | 4.1.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | 0.8.1 | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.1.0 | 1.1.0 | 1.1.0 | 1.1.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 5.0.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,194 | 0,194 | 0,194 | 0,194 | | Spark | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.7 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.12 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.15.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.15.0. Perubahan bersifat relatif terhadap 5.14.0. Tanggal rilis awal: 21 Juni 2018 **Upgrade** + Upgrade HBase ke 1.4.4 + Hive telah di-upgrade ke 2.3.3 + Hue telah di-upgrade ke 4.2.0 + Oozie telah di-upgrade ke 5.0.0 + Zookeeper telah di-upgrade ke 3.4.12 + AWS SDK yang ditingkatkan ke 1.11.333 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Hive + [HIVE-18069](https://issues.apache.org/jira/browse/HIVE-18069) telah di-backporting + Hue + Pembaruan Hue untuk melakukan autentikasi dengan benar dengan Livy saat Kerberos diaktifkan. Livy sekarang didukung saat menggunakan Kerberos dengan Amazon EMR. + JupyterHub + Diperbarui JupyterHub sehingga Amazon EMR menginstal pustaka klien LDAP secara default. + Perbaikan kesalahan dalam skrip yang menghasilkan sertifikat yang ditandatangani sendiri. **Masalah yang diketahui** + Versi rilis ini tidak mendukung tipe instans c1.medium atau m1.small. Klaster yang menggunakan salah satu dari tipe instans tersebut gagal memulai. Sebagai solusi, tentukan tipe instans yang berbeda atau gunakan versi rilis yang berbeda. + Setelah node primer reboot atau pengontrol instans dimulai ulang, CloudWatch metrik tidak akan dikumpulkan dan fitur penskalaan otomatis tidak akan tersedia di Amazon EMR versi 5.14.0, 5.15.0, atau 5.16.0. Masalah ini telah diperbaiki di Amazon EMR 5.17.0. ## Versi komponen 5.15.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.24.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.4 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.4 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.4 | HBase klien baris perintah. | | hbase-rest-server | 1.4.4 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.4 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.3-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.3-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.3-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.3-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.3-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.3-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.3-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.2.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.1.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 5.0.0 | Klien baris perintah Oozie. | | oozie-server | 5.0.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,194 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,194 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.0 | Klien baris perintah Spark. | | spark-history-server | 2.3.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.12 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.12 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.15.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.15.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.14.2 ## 5.14.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.14.2 | emr-5.14.1 | emr-5.14.0 | emr-5.13.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.297 | 1.11.297 | 1.11.297 | 1.11.297 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.2 | | HCatalog | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | | Hudi | - | - | - | - | | Hue | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | 0.8.1 | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.1.0 | 1.1.0 | 1.1.0 | 1.0.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,194 | 0,194 | 0,194 | 0,194 | | Spark | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.7 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.14.2 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.14.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.23.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.2 | HBase klien baris perintah. | | hbase-rest-server | 1.4.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.1.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.1.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,194 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,194 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.0 | Klien baris perintah Spark. | | spark-history-server | 2.3.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.14.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.14.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.14.1 ## 5.14.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.14.1 | emr-5.14.0 | emr-5.13.1 | emr-5.13.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.297 | 1.11.297 | 1.11.297 | 1.11.297 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.2 | 1.4.2 | 1.4.0 | 1.4.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.2 | | HCatalog | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | | Hudi | - | - | - | - | | Hue | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | 0.8.1 | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.1.0 | 1.1.0 | 1.0.0 | 1.0.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,194 | 0,194 | 0,194 | 0,194 | | Spark | 2.3.0 | 2.3.0 | 2.3.0 | 2.3.0 | | Sqoop | 1.4.7 | 1.4.7 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.14.1 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.14.1. Perubahan bersifat relatif terhadap 5.14.0. Tanggal rilis awal: 17 Oktober 2018 Pembaruan AMI default untuk Amazon EMR untuk mengatasi potensi kelemahan keamanan. ## 5.14.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.23.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.2 | HBase klien baris perintah. | | hbase-rest-server | 1.4.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.1.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.1.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,194 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,194 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.0 | Klien baris perintah Spark. | | spark-history-server | 2.3.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.14.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.14.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 5.14.0 ## 5.14.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://jupyterhub.readthedocs.io/en/latest/#](https://jupyterhub.readthedocs.io/en/latest/#), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.14.0 | emr-5.13.1 | emr-5.13.0 | emr-5.12.3 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.297 | 1.11.297 | 1.11.297 | 1.11.267 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.2 | 1.4.0 | 1.4.0 | 1.4.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.2 | 1.4.2 | 1.4.2 | 1.4.0 | | HCatalog | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-1 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | 0.8.1 | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.1.0 | 1.0.0 | 1.0.0 | 1.0.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,194 | 0,194 | 0,194 | 0,188 | | Spark | 2.3.0 | 2.3.0 | 2.3.0 | 2.2.1 | | Sqoop | 1.4.7 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.14.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.14.0. Perubahan bersifat relatif terhadap 5.13.0. Tanggal rilis awal: 4 Juni 2018 **Upgrade** + Apache Flink telah di-upgrade ke 1.4.2 + Upgrade Apache MXnet ke 1.1.0 + Apache Sqoop telah di-upgrade ke 1.4.7 **Fitur baru** + Menambahkan JupyterHub dukungan. Untuk informasi selengkapnya, lihat [JupyterHub](emr-jupyterhub.md). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + EMRFS + String userAgent dalam permintaan untuk Amazon S3 telah diperbarui sehingga berisi informasi pengguna dan kelompok prinsipal utama pemohon. Ini dapat digunakan dengan AWS CloudTrail log untuk pelacakan permintaan yang lebih komprehensif. + HBase + Termasuk [HBASE-20447](https://issues.apache.org/jira/browse/HBASE-20447), yang mengatasi masalah yang dapat menyebabkan masalah cache, terutama dengan Wilayah terpisah. + MXnet + Penambahan perpustakaan OpenCV. + Spark + Ketika Spark menulis file Parquet ke lokasi Amazon S3 menggunakan EMRFS, FileOutputCommitter algoritme telah diperbarui untuk menggunakan versi 2, bukan versi 1. Hal ini mengurangi jumlah penggantian nama, yang akan meningkatkan performa aplikasi. Perubahan ini tidak mempengaruhi: + Aplikasi selain Spark. + Aplikasi yang menulis ke sistem file lain, seperti HDFS (yang masih menggunakan versi 1 dari FileOutputCommitter). + Aplikasi yang menggunakan format output lain, seperti teks atau csv, yang sudah menggunakan tulis langsung EMRFS. **Masalah yang diketahui** + JupyterHub + Menggunakan klasifikasi konfigurasi untuk menyiapkan JupyterHub dan notebook Jupyter individual saat Anda membuat klaster tidak didukung. Edit file jupyterhub\$1config.py dan file jupyter\$1notebook\$1config.py untuk setiap pengguna secara manual. Untuk informasi selengkapnya, lihat [Mengkonfigurasi JupyterHub](emr-jupyterhub-configure.md). + JupyterHub gagal memulai pada cluster dalam subnet pribadi, gagal dengan pesan. `Error: ENOENT: no such file or directory, open '/etc/jupyter/conf/server.crt' ` Hal ini disebabkan oleh kesalahan dalam skrip yang menghasilkan sertifikat ditandatangani sendiri. Gunakan solusi berikut untuk menghasilkan sertifikat yang ditandatangani sendiri. Semua perintah dijalankan saat terhubung ke node utama. 1. Salin skrip pembuatan sertifikat dari wadah ke simpul utama: ``` sudo docker cp jupyterhub:/tmp/gen_self_signed_cert.sh ./ ``` 1. Gunakan editor teks untuk mengubah baris 23 untuk mengubah hostname publik menjadi hostname lokal seperti yang ditunjukkan di bawah ini: ``` local hostname=$(curl -s $EC2_METADATA_SERVICE_URI/local-hostname) ``` 1. Jalankan skrip untuk menghasilkan sertifikat ditandatangani sendiri: ``` sudo bash ./gen_self_signed_cert.sh ``` 1. Pindahkan file sertifikat yang menghasilkan skrip untuk direktori `/etc/jupyter/conf/`: ``` sudo mv /tmp/server.crt /tmp/server.key /etc/jupyter/conf/ ``` Anda dapat `tail` `jupyter.log` file untuk memverifikasi bahwa JupyterHub dimulai ulang dan mengembalikan kode respons 200. Contoh: ``` tail -f /var/log/jupyter/jupyter.log ``` Ini akan menghasilkan respons yang serupa dengan yang berikut ini: ``` # [I 2018-06-14 18:56:51.356 JupyterHub app:1581] JupyterHub is now running at https://:9443/ # 19:01:51.359 - info: [ConfigProxy] 200 GET /api/routes ``` + Setelah node primer reboot atau pengontrol instans dimulai ulang, CloudWatch metrik tidak akan dikumpulkan dan fitur penskalaan otomatis tidak akan tersedia di Amazon EMR versi 5.14.0, 5.15.0, atau 5.16.0. Masalah ini telah diperbaiki di Amazon EMR 5.17.0. ## 5.14.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.23.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.2 | HBase klien baris perintah. | | hbase-rest-server | 1.4.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.1.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | jupyterhub | 0.8.1 | Server multi-pengguna untuk notebook Jupyter | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.1.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | opencv | 3.4.0 | Perpustakaan Visi Komputer Sumber Terbuka. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,194 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,194 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.0 | Klien baris perintah Spark. | | spark-history-server | 2.3.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.7 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.14.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.14.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | container-log4j | Ubah nilai dalam file container-log4j.properties Hadoop YARN. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | jupyter-notebook-conf | Ubah nilai dalam file jupyter\$1notebook\$1config.py Jupyter Notebook. | | jupyter-hub-conf | Ubah nilai dalam JupyterHubs file jupyterhub\$1config.py. | | jupyter-sparkmagic-conf | Ubah nilai dalam file config.json Sparkmagic. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.13.1 ## 5.13.1 versi aplikasi Rilis ini mencakup aplikasi-aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/),, [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.13.1 | emr-5.13.0 | emr-5.12.3 | emr-5.12.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.297 | 1.11.297 | 1.11.267 | 1.11.267 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.2 | 1.4.2 | 1.4.0 | 1.4.0 | | HCatalog | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.2-amzn-2 | 2.3.2-amzn-2 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,194 | 0,194 | 0,188 | 0,188 | | Spark | 2.3.0 | 2.3.0 | 2.2.1 | 2.2.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.13.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.13.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.22.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.2 | HBase klien baris perintah. | | hbase-rest-server | 1.4.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.1.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.0.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,194 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,194 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.0 | Klien baris perintah Spark. | | spark-history-server | 2.3.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.13.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.13.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.13.0 ## Versi aplikasi 5.13.0 Rilis ini mencakup aplikasi-aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/),, [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.13.0 | emr-5.12.3 | emr-5.12.2 | emr-5.12.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.297 | 1.11.267 | 1.11.267 | 1.11.267 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.2 | 1.4.0 | 1.4.0 | 1.4.0 | | HCatalog | 2.3.2-amzn-2 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.2-amzn-2 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,194 | 0,188 | 0,188 | 0,188 | | Spark | 2.3.0 | 2.2.1 | 2.2.1 | 2.2.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.13.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.13.0. Perubahan bersifat relatif terhadap 5.12.0. **Upgrade** + Spark telah di-upgrade ke 2.3.0 + Upgrade HBase ke 1.4.2 + Presto telah di-upgrade ke 0.194 + Ditingkatkan ke AWS SDK untuk Java 1.11.297 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Hive + [HIVE-15436](https://issues.apache.org/jira/browse/HIVE-15436) telah di-backport. Enhanced Hive APIs untuk mengembalikan hanya tampilan. **Masalah yang diketahui** + MXNet saat ini tidak memiliki pustaka OpenCV. ## Versi komponen 5.13.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.10.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.22.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.2 | HBase klien baris perintah. | | hbase-rest-server | 1.4.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-2 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-2 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-2 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-2 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-2 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.1.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.0.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,194 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,194 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | r | 3.4.1 | Proyek R untuk Komputasi Statistik | | spark-client | 2.3.0 | Klien baris perintah Spark. | | spark-history-server | 2.3.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.3.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.3.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## Klasifikasi konfigurasi 5.13.0 Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.13.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.12.3 ## 5.12.3 versi aplikasi Rilis ini mencakup aplikasi-aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/),, [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.12.3 | emr-5.12.2 | emr-5.12.1 | emr-5.12.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.267 | 1.11.267 | 1.11.267 | 1.11.267 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.0 | 1.4.0 | 1.4.0 | 1.4.0 | | HCatalog | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | | Hive | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | | Hudi | - | - | - | - | | Hue | 4.1.0 | 4.1.0 | 4.1.0 | 4.1.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.0.0 | 1.0.0 | 1.0.0 | 1.0.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,188 | 0,188 | 0,188 | 0,188 | | Spark | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.12.3 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.12.3 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.9.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.21.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.0 | HBase klien baris perintah. | | hbase-rest-server | 1.4.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.1.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.0.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,188 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,188 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.1 | Klien baris perintah Spark. | | spark-history-server | 2.2.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.12.3 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.12.3** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.12.2 ## 5.12.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.12.2 | emr-5.12.1 | emr-5.12.0 | emr-5.11.4 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.267 | 1.11.267 | 1.11.267 | 1.11.238 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.0 | 1.4.0 | 1.4.0 | 1.3.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.0 | 1.4.0 | 1.4.0 | 1.3.1 | | HCatalog | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-0 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.7.3-amzn-6 | | Hive | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.1.0 | 4.1.0 | 4.1.0 | 4.0.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.0.0 | 1.0.0 | 1.0.0 | 0.12.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,188 | 0,188 | 0,188 | 0,187 | | Spark | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.12.2 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.12.2. Perubahan bersifat relatif terhadap 5.12.1. Tanggal rilis awal: 29 Agustus 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Rilis ini membahas potensi kelemahan keamanan. ## 5.12.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.9.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.21.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.0 | HBase klien baris perintah. | | hbase-rest-server | 1.4.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.1.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.0.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,188 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,188 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.1 | Klien baris perintah Spark. | | spark-history-server | 2.2.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.12.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.12.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.12.1 ## 5.12.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.12.1 | emr-5.12.0 | emr-5.11.4 | emr-5.11.3 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.267 | 1.11.267 | 1.11.238 | 1.11.238 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.0 | 1.4.0 | 1.3.2 | 1.3.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.0 | 1.4.0 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | | Hadoop | 2.8.3-amzn-0 | 2.8.3-amzn-0 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | | Hive | 2.3.2-amzn-1 | 2.3.2-amzn-1 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.1.0 | 4.1.0 | 4.0.1 | 4.0.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.0.0 | 1.0.0 | 0.12.0 | 0.12.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.13.0- -1.4 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,188 | 0,188 | 0,187 | 0,187 | | Spark | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.12.1 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.12.1. Perubahan bersifat relatif terhadap 5.12.0. Tanggal rilis awal: 29 Maret 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Pembaruan kernel Amazon Linux dari default Amazon Linux AMI untuk Amazon EMR untuk mengatasi potensi kelemahan. ## 5.12.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.9.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.21.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.0 | HBase klien baris perintah. | | hbase-rest-server | 1.4.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.1.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.0.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,188 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,188 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.1 | Klien baris perintah Spark. | | spark-history-server | 2.2.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.12.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.12.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR Rilis 5.12.0 ## 5.12.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.12.0 | emr-5.11.4 | emr-5.11.3 | emr-5.11.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.267 | 1.11.238 | 1.11.238 | 1.11.238 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.4.0 | 1.3.2 | 1.3.2 | 1.3.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.4.0 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.2-amzn-1 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | | Hadoop | 2.8.3-amzn-0 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | | Hive | 2.3.2-amzn-1 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.1.0 | 4.0.1 | 4.0.1 | 4.0.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 1.0.0 | 0.12.0 | 0.12.0 | 0.12.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.13.0- -1.4 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,188 | 0,187 | 0,187 | 0,187 | | Spark | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.12.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.12.0. Perubahan bersifat relatif terhadap 5.11.1. **Upgrade** + AWS SDK for Java 1.11.238 ⇒ 1.11.267. Untuk informasi selengkapnya, lihat Log [AWS GitHubon SDK for Java Change](https://github.com/aws/aws-sdk-java/blob/master/CHANGELOG.md). + Hadoop 2.7.3 ⇒ 2.8.3. Untuk informasi selengkapnya, lihat [Rilis Apache Hadoop](http://hadoop.apache.org/releases.html). + Flink 1.3.2 ⇒ 1.4.0. Untuk informasi lebih lanjut, lihat [Pengumuman Rilis Apache Flink 1.4.0](https://flink.apache.org/news/2017/12/12/release-1.4.0.html). + HBase 1.3.1 ⇒ 1.4.0. Untuk informasi selengkapnya, lihat [Pengumuman HBase Rilis](http://mail-archives.apache.org/mod_mbox/www-announce/201712.mbox/%3CCA+RK=_AU+tB=7SU1HRbeKVEd-sKA5WcJo3oa43vQ6PMB3L9pgQ@mail.gmail.com%3E). + Hue 4.0.1 ⇒ 4.1.0. Untuk informasi lebih lanjut, lihat [Catatan Rilis](https://docs.gethue.com/releases/release-notes-4.10.0/). + MxNet 0.12.0 ⇒ 1.0.0. Untuk informasi selengkapnya, lihat [MXNet Ubah Log](https://github.com/apache/incubator-mxnet/releases/tag/1.0.0) on GitHub. + Presto 0.187 ⇒ 0.188. Untuk informasi lebih lanjut, lihat [Catatan Rilis](https://prestodb.io/docs/current/release/release-0.188.html). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + **Hadoop** + Properti `yarn.resourcemanager.decommissioning.timeout` telah berubah menjadi `yarn.resourcemanager.nodemanager-graceful-decommission-timeout-secs`. Anda dapat menggunakan properti ini untuk menyesuaikan menurunkan skala klaster. Untuk informasi selengkapnya, lihat [Menurunkan Skala Klaster](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-scaledown-behavior.html) di *Panduan Pengelolaan Amazon EMR*. + Hadoop CLI menambahkan opsi `-d` pada perintah (salin) `cp`, yang menentukan salinan langsung. Anda dapat menggunakan ini untuk menghindari membuat file `.COPYING` perantara, yang membuat penyalinan data antara Amazon S3 lebih cepat. Untuk informasi selengkapnya, lihat [HADOOP-12384](https://issues.apache.org/jira/browse/HADOOP-12384). + **Babi** + Penambahan klasifikasi konfigurasi `pig-env`, yang menyederhanakan konfigurasi properti lingkungan Pig. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). + **Presto** + Penambahan konfigurasi klasifikasi `presto-connector-redshift`, yang dapat Anda gunakan untuk mengkonfigurasi nilai-nilai dalam file konfigurasi `redshift.properties` Presto. Untuk informasi selengkapnya, lihat [Konektor Redshift](https://prestodb.io/docs/current/connector/redshift.html) dalam dokumentasi Presto, dan [Konfigurasikan aplikasi](emr-configure-apps.md). + Support presto untuk EMRFS telah ditambahkan dan menjadi konfigurasi default. Rilis Amazon EMR sebelumnya menggunakan PrestOS3FileSystem, yang merupakan satu-satunya pilihan. Untuk informasi selengkapnya, lihat [Konfigurasi EMRFS dan PrestOS3 FileSystem](emr-presto-considerations.md#emr-presto-prestos3). **catatan** Jika Anda menanyakan data yang mendasarinya di Amazon S3 dengan Amazon EMR versi 5.12.0, kesalahan Presto dapat terjadi. Hal ini karena Presto gagal untuk mengambil nilai klasifikasi konfigurasi dari `emrfs-site.xml`. Sebagai solusinya, buat `emrfs` subdirektori di bawah `usr/lib/presto/plugin/hive-hadoop2/` dan buat symlink ke file yang ada`usr/lib/presto/plugin/hive-hadoop2/emrfs`. `/usr/share/aws/emr/emrfs/conf/emrfs-site.xml` Kemudian restart proses presto-server (`sudo presto-server stop`diikuti oleh). `sudo presto-server start` + **Percikan** + Backported [SPARK-22036: BigDecimal ](https://issues.apache.org/jira/browse/SPARK-22036) perkalian terkadang mengembalikan null. **Masalah yang diketahui** + MXNet tidak termasuk pustaka OpenCV. + SparkR ini tidak tersedia untuk klaster yang dibuat dengan menggunakan AMI kustom karena R tidak diinstal secara default pada simpul utama. ## 5.12.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0.1 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.9.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.21.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.4.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.8.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.8.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.8.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.8.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.8.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.8.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.8.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.8.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.8.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.4.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.4.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.4.0 | HBase klien baris perintah. | | hbase-rest-server | 1.4.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.4.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-1 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-1 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-1 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-1 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-1 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.1.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 1.0.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.1.85 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.13.0- -1.4 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.13.0- -1.4 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,188 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,188 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.1 | Klien baris perintah Spark. | | spark-history-server | 2.2.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.12.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.12.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-env | Ubah nilai di lingkungan Pig. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-redshift | Ubah nilai dalam file redshift.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.11.4 ## 5.11.4 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.11.4 | emr-5.11.3 | emr-5.11.2 | emr-5.11.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.238 | 1.11.238 | 1.11.238 | 1.11.238 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | | Hadoop | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | | Hive | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 0.12.0 | 0.12.0 | 0.12.0 | 0.12.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,187 | 0,187 | 0,187 | 0,187 | | Spark | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.11.4 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.11.4 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.8.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.20.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-6 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-6 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-6 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-6 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-6 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-6 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-6 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-6 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.0.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 0.12.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.0.176 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,187 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,187 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.1 | Klien baris perintah Spark. | | spark-history-server | 2.2.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.11.4 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.11.4** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.11.3 ## 5.11.3 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.11.3 | emr-5.11.2 | emr-5.11.1 | emr-5.11.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.238 | 1.11.238 | 1.11.238 | 1.11.238 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | | Hadoop | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | | Hive | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 0.12.0 | 0.12.0 | 0.12.0 | 0.12.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,187 | 0,187 | 0,187 | 0,187 | | Spark | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.11.3 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.11.3. Perubahan bersifat relatif terhadap 5.11.2. Tanggal rilis awal: 18 Juli 2019 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + [Memperbarui AMI Linux Amazon default untuk Amazon EMR untuk menyertakan pembaruan keamanan kernel Linux yang penting, termasuk TCP SACK Denial of Service Issue (AWS-2019-005).](https://aws.amazon.com/security/security-bulletins/AWS-2019-005/) ## 5.11.3 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.8.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.20.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-6 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-6 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-6 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-6 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-6 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-6 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-6 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-6 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.0.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 0.12.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.0.176 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,187 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,187 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.1 | Klien baris perintah Spark. | | spark-history-server | 2.2.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.11.3 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.11.3** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.11.2 ## 5.11.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.11.2 | emr-5.11.1 | emr-5.11.0 | emr-5.10.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.238 | 1.11.238 | 1.11.238 | 1.11.221 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.1-amzn-0 | | Hadoop | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-5 | | Hive | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 0.12.0 | 0.12.0 | 0.12.0 | 0.12.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,187 | 0,187 | 0,187 | 0,187 | | Spark | 2.2.1 | 2.2.1 | 2.2.1 | 2.2.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.11.2 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.11.2. Perubahan bersifat relatif terhadap 5.11.1. Tanggal rilis awal: 29 Agustus 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Rilis ini membahas potensi kelemahan keamanan. ## 5.11.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.8.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.20.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-6 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-6 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-6 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-6 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-6 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-6 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-6 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-6 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.0.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 0.12.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.0.176 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,187 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,187 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.1 | Klien baris perintah Spark. | | spark-history-server | 2.2.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.11.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.11.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.11.1 ## 5.11.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.11.1 | emr-5.11.0 | emr-5.10.1 | emr-5.10.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.238 | 1.11.238 | 1.11.221 | 1.11.221 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.1-amzn-0 | 2.3.1-amzn-0 | | Hadoop | 2.7.3-amzn-6 | 2.7.3-amzn-6 | 2.7.3-amzn-5 | 2.7.3-amzn-5 | | Hive | 2.3.2-amzn-0 | 2.3.2-amzn-0 | 2.3.1-amzn-0 | 2.3.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 0.12.0 | 0.12.0 | 0.12.0 | 0.12.0 | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,187 | 0,187 | 0,187 | 0,187 | | Spark | 2.2.1 | 2.2.1 | 2.2.0 | 2.2.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.3 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.11.1 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.11.1. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.8.0. Tanggal rilis awal: 22 Januari 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Pembaruan kernel Amazon Linux dari default Amazon Linux AMI untuk Amazon EMR untuk mengatasi kelemahan terkait dengan eksekusi spekulatif (CVE-2017-5715, CVE-2017-5753, dan CVE-2017-5754). Untuk informasi selengkapnya, lihat [https://aws.amazon.com/security/security-bulletins/AWS-2018-013/](https://aws.amazon.com/security/security-bulletins/AWS-2018-013/). ## 5.11.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.8.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.20.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-6 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-6 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-6 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-6 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-6 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-6 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-6 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-6 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.0.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 0.12.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.0.176 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,187 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,187 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.1 | Klien baris perintah Spark. | | spark-history-server | 2.2.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.11.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.11.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.11.0 ## 5.11.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.11.0 | emr-5.10.1 | emr-5.10.0 | emr-5.9.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.238 | 1.11.221 | 1.11.221 | 1.11.183 | | Python | 2.7, 3.4 | 2.7, 3.4 | 2.7, 3.4 | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.2-amzn-0 | 2.3.1-amzn-0 | 2.3.1-amzn-0 | 2.3.0-amzn-0 | | Hadoop | 2.7.3-amzn-6 | 2.7.3-amzn-5 | 2.7.3-amzn-5 | 2.7.3-amzn-4 | | Hive | 2.3.2-amzn-0 | 2.3.1-amzn-0 | 2.3.1-amzn-0 | 2.3.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 0.12.0 | 0.12.0 | 0.12.0 | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,187 | 0,187 | 0,187 | 0,184 | | Spark | 2.2.1 | 2.2.0 | 2.2.0 | 2.2.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.3 | 0.7.2 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.11.0 Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 5.11.0. Perubahan relatif dilakukan terhadap 5.10.0. **Upgrade** + Hive versi 2.3.2 + Spark versi 2.2.1 + SDK for Java versi 1.11.238 **Fitur baru** + Spark + Penambahan pengaturan `spark.decommissioning.timeout.threshold`, yang meningkatkan perilaku decommissioning ketika menggunakan Instans Spot. Untuk informasi selengkapnya, lihat [Mengkonfigurasi perilaku dekomisioning node](emr-spark-configure.md#spark-decommissioning). + [Menambahkan `aws-sagemaker-spark-sdk` komponen ke Spark, yang menginstal Amazon SageMaker Spark dan dependensi terkait untuk integrasi Spark dengan Amazon. SageMaker](https://aws.amazon.com/sagemaker/) Anda dapat menggunakan Amazon SageMaker Spark untuk membuat pipeline machine learning (ML) Spark menggunakan tahapan Amazon. SageMaker Untuk informasi selengkapnya, lihat [SageMaker Spark Readme aktif](https://github.com/aws/sagemaker-spark/blob/master/README.md) GitHub dan [Menggunakan Apache Spark dengan Amazon SageMaker di Panduan](https://docs.aws.amazon.com/sagemaker/latest/dg/apache-spark.html) Pengembang *Amazon SageMaker *. **Masalah yang diketahui** + MXNet tidak termasuk pustaka OpenCV. + Hive 2.3.2 mengatur `hive.compute.query.using.stats=true` secara default. Hal ini menyebabkan kueri mengambil data statistik yang ada bukan secara langsung dari data, yang dapat membingungkan. Sebagai contoh, jika Anda memiliki tabel dengan `hive.compute.query.using.stats=true` dan mengunggah file baru ke `LOCATION` tabel, menjalankan kueri `SELECT COUNT(*)` pada tabel akan menghasilkan hitungan dari statistik, bukan mengambil dari baris yang ditambahkan. Sebagai solusinya, gunakan perintah `ANALYZE TABLE` untuk mengumpulkan statistik baru, atau atur `hive.compute.query.using.stats=false`. Untuk informasi selengkapnya, lihat [Statistik di Hive](https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-StatisticsinHive) di dokumentasi Apache Hive. ## 5.11.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | aws-sagemaker-spark-sdk | 1.0 | Amazon SageMaker Spark SDK | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.8.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.20.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-6 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-6 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-6 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-6 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-6 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-6 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-6 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-6 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-6 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.2-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.2-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.2-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.2-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.2-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.2-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.2-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.0.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 0.12.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.0.176 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,187 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,187 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.1 | Klien baris perintah Spark. | | spark-history-server | 2.2.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.11.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.11.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.10.1 ## 5.10.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.10.1 | emr-5.10.0 | emr-5.9.1 | emr-5.9.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.221 | 1.11.221 | 1.11.183 | 1.11.183 | | Python | 2.7, 3.4 | 2.7, 3.4 | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.2 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.1-amzn-0 | 2.3.1-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hadoop | 2.7.3-amzn-5 | 2.7.3-amzn-5 | 2.7.3-amzn-4 | 2.7.3-amzn-4 | | Hive | 2.3.1-amzn-0 | 2.3.1-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.0.1 | 4.0.1 | 4.0.1 | 4.0.1 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | | MXNet | 0.12.0 | 0.12.0 | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.17.0 | | Presto | 0,187 | 0,187 | 0,184 | 0,184 | | Spark | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.3 | 0.7.2 | 0.7.2 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan terbitan 5.10.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.10.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.7.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.20.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-5 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-5 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-5 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-5 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-5 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-5 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-5 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-5 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-5 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-5 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.0.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 0.12.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.0.176 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,187 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,187 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.0 | Klien baris perintah Spark. | | spark-history-server | 2.2.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.10.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.10.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.10.0 ## 5.10.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [https://mxnet.incubator.apache.org/](https://mxnet.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.10.0 | emr-5.9.1 | emr-5.9.0 | emr-5.8.3 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.221 | 1.11.183 | 1.11.183 | 1.11.160 | | Python | 2.7, 3.4 | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.2 | 1.3.2 | 1.3.2 | 1.3.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.1-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hadoop | 2.7.3-amzn-5 | 2.7.3-amzn-4 | 2.7.3-amzn-4 | 2.7.3-amzn-3 | | Hive | 2.3.1-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.0.1 | 4.0.1 | 4.0.1 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | 0.4.0-incubating | - | | MXNet | 0.12.0 | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.17.0 | 0.16.0-amzn-1 | | Presto | 0,187 | 0,184 | 0,184 | 0,170 | | Spark | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.3 | 0.7.2 | 0.7.2 | 0.7.2 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.10.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.10.0. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.9.0. **Upgrade** + AWS SDK untuk Java 1.11.221 + Hive versi 2.3.1 + Presto versi 0.187 **Fitur baru** + Penambahan support untuk autentikasi Kerberos. Untuk informasi selengkapnya, lihat [Menggunakan Autentikasi Kerberos](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-kerberos.html) di *Panduan Pengelolaan Amazon EMR* + Penambahan support untuk peran IAM untuk EMRFS. Untuk infromasi selengkapnya, lihat [Mengkonfigurasikan Peran IAM untuk Permintaan EMRFS ke Amazon S3](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-emrfs-iam-role.html) di *Panduan Pengelolaan Amazon EMR* + Penambahan dukungan untuk tipe instans P2 dan P3 berbasis GPU. Untuk informasi lebih lanjut, lihat [Instans Amazon EC2 P2](https://aws.amazon.com/ec2/instance-types/p2/) dan [Instans Amazon EC2 P3](https://aws.amazon.com/ec2/instance-types/p3/). Driver NVIDIA 384.81 dan Driver CUDA 9.0.176 diinstal pada tipe instans ini secara default. + Penambahan support untuk [Apache MXNet](emr-mxnet.md). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Presto + Menambahkan dukungan untuk menggunakan AWS Glue Data Catalog sebagai metastore Hive default. Untuk informasi selengkapnya, lihat [Menggunakan Presto dengan Katalog Data AWS Glue](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-presto.html#emr-presto-glue). + Penambahan support untuk [fungsi geospasial](https://prestodb.io/docs/current/functions/geospatial.html). + Penambahan support [spill to disk](https://prestodb.io/docs/current/admin/spill.html) untuk join. + Penambahan support untuk [konektor Redshift](https://prestodb.io/docs/current/connector/redshift.html). + Spark + [SPARK-20640](https://issues.apache.org/jira/browse/SPARK-20640) yang telah di-backport, yang membuat waktu habis rpc dan coba lagi untuk nilai registrasi kocok yang dapat dikonfigurasi menggunakan properti `spark.shuffle.registration.timeout` dan `spark.shuffle.registration.maxAttempts`. + Backported [SPARK-21549](https://issues.apache.org/jira/browse/SPARK-21549), yang mengoreksi kesalahan yang terjadi saat menulis kustom ke lokasi non-HDFS. OutputFormat + [Hadoop-13270](https://issues.apache.org/jira/browse/HADOOP-13270) yang telah di-backport. + Perpustakaan Numpy, Scipy, dan Matplotlib telah dihapus dari base Amazon EMR AMI. Jika perpustakaan tersebut diperlukan untuk aplikasi Anda, mereka tersedia di repositori aplikasi, sehingga Anda dapat menggunakan tindakan bootstrap untuk menginstalnya pada semua simpul menggunakan `yum install`. + Amazon EMR base AMI tidak lagi memiliki paket RPM aplikasi yang disertakan, sehingga paket RPM tidak lagi ada pada simpul klaster. Kustom AMIs dan basis EMR Amazon AMI sekarang mereferensikan repositori paket RPM di Amazon S3. + Karena perkenalan penagihan per-detik di Amazon EC2, **Perilaku menurunkan skala** default sekarang **Dihentikan saat tugas selesai** bukan **Dihentikan pada jam instans**. Untuk informasi selengkapnya, lihat [Mengkonfigurasi Penurunan Skala Klaster](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-scaledown-behavior.html). **Masalah yang diketahui** + MXNet tidak termasuk pustaka OpenCV. + Hive 2.3.1 mengatur `hive.compute.query.using.stats=true` secara default. Hal ini menyebabkan kueri mengambil data statistik yang ada bukan secara langsung dari data, yang dapat membingungkan. Sebagai contoh, jika Anda memiliki tabel dengan `hive.compute.query.using.stats=true` dan mengunggah file baru ke `LOCATION` tabel, menjalankan kueri `SELECT COUNT(*)` pada tabel akan menghasilkan hitungan dari statistik, bukan mengambil dari baris yang ditambahkan. Sebagai solusinya, gunakan perintah `ANALYZE TABLE` untuk mengumpulkan statistik baru, atau atur `hive.compute.query.using.stats=false`. Untuk informasi selengkapnya, lihat [Statistik di Hive](https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-StatisticsinHive) di dokumentasi Apache Hive. ## 5.10.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.5.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.7.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.20.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-5 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-5 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-5 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-5 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-5 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-5 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-5 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-5 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-5 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-5 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.0.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mxnet | 0.12.0 | Perpustakaan yang fleksibel, dapat diskalakan, dan efisien untuk deep learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | nvidia-cuda | 9.0.176 | Driver Nvidia dan kit alat Cuda | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,187 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,187 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.0 | Klien baris perintah Spark. | | spark-history-server | 2.2.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.3 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.10.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.10.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.9.1 ## 5.9.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.9.1 | emr-5.9.0 | emr-5.8.3 | emr-5.8.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.183 | 1.11.183 | 1.11.160 | 1.11.160 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.2 | 1.3.2 | 1.3.1 | 1.3.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hadoop | 2.7.3-amzn-4 | 2.7.3-amzn-4 | 2.7.3-amzn-3 | 2.7.3-amzn-3 | | Hive | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.0.1 | 4.0.1 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | 0.4.0-incubating | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.17.0 | 0.16.0-amzn-1 | 0.16.0-amzn-1 | | Presto | 0,184 | 0,184 | 0,170 | 0,170 | | Spark | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.9.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.9.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.4.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.7.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.19.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.0-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.0-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.0.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,184 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,184 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.0 | Klien baris perintah Spark. | | spark-history-server | 2.2.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.9.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.9.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.9.0 ## 5.9.0 versi aplikasi Rilis ini mencakup aplikasi-aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [https://livy.incubator.apache.org/](https://livy.incubator.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/),, [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/),, [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.9.0 | emr-5.8.3 | emr-5.8.2 | emr-5.8.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.183 | 1.11.160 | 1.11.160 | 1.11.160 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.2 | 1.3.1 | 1.3.1 | 1.3.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hadoop | 2.7.3-amzn-4 | 2.7.3-amzn-3 | 2.7.3-amzn-3 | 2.7.3-amzn-3 | | Hive | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 4.0.1 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | 0.4.0-incubating | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.17.0 | 0.16.0-amzn-1 | 0.16.0-amzn-1 | 0.16.0-amzn-1 | | Presto | 0,184 | 0,170 | 0,170 | 0,170 | | Spark | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.9.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.9.0. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.8.0. Tanggal rilis: 5 Oktober 2017 Pembaruan fitur terbaru: 12 Oktober, 2017 **Upgrade** + AWS SDK untuk Java versi 1.11.183 + Flink versi 1.3.2 + Hue versi 4.0.1 + Pig versi 0.17.0 + Presto versi 0.184 **Fitur baru** + Penambahan support Livy (versi 0.4.0-incubating). Untuk informasi selengkapnya, lihat [Apache Livy](emr-livy.md). + Penambahan support untuk Hue Notebook untuk Spark. + Penambahan support untuk instans Amazon EC2 i3-series (12 Oktober, 2017). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Spark + Penambahan serangkaian fitur baru yang membantu memastikan Spark menangani penghentian simpul karena pengubahan ukuran manual atau permintaan kebijakan penskalaan otomatis dengan lebih baik. Untuk informasi selengkapnya, lihat [Mengkonfigurasi perilaku dekomisioning node](emr-spark-configure.md#spark-decommissioning). + SSL digunakan sebagai ganti 3DES untuk enkripsi in-transit untuk layanan transfer blok, yang meningkatkan kinerja saat menggunakan tipe instans Amazon EC2 dengan AES-NI. + [SPARK-21494](https://issues.apache.org/jira/browse/SPARK-21494) yang telah di-backport. + Zeppelin + [ZEPPELIN-2377](https://issues.apache.org/jira/browse/ZEPPELIN-2377) yang telah di-backport. + HBase + Ditambahkan patch [HBASE-18533](https://issues.apache.org/jira/browse/HBASE-18533), yang memungkinkan nilai tambahan untuk HBase BucketCache konfigurasi menggunakan klasifikasi konfigurasi. `hbase-site` + Hue + Menambahkan dukungan AWS Glue Data Catalog untuk editor kueri Hive di Hue. + Secara default, pengguna super di Hue dapat mengakses semua file yang diizinkan untuk diakses oleh peran Amazon EMR IAM. Pengguna yang baru dibuat tidak secara otomatis memiliki izin untuk mengakses browser file Amazon S3 dan harus mengaktifkan izin `filebrowser.s3_access` untuk grup mereka. + Menyelesaikan masalah yang menyebabkan data JSON dasar yang dibuat menggunakan AWS Glue Data Catalog tidak dapat diakses. **Masalah yang diketahui** + Peluncuran klaster gagal saat semua aplikasi diinstal dan ukuran volume akar Amazon EBS default tidak diubah. Sebagai solusinya, gunakan `aws emr create-cluster` perintah dari AWS CLI dan tentukan parameter yang lebih besar. `--ebs-root-volume-size` + Hive 2.3.0 mengatur `hive.compute.query.using.stats=true` secara default. Hal ini menyebabkan kueri mengambil data statistik yang ada bukan secara langsung dari data, yang dapat membingungkan. Sebagai contoh, jika Anda memiliki tabel dengan `hive.compute.query.using.stats=true` dan mengunggah file baru ke `LOCATION` tabel, menjalankan kueri `SELECT COUNT(*)` pada tabel akan menghasilkan hitungan dari statistik, bukan mengambil dari baris yang ditambahkan. Sebagai solusinya, gunakan perintah `ANALYZE TABLE` untuk mengumpulkan statistik baru, atau atur `hive.compute.query.using.stats=false`. Untuk informasi selengkapnya, lihat [Statistik di Hive](https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-StatisticsinHive) di dokumentasi Apache Hive. ## 5.9.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.4.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.7.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.19.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.2 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.0-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.0-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 4.0.1 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | livy-server | 0.4.0-incubating | Antarmuka REST untuk berinteraksi dengan Apache Spark | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,184 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,184 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.17.0 | Klien baris perintah Pig. | | spark-client | 2.2.0 | Klien baris perintah Spark. | | spark-history-server | 2.2.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.9.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.9.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | livy-conf | Ubah nilai dalam file livy.conf Livy. | | livy-env | Ubah nilai di lingkungan Livy. | | livy-log4j | Ubah pengaturan Livy log4j.properties. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.8.3 ## 5.8.3 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.8.3 | emr-5.8.2 | emr-5.8.1 | emr-5.8.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.160 | 1.11.160 | 1.11.160 | 1.11.160 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hadoop | 2.7.3-amzn-3 | 2.7.3-amzn-3 | 2.7.3-amzn-3 | 2.7.3-amzn-3 | | Hive | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.16.0-amzn-1 | 0.16.0-amzn-1 | 0.16.0-amzn-1 | 0.16.0-amzn-1 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.2.0 | 2.2.0 | 2.2.0 | 2.2.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.8.3 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.8.3 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.4.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.6.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.18.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.0-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.0-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-1 | Klien baris perintah Pig. | | spark-client | 2.2.0 | Klien baris perintah Spark. | | spark-history-server | 2.2.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.8.3 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.8.3** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.8.2 ## 5.8.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.8.2 | emr-5.8.1 | emr-5.8.0 | emr-5.7.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.160 | 1.11.160 | 1.11.160 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-3 | 2.7.3-amzn-3 | 2.7.3-amzn-3 | 2.7.3-amzn-2 | | Hive | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.16.0-amzn-1 | 0.16.0-amzn-1 | 0.16.0-amzn-1 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.2.0 | 2.2.0 | 2.2.0 | 2.1.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## 5.8.2 Catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.8.2. Perubahan relatif dilakukan terhadap 5.8.1. Tanggal rilis awal: 29 Maret 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Pembaruan kernel Amazon Linux dari default Amazon Linux AMI untuk Amazon EMR untuk mengatasi potensi kelemahan. ## 5.8.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.4.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.6.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.18.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.0-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.0-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-1 | Klien baris perintah Pig. | | spark-client | 2.2.0 | Klien baris perintah Spark. | | spark-history-server | 2.2.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.8.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.8.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.8.1 ## 5.8.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.8.1 | emr-5.8.0 | emr-5.7.1 | emr-5.7.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.160 | 1.11.160 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.1 | 1.3.1 | 1.3.0 | 1.3.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.1 | | HCatalog | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-3 | 2.7.3-amzn-3 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 2.3.0-amzn-0 | 2.3.0-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | | Pig | 0.16.0-amzn-1 | 0.16.0-amzn-1 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.2.0 | 2.2.0 | 2.1.1 | 2.1.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.2 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## 5.8.1 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.8.1. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.8.0. Tanggal rilis awal: 22 Januari 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Pembaruan kernel Amazon Linux dari default Amazon Linux AMI untuk Amazon EMR untuk mengatasi kelemahan terkait dengan eksekusi spekulatif (CVE-2017-5715, CVE-2017-5753, dan CVE-2017-5754). Untuk informasi selengkapnya, lihat [https://aws.amazon.com/security/security-bulletins/AWS-2018-013/](https://aws.amazon.com/security/security-bulletins/AWS-2018-013/). ## 5.8.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.4.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.6.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.18.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.0-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.0-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-1 | Klien baris perintah Pig. | | spark-client | 2.2.0 | Klien baris perintah Spark. | | spark-history-server | 2.2.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.8.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.8.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.8.0 ## 5.8.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.8.0 | emr-5.7.1 | emr-5.7.0 | emr-5.6.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.11.160 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.1 | 1.3.0 | 1.3.0 | 1.2.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.1 | 1.3.0 | | HCatalog | 2.3.0-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-3 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 2.3.0-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.9.0- -1.2 HBase | | Pig | 0.16.0-amzn-1 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.2.0 | 2.1.1 | 2.1.1 | 2.1.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.2 | 0.7.2 | 0.7.2 | 0.7.1 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.8.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.8.0. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.7.0. Tanggal rilis awal: 10 Agustus 2017 Pembaruan fitur terakhir: 25 September 2017 **Upgrade** + AWS SDK 1.11.160 + Flink versi 1.3.1 + Hive versi 2.3.0. Untuk informasi lebih lanjut, lihat [Catatan Rilis](https://issues.apache.org/jira/secure/ConfigureReleaseNote.jspa?projectId=12310843&version=12340269) di situs Apache Hive. + Spark versi 2.2.0. Untuk informasi lebih lanjut, lihat [Catatan Rilis](https://spark.apache.org/releases/spark-release-2-2-0.html) di situs Apache Spark. **Fitur baru** + Penambahan support untuk melihat riwayat aplikasi (25 September 2017). Untuk informasi selengkapnya, lihat [Melihat Riwayat Aplikasi](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-cluster-application-history.html) di *Panduan Pengelolaan Amazon EMR*. **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + **Integrasi dengan AWS Glue Data Catalog** + Ditambahkan kemampuan untuk Hive dan Spark SQL untuk menggunakan AWS Glue Data Catalog sebagai penyimpanan metadata Hive. Untuk informasi selengkapnya, lihat [Menggunakan Katalog Data AWS Glue sebagai metastore untuk Hive](emr-hive-metastore-glue.md) dan [Gunakan katalog Katalog Data AWS Glue dengan Spark di Amazon EMR](emr-spark-glue.md). + Penambahan **Riwayat aplikasi** ke detail klaster, yang memungkinkan Anda melihat data riwayat untuk aplikasi YARN dan detail tambahan untuk aplikasi Spark. Untuk informasi selengkapnya, lihat [Melihat Riwayat Aplikasi](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-cluster-application-history.html) di *Panduan Pengelolaan Amazon EMR*. + **Oozie** + [OOZIE-2748](https://issues.apache.org/jira/browse/OOZIE-2748) yang telah di-backport. + **Rona** + [HUE-5859](https://issues.cloudera.org/browse/HUE-5859) yang telah di-backport + **HBase** + Ditambahkan patch untuk mengekspos waktu mulai server HBase master melalui Java Management Extensions (JMX) menggunakan. `getMasterInitializedTime` + Penambahan patch yang meningkatkan waktu mulai klaster. **Masalah yang diketahui** + Peluncuran klaster gagal saat semua aplikasi diinstal dan ukuran volume akar Amazon EBS default tidak diubah. Sebagai solusinya, gunakan `aws emr create-cluster` perintah dari AWS CLI dan tentukan parameter yang lebih besar. `--ebs-root-volume-size` + Hive 2.3.0 mengatur `hive.compute.query.using.stats=true` secara default. Hal ini menyebabkan kueri mengambil data statistik yang ada bukan secara langsung dari data, yang dapat membingungkan. Sebagai contoh, jika Anda memiliki tabel dengan `hive.compute.query.using.stats=true` dan mengunggah file baru ke `LOCATION` tabel, menjalankan kueri `SELECT COUNT(*)` pada tabel akan menghasilkan hitungan dari statistik, bukan mengambil dari baris yang ditambahkan. Sebagai solusinya, gunakan perintah `ANALYZE TABLE` untuk mengumpulkan statistik baru, atau atur `hive.compute.query.using.stats=false`. Untuk informasi selengkapnya, lihat [Statistik di Hive](https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-StatisticsinHive) di dokumentasi Apache Hive. + **Spark**—Saat menggunakan Spark, ada masalah kebocoran file handler dengan daemon apppusher, yang dapat muncul untuk tugas Spark yang berjalan lama setelah beberapa jam atau hari. Untuk memperbaiki masalah, sambungkan ke node utama dan ketik`sudo /etc/init.d/apppusher stop`. Ini akan menghentikan daemon apppusher, yang akan dimulai ulang secara otomatis oleh Amazon EMR. + **Riwayat aplikasi** + Data historis untuk eksekutor Spark yang mati tidak tersedia. + Riwayat aplikasi tidak tersedia untuk klaster yang menggunakan konfigurasi keamanan untuk mengaktifkan enkripsi in-flight. ## 5.8.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.4.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.4.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.4.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.6.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.18.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.3.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.3.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.3.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.3.0-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.3.0-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.3.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.3.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-1 | Klien baris perintah Pig. | | spark-client | 2.2.0 | Klien baris perintah Spark. | | spark-history-server | 2.2.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.2.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.2.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.8.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.8.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.7.1 ## 5.7.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.7.1 | emr-5.7.0 | emr-5.6.1 | emr-5.6.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.0 | 1.3.0 | 1.2.1 | 1.2.1 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.1 | 1.3.0 | 1.3.0 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.13.0 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.11.0- -1.3 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.1.1 | 2.1.1 | 2.1.1 | 2.1.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.2 | 0.7.2 | 0.7.1 | 0.7.1 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.7.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.7.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.5.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.18.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.1 | Klien baris perintah Spark. | | spark-history-server | 2.1.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.7.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.7.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.7.0 ## 5.7.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.7.0 | emr-5.6.1 | emr-5.6.0 | emr-5.5.4 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.3.0 | 1.2.1 | 1.2.1 | 1.2.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.1 | 1.3.0 | 1.3.0 | 1.3.0 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.13.0 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.11.0- -1.3 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.1.1 | 2.1.1 | 2.1.1 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.2 | 0.7.1 | 0.7.1 | 0.7.1 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.7.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.7.0. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.6.0. Tanggal rilis: 13 Juli 2017 **Upgrade** + Flink versi 1.3.0 + Phoenix versi 4.11.0 + Zeppelin versi 0.7.2 **Fitur baru** + Penambahan kemampuan untuk menentukan Amazon Linux AMI kustom saat Anda membuat klaster. Untuk informasi selengkapnya, lihat [Menggunakan AMI Kustom](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-custom-ami.html). **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + **HBase** + Ditambahkan kemampuan untuk mengkonfigurasi cluster HBase baca-replika. Lihat [Menggunakan Klaster Replika Baca.](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hbase-s3.html#emr-hbase-s3-read-replica) + Beberapa perbaikan bug dan peningkatan + **Presto** - penambahan kemampuan untuk mengonfigurasi `node.properties`. + **YARN** - penambahan kemampuan untuk mengonfigurasi `container-log4j.properties` + **Sqoop** - [SQOOP-2880](https://issues.apache.org/jira/browse/SQOOP-2880) yang telah di-backport, yang memperkenalkan argumen yang mengizinkan Anda untuk mengatur direktori sementara Sqoop. ## 5.7.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.5.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.18.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.3.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.11.0- -1.3 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.11.0- -1.3 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.1 | Klien baris perintah Spark. | | spark-history-server | 2.1.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.7.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.7.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.6.1 ## 5.6.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.6.1 | emr-5.6.0 | emr-5.5.4 | emr-5.5.3 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.2.1 | 1.2.1 | 1.2.0 | 1.2.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.13.0 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.1.1 | 2.1.1 | 2.1.0 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.1 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.6.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.6.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.5.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.17.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.2.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.9.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.9.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.1 | Klien baris perintah Spark. | | spark-history-server | 2.1.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.6.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.6.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.6.0 ## 5.6.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.6.0 | emr-5.5.4 | emr-5.5.3 | emr-5.5.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.2.1 | 1.2.0 | 1.2.0 | 1.2.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.13.0 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.1.1 | 2.1.0 | 2.1.0 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.1 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.6.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.6.0. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.5.0. Tanggal rilis: 5 Juni 2017 **Upgrade** + Flink versi 1.2.1 + HBase 1.3.1 + Mahout versi 0.13.0. Ini adalah versi Mahout pertama yang men-support Spark 2.x di Amazon EMR versi 5.0 dan versi setelahnya. + Spark versi 2.1.1 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + **Presto** + Menambahkan kemampuan untuk mengaktifkan komunikasi SSL/TLS aman antara node Presto dengan mengaktifkan enkripsi dalam transit menggunakan konfigurasi keamanan. Untuk informasi selengkapnya, lihat [Enkripsi Data In-transit](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-data-encryption-options.html#emr-encryption-intransit). + [Presto 7661](https://github.com/prestodb/presto/pull/7661/commits) yang telah di-backport, yang menambahkan opsi `VERBOSE` pada pernyataan `EXPLAIN ANALYZE` untuk melaporkan statistik yang detail dan low-level tentang rencana kueri. ## 5.6.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.5.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.17.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.2.1 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.1 | HBase klien baris perintah. | | hbase-rest-server | 1.3.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.13.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.9.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.9.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.1 | Klien baris perintah Spark. | | spark-history-server | 2.1.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.6.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.6.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-env | Ubah nilai dalam file presto-env.sh Presto. | | presto-node | Ubah nilai dalam file node.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.5.4 ## 5.5.4 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.5.4 | emr-5.5.3 | emr-5.5.2 | emr-5.5.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.1 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## 5.5.4 catatan rilis Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.5.4 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.5.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.16.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.2.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.0 | HBase klien baris perintah. | | hbase-rest-server | 1.3.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.9.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.9.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.5.4 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.5.4** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.5.3 ## 5.5.3 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.5.3 | emr-5.5.2 | emr-5.5.1 | emr-5.5.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.12.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,170 | | Spark | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.1 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.10 | ## Catatan rilis 5.5.3 Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.5.3. Perubahan relatif dilakukan terhadap 5.5.2. Tanggal rilis awal: 29 Agustus 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Rilis ini membahas potensi kelemahan keamanan. ## 5.5.3 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.5.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.16.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.2.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.0 | HBase klien baris perintah. | | hbase-rest-server | 1.3.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.9.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.9.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.5.3 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.5.3** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.5.2 ## 5.5.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.5.2 | emr-5.5.1 | emr-5.5.0 | emr-5.4.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-1 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.12.0 | 3.11.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,170 | 0,166 | | Spark | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.1 | 0.7.1 | 0.7.1 | 0.7.0 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.10 | 3.4.9 | ## 5.5.2 Catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR rilis 5.5.2. Perubahan relatif dilakukan terhadap 5.5.1. Tanggal rilis awal: 29 Maret 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Pembaruan kernel Amazon Linux dari default Amazon Linux AMI untuk Amazon EMR untuk mengatasi potensi kelemahan. ## 5.5.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.5.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.16.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.2.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.0 | HBase klien baris perintah. | | hbase-rest-server | 1.3.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.9.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.9.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.5.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.5.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.5.1 ## 5.5.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.5.1 | emr-5.5.0 | emr-5.4.1 | emr-5.4.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.2.0 | 1.2.0 | 1.2.0 | 1.2.0 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.0 | 1.3.0 | 1.3.0 | 1.3.0 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.12.0 | 3.11.0 | 3.11.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,170 | 0,166 | 0,166 | | Spark | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.1 | 0.7.1 | 0.7.0 | 0.7.0 | | ZooKeeper | 3.4.10 | 3.4.10 | 3.4.9 | 3.4.9 | ## 5.5.1 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.5.1. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.5.0. Tanggal rilis awal: 22 Januari 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Pembaruan kernel Amazon Linux dari default Amazon Linux AMI untuk Amazon EMR untuk mengatasi kelemahan terkait dengan eksekusi spekulatif (CVE-2017-5715, CVE-2017-5753, dan CVE-2017-5754). Untuk informasi selengkapnya, lihat [https://aws.amazon.com/security/security-bulletins/AWS-2018-013/](https://aws.amazon.com/security/security-bulletins/AWS-2018-013/). ## 5.5.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.5.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.16.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.2.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.0 | HBase klien baris perintah. | | hbase-rest-server | 1.3.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.9.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.9.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.5.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.5.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.5.0 ## 5.5.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.5.0 | emr-5.4.1 | emr-5.4.0 | emr-5.3.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.2.0 | 1.2.0 | 1.2.0 | 1.1.4 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.0 | 1.3.0 | 1.3.0 | 1.2.3 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.12.0 | 3.11.0 | 3.11.0 | 3.11.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,170 | 0,166 | 0,166 | 0.157.1 | | Spark | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.1 | 0.7.0 | 0.7.0 | 0.6.2 | | ZooKeeper | 3.4.10 | 3.4.9 | 3.4.9 | 3.4.9 | ## Catatan rilis 5.5.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.5.0. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.4.0. Tanggal rilis: 26 April 2017 **Upgrade** + Hue versi 3.12 + Presto versi 0.170 + Zeppelin versi 0.7.1 + ZooKeeper 3.4.10 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + **Percikan** + Backported Spark Patch [(SPARK-20115) Perbaiki DAGScheduler untuk menghitung ulang semua blok shuffle yang hilang saat layanan shuffle eksternal tidak tersedia untuk Spark versi 2.1.0, yang termasuk dalam rilis ini](https://issues.apache.org/jira/browse/SPARK-20115). + **Flink** + Flink sekarang dibangun dengan Scala 2.11. Jika Anda menggunakan API dan perpustakaan Scala, kami menyarankan Anda menggunakan Scala 2.11 dalam proyek Anda. + Mengatasi masalah di mana default `HADOOP_CONF_DIR` dan `YARN_CONF_DIR` tidak diatur dengan benar, sehingga `start-scala-shell.sh` gagal bekerja. Juga penambahan kemampuan untuk mengatur nilai ini menggunakan `env.hadoop.conf.dir` dan `env.yarn.conf.dir` di `/etc/flink/conf/flink-conf.yaml` atau klasifikasi konfigurgasi `flink-conf`. + Perintah spesifik EMR baru diperkenalkan, `flink-scala-shell` sebagai wrapper untuk `start-scala-shell.sh`. Kami menyarankan untuk menggunakan perintah ini, bukan `start-scala-shell`. Perintah baru menyederhanakan eksekusi. Sebagai contoh, `flink-scala-shell -n 2` memulai shell Flink Scala dengan tugas paralelisme 2. + Perintah spesifik EMR baru diperkenalkan, `flink-yarn-session` sebagai wrapper untuk `yarn-session.sh`. Kami menyarankan untuk menggunakan perintah ini, bukan `yarn-session`. Perintah baru menyederhanakan eksekusi. Misalnya, `flink-yarn-session -d -n 2` memulai sesi Flink yang berjalan lama dalam keadaan terlepas dengan dua pengelola tugas. + Telah mengatasi masalah di mana [(FLINK-6125) Commons httpclient tidak tertutup lagi di Flink 1.2](https://issues.apache.org/jira/browse/FLINK-6125). + **Presto** + Penambahan support untuk autentikasi LDAP. Menggunakan LDAP dengan Presto on Amazon EMR mengharuskan Anda mengaktifkan akses HTTPS untuk koordinator Presto (`http-server.https.enabled=true` dalam `config.properties`). Untuk detail konfigurasi, lihat [Autentikasi LDAP](https://prestodb.io/docs/current/security/ldap.html) dalam dokumentasi Presto. + Penambahan support untuk `SHOW GRANTS`. + **Amazon EMR Basis Linux AMI** + Rilis Amazon EMR sekarang berbasis Amazon Linux 2017.03. Untuk informasi selengkapnya, lihat [Catatan Rilis Amazon Linux AMI 2017.03](https://aws.amazon.com/amazon-linux-ami/2017.03-release-notes/). + Menghapus Python 2.6 dari citra Amazon EMR base Linux. Python 2.7 dan 3.4 diinstal secara default. Anda dapat menginstal Python 2.6 secara manual jika diperlukan. ## 5.5.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.5.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.16.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.2.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.0 | HBase klien baris perintah. | | hbase-rest-server | 1.3.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.12.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.9.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.9.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,170 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,170 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.10 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.10 | ZooKeeper klien baris perintah. | ## 5.5.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.5.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.4.1 ## 5.4.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.4.1 | emr-5.4.0 | emr-5.3.2 | emr-5.3.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.2.0 | 1.2.0 | 1.1.4 | 1.1.4 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.0 | 1.3.0 | 1.2.3 | 1.2.3 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.11.0 | 3.11.0 | 3.11.0 | 3.11.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.9.0- -1.2 HBase | 4.9.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,166 | 0,166 | 0.157.1 | 0.157.1 | | Spark | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.0 | 0.7.0 | 0.6.2 | 0.6.2 | | ZooKeeper | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## 5.4.1 catatan rilis Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.4.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.15.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.2.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.0 | HBase klien baris perintah. | | hbase-rest-server | 1.3.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.9.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.9.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,166 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,166 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 5.4.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.4.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.4.0 ## 5.4.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.4.0 | emr-5.3.2 | emr-5.3.1 | emr-5.3.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.2.0 | 1.1.4 | 1.1.4 | 1.1.4 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.3.0 | 1.2.3 | 1.2.3 | 1.2.3 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.11.0 | 3.11.0 | 3.11.0 | 3.11.0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.3.0 | | Phoenix | 4.9.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,166 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 2.1.0 | 2.1.0 | 2.1.0 | 2.1.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.7.0 | 0.6.2 | 0.6.2 | 0.6.2 | | ZooKeeper | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## Catatan rilis 5.4.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.4.0. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.3.0. Tanggal rilis: 08 Maret 2017 **Upgrade** + Flink di-upgrade ke 1.2.0 + Upgrade ke 1.3.0 HBase + Phoenix di-upgrade ke 4.9.0 **catatan** Jika Anda melakukan upgrade dari Amazon EMR versi sebelumnya ke Amazon EMR versi 5.4.0 atau yang lebih baru dan menggunakan pengindeksan sekunder, lakukan upgrade indeks lokal seperti yang dijelaskan dalam [dokumentasi Apache Phoenix](https://phoenix.apache.org/secondary_indexing.html#Upgrading_Local_Indexes_created_before_4.8.0). Amazon EMR menghapus konfigurasi yang diperlukan dari klasifikasi `hbase-site`, tetapi indeks perlu diisi ulang. Upgrade indeks online dan offline didukung. Default-nya adalah upgrade online, yang berarti indeks diisi ulang saat menginisialisasi dari klien Phoenix versi 4.8.0 atau lebih tinggi. Untuk menentukan upgrade offline, atur `phoenix.client.localIndexUpgrade` konfigurasi ke false dalam `phoenix-site` klasifikasi, dan kemudian SSH ke node utama untuk dijalankan. `psql [zookeeper] -1` + Presto di-upgrade ke 0.166 + Zeppelin di-upgrade ke 0.7.0 **Perubahan dan penyempurnaan** + Penambahan support untuk instans r4. Lihat [Tipe Instans Amazon EC2](https://aws.amazon.com/ec2/instance-types/). ## 5.4.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.3.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.15.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.2.0 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.3.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.3.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.3.0 | HBase klien baris perintah. | | hbase-rest-server | 1.3.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.3.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-hbase | 2.1.1-amzn-0 | Klien Hive-hbase. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server2 | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.9.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.9.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,166 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,166 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.7.0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 5.4.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.4.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.3.2 ## 5.3.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.3.2 | emr-5.3.1 | emr-5.3.0 | emr-5.2.3 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.1.4 | 1.1.4 | 1.1.4 | 1.1.3 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.11.0 | 3.11.0 | 3.11.0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.3.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 2.1.0 | 2.1.0 | 2.1.0 | 2.0.2 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | | ZooKeeper | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## 5.3.2 catatan rilis Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.3.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.14.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.1.4 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.3 | HBase klien baris perintah. | | hbase-rest-server | 1.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 5.3.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.3.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.3.1 ## 5.3.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.3.1 | emr-5.3.0 | emr-5.2.3 | emr-5.2.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.1.4 | 1.1.4 | 1.1.3 | 1.1.3 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | | HCatalog | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | | Hive | 2.1.1-amzn-0 | 2.1.1-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.11.0 | 3.11.0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.3.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 2.1.0 | 2.1.0 | 2.0.2 | 2.0.2 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | | ZooKeeper | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## 5.3.1 Catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.3.1. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.3.0. Tanggal rilis: 7 Februari 2017 Perubahan kecil untuk melakukan backporting pada patch Zeppelin dan memperbarui AMI default untuk Amazon EMR. ## 5.3.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.14.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.1.4 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.3 | HBase klien baris perintah. | | hbase-rest-server | 1.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 5.3.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.3.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.3.0 ## 5.3.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.3.0 | emr-5.2.3 | emr-5.2.2 | emr-5.2.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.1.4 | 1.1.3 | 1.1.3 | 1.1.3 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | | HCatalog | 2.1.1-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | | Hive | 2.1.1-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.11.0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.3.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 2.1.0 | 2.0.2 | 2.0.2 | 2.0.2 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | | ZooKeeper | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## Catatan rilis 5.3.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.3.0. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.2.1. Tanggal rilis: 26 Januari 2017 **Upgrade** + Hive di-upgrade ke 2.1.1 + Hue di-upgrade ke 3.11.0 + Spark di-upgrade ke 2.1.0 + Oozie di-upgrade ke 4.3.0 + Flink di-upgrade ke 1.1.4 **Perubahan dan penyempurnaan** + Menambahkan patch ke Hue yang mengizinkan Anda menggunakan pengaturan `interpreters_shown_on_wheel` untuk mengonfigurasi apa yang akan ditampilkan interpreter pertama kali di roda pilihan Notebook, terlepas dari urutannya dalam file `hue.ini`. + Penambahan konfigurasi klasifikasi `hive-parquet-logging`, yang dapat Anda gunakan untuk mengonfigurasi nilai-nilai dalam file `parquet-logging.properties` Hive. ## 5.3.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.14.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.1.4 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.3 | HBase klien baris perintah. | | hbase-rest-server | 1.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.1-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.1-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.1-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.1-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.1-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.1-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.11.0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.3.0 | Klien baris perintah Oozie. | | oozie-server | 4.3.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.1.0 | Klien baris perintah Spark. | | spark-history-server | 2.1.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.1.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.1.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 5.3.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.3.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-parquet-logging | Ubah nilai dalam file parquet-logging.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.2.3 ## 5.2.3 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.2.3 | emr-5.2.2 | emr-5.2.1 | emr-5.2.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.1.3 | 1.1.3 | 1.1.3 | 1.1.3 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-0 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0.157.1 | 0.157.1 | 0.157.1 | 0,152.3 | | Spark | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.2 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | | ZooKeeper | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.8 | ## 5.2.3 catatan rilis Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.2.3 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.13.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.1.3 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.3 | HBase klien baris perintah. | | hbase-rest-server | 1.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.2 | Klien baris perintah Spark. | | spark-history-server | 2.0.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 5.2.3 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.2.3** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.2.2 ## 5.2.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.2.2 | emr-5.2.1 | emr-5.2.0 | emr-5.1.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.1.3 | 1.1.3 | 1.1.3 | 1.1.3 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-0 | 2.7.3-amzn-0 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0.157.1 | 0.157.1 | 0,152.3 | 0,152.3 | | Spark | 2.0.2 | 2.0.2 | 2.0.2 | 2.0.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | | ZooKeeper | 3.4.9 | 3.4.9 | 3.4.8 | 3.4.8 | ## 5.2.2 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.2.2. Perubahan relatif dilakukan terhadap rilis Amazon EMR 5.2.1. Tanggal rilis: 2 Mei 2017 **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Backport [SPARK-194459](https://issues.apache.org/jira/browse/SPARK-19459), yang membahas masalah saat membaca dari tabel ORC dengan kolom bisa gagal. char/varchar ## 5.2.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.13.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.1.3 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.3 | HBase klien baris perintah. | | hbase-rest-server | 1.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.2 | Klien baris perintah Spark. | | spark-history-server | 2.0.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 5.2.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.2.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.2.1 ## 5.2.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.2.1 | emr-5.2.0 | emr-5.1.1 | emr-5.1.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.1.3 | 1.1.3 | 1.1.3 | 1.1.3 | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.3 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-0 | 2.7.3-amzn-0 | 2.7.3-amzn-0 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0.157.1 | 0,152.3 | 0,152.3 | 0,152.3 | | Spark | 2.0.2 | 2.0.2 | 2.0.1 | 2.0.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.2 | | ZooKeeper | 3.4.9 | 3.4.8 | 3.4.8 | 3.4.8 | ## 5.2.1 Catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.2.1. Perubahan relatif dilakukan terhadap Amazon EMR rilis 5.2.0. Tanggal rilis: 29 Desember 2016 **Upgrade** + Presto di-upgrade ke 0.157.1. Untuk informasi selengkapnya, lihat [Catatan Rilis Presto](https://prestodb.io/docs/current/release/release-0.157.1.html) di dokumentasi Presto. + Zookeeper di-upgrade 3.4.9. Untuk informasi selengkapnya, lihat [Catatan ZooKeeper Rilis](https://zookeeper.apache.org/doc/r3.4.9/releasenotes.html) dalam ZooKeeper dokumentasi Apache. **Perubahan dan penyempurnaan** + Menambahkan support untuk tipe instans Amazon EC2 m4.16xlarge di Amazon EMR versi 4.8.3 dan versi yang lebih baru, tidak termasuk versi 5.0.0, 5.0.3, dan 5.2.0. + Rilis Amazon EMR sekarang berbasis Amazon Linux 2016.09. Untuk informasi selengkapnya, lihat [https://aws.amazon.com/amazon-linux-ami/2016.09-release-notes/](https://aws.amazon.com/amazon-linux-ami/2016.09-release-notes/). + Lokasi jalur konfigurasi Flink dan YARN sekarang diatur secara default di `/etc/default/flink` sehingga Anda tidak perlu mengatur variabel lingkungan `FLINK_CONF_DIR` dan `HADOOP_CONF_DIR` saat menjalankan skrip driver `flink` atau `yarn-session.sh` untuk melakukan peluncuran tugas Flink. + Menambahkan dukungan untuk FlinkKinesisConsumer kelas. **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah di Hadoop di mana ReplicationMonitor utas bisa macet untuk waktu yang lama karena perlombaan antara replikasi dan penghapusan file yang sama di cluster besar. + Memperbaiki masalah saat ControlledJob \$1toString gagal dengan pengecualian penunjuk nol (NPE) saat status pekerjaan tidak berhasil diperbarui. ## 5.2.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.13.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.1.3 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.3 | HBase klien baris perintah. | | hbase-rest-server | 1.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.2 | Klien baris perintah Spark. | | spark-history-server | 2.0.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 5.2.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.2.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.2.0 ## 5.2.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.2.0 | emr-5.1.1 | emr-5.1.0 | emr-5.0.3 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.1.3 | 1.1.3 | 1.1.3 | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.3 | 1.2.3 | 1.2.3 | 1.2.2 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-0 | 2.7.3-amzn-0 | 2.7.3-amzn-0 | 2.7.3-amzn-0 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,152.3 | 0,152.3 | 0,152.3 | 0,152.3 | | Spark | 2.0.2 | 2.0.1 | 2.0.1 | 2.0.1 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.2 | 0.6.2 | 0.6.2 | 0.6.1 | | ZooKeeper | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## Catatan rilis 5.2.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.2.0. Perubahan relatif dilakukan terhadap Amazon EMR rilis 5.1.0. Tanggal rilis: 21 November 2016 **Perubahan dan penyempurnaan** + Menambahkan mode penyimpanan Amazon S3 untuk. HBase + Memungkinkan Anda menentukan lokasi Amazon S3 untuk rootdir. HBase Untuk informasi lebih lanjut, lihat [HBase di Amazon S3](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hbase-s3.html). **Upgrade** + Spark di-upgrade 2.0.2 **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah dengan /mnt yang dibatasi hingga 2 TB pada tipe instans khusus EBS. + Memperbaiki masalah dengan instance-controler dan log logpusher yang dikeluarkan ke file .out yang sesuai alih-alih ke file .log normal yang dikonfigurasi log4j, yang berputar setiap jam. File .out tidak berputar, jadi ini pada akhirnya akan mengisi partisi /emr. Masalah ini hanya memengaruhi tipe instans mesin virtual perangkat keras (HVM). ## 5.2.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.12.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.1.3 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.3 | HBase klien baris perintah. | | hbase-rest-server | 1.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,152.3 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,152.3 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.2 | Klien baris perintah Spark. | | spark-history-server | 2.0.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 5.2.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.2.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase | Pengaturan Amazon EMR-curated untuk Apache. HBase | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.1.1 ## 5.1.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.1.1 | emr-5.1.0 | emr-5.0.3 | emr-5.0.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.1.3 | 1.1.3 | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.3 | 1.2.3 | 1.2.2 | 1.2.2 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-0 | 2.7.3-amzn-0 | 2.7.3-amzn-0 | 2.7.2-amzn-3 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,152.3 | 0,152.3 | 0,152.3 | 0,150 | | Spark | 2.0.1 | 2.0.1 | 2.0.1 | 2.0.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.2 | 0.6.2 | 0.6.1 | 0.6.1-SNAPSHOT | | ZooKeeper | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## Catatan terbitan 5.1.1 Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 5.1.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.11.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.1.3 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.3 | HBase klien baris perintah. | | hbase-rest-server | 1.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,152.3 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,152.3 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.1 | Klien baris perintah Spark. | | spark-history-server | 2.0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 5.1.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.1.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.1.0 ## 5.1.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [https://flink.apache.org/](https://flink.apache.org/),, [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.1.0 | emr-5.0.3 | emr-5.0.2 | emr-5.0.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | 1.1.3 | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.3 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-0 | 2.7.3-amzn-0 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,152.3 | 0,152.3 | 0,150 | 0,150 | | Spark | 2.0.1 | 2.0.1 | 2.0.0 | 2.0.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.2 | 0.6.1 | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | | ZooKeeper | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## Catatan rilis 5.1.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.1.0. Perubahan relatif dilakukan terhadap Amazon EMR rilis 5.0.3. Tanggal rilis: 03 November 2016 **Perubahan dan penyempurnaan** + Menambahkan support untuk Flink 1.1.3. + Presto telah ditambahkan sebagai opsi di bagian notebook Hue. **Upgrade** + Upgrade ke 1.2.3 HBase + Zeppelin di-upgrade ke 0.6.2 **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah dengan kueri Tez di Amazon S3 dengan file ORC yang tidak berfungsi sebaik versi Amazon EMR 4.x sebelumnya. ## 5.1.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.11.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | flink-client | 1.1.3 | Skrip dan aplikasi klien baris perintah Apache Flink. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.3 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.3 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.3 | HBase klien baris perintah. | | hbase-rest-server | 1.2.3 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.3 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,152.3 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,152.3 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.1 | Klien baris perintah Spark. | | spark-history-server | 2.0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.2 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 5.1.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.1.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | flink-conf | Ubah pengaturan flink-conf.yaml. | | flink-log4j | Ubah pengaturan log4j.properties Flink. | | flink-log4j-yarn-session | Ubah pengaturan Flink log4 j-yarn-session .properties. | | flink-log4j-cli | Ubah pengaturan log4j-cli.properties Flink. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.0.3 ## 5.0.3 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info),, [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.0.3 | emr-5.0.2 | emr-5.0.1 | emr-5.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-0 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,152.3 | 0,150 | 0,150 | 0,150 | | Spark | 2.0.1 | 2.0.0 | 2.0.0 | 2.0.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.1 | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | | ZooKeeper | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 5.0.3 Catatan terbitan Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 5.0.3. Perubahan relatif dilakukan terhadap Amazon EMR rilis 5.0.0. Tanggal rilis: 24 Oktober 2016 **Upgrade** + Hadoop di-upgrade ke 2.7.3 + Presto di-upgrade ke 0.152.3, yang mencakup support untuk antarmuka web Presto. Anda dapat mengakses antarmuka web Presto pada koordinator Presto dengan menggunakan port 8889. Untuk informasi lebih lanjut tentang antarmuka web Presto, lihat [Antarmuka Web](https://prestodb.io/docs/current/admin/web-interface.html) dalam dokumentasi Presto. + Spark di-upgrade ke 2.0.1 + Rilis Amazon EMR sekarang berbasis Amazon Linux 2016.09. Untuk informasi selengkapnya, lihat [https://aws.amazon.com/amazon-linux-ami/2016.09-release-notes/](https://aws.amazon.com/amazon-linux-ami/2016.09-release-notes/). ## 5.0.3 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.10.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,152.3 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,152.3 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.1 | Klien baris perintah Spark. | | spark-history-server | 2.0.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 5.0.3 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.0.3** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.0.2 ## 5.0.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info),, [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.0.3 | emr-5.0.2 | emr-5.0.1 | emr-5.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-0 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,152.3 | 0,150 | 0,150 | 0,150 | | Spark | 2.0.1 | 2.0.0 | 2.0.0 | 2.0.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.1 | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | | ZooKeeper | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 5.0.2 catatan rilis ## 5.0.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.9.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.46 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,150 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,150 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.0 | Klien baris perintah Spark. | | spark-history-server | 2.0.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.1-SNAPSHOT | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 5.0.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.0.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.0.1 ## 5.0.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info),, [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.0.3 | emr-5.0.2 | emr-5.0.1 | emr-5.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-0 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,152.3 | 0,150 | 0,150 | 0,150 | | Spark | 2.0.1 | 2.0.0 | 2.0.0 | 2.0.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.1 | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | | ZooKeeper | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 5.0.1 Catatan terbitan ## 5.0.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.9.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.46 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,150 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,150 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.0 | Klien baris perintah Spark. | | spark-history-server | 2.0.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.1-SNAPSHOT | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 5.0.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-5.0.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 5.0.0 ## 5.0.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info),, [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/),, [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-5.0.3 | emr-5.0.2 | emr-5.0.1 | emr-5.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | 2.11.8 | 2.11.8 | 2.11.8 | 2.11.8 | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hadoop | 2.7.3-amzn-0 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | | Hive | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | 2.1.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | 3.10.0-amzn-0 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | 0.16.0-amzn-0 | | Presto | 0,152.3 | 0,150 | 0,150 | 0,150 | | Spark | 2.0.1 | 2.0.0 | 2.0.0 | 2.0.0 | | Sqoop | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | 0.6.1 | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | 0.6.1-SNAPSHOT | | ZooKeeper | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## Catatan rilis 5.0.0 Tanggal rilis: 27 Juli 2016 **Upgrade** + Hive di-upgrade ke 2.1 + Presto di-upgrade ke 0.150 + Spark di-upgrade ke 2.0 + Hue di-upgrade ke 3.10.0 + Pig di-upgrade ke 0.16.0 + Tez di-upgrade ke 0.8.4 + Zeppelin di-upgrade ke 0.6.1 **Perubahan dan penyempurnaan** + Amazon EMR men-support versi sumber terbuka terbaru dari Hive (versi 2.1) dan Pig (versi 0.16.0). Jika Anda pernah menggunakan Hive atau Pig di Amazon EMR di masa lalu, ini dapat memengaruhi beberapa kasus penggunaan. Untuk informasi lebih lanjut, lihat [Hive](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hive.html) dan [Pig](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-pig.html). + Mesin eksekusi default untuk Hive dan Pig sekarang adalah Tez. Untuk mengubah ini, Anda akan mengedit nilai yang sesuai dalam klasifikasi konfigurasi `hive-site` dan `pig-properties`, masing-masing. + Fitur langkah debug yang disempurnakan telah ditambahkan, yang mengizinkan Anda untuk melihat akar masalah gagal langkah jika layanan dapat menentukan penyebabnya. Untuk informasi selengkapnya, lihat [ Peningkatan Langkah Debug](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-enhanced-step-debugging.html) di Panduan Pengelolaan Amazon EMR. + Aplikasi yang sebelumnya diakhiri dengan "-Sandbox" tidak lagi menggunakan akhiran itu. Ini akan merusak otomatisasi Anda, misalnya, jika Anda menggunakan skrip untuk melakukan peluncuran klaster dengan aplikasi ini. Tabel berikut menunjukkan nama-nama aplikasi di Amazon EMR 4.7.2 vs Amazon EMR 5.0.0. **Perubahan nama aplikasi** [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-500-release.html) + Spark sekarang dikompilasi untuk Scala 2.11. + Java 8 sekarang menjadi default JVM. Semua aplikasi berjalan menggunakan waktu aktif Java 8. Tidak ada perubahan terhadap target kode byte application’s. Sebagian besar aplikasi tetap menargetkan Java 7. + Zeppelin sekarang menyertakan fitur autentikasi. Untuk informasi selengkapnya, lihat [Zeppelin](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-zeppelin.html). + Menambahkan support untuk konfigurasi keamanan, yang mengizinkan Anda membuat dan menerapkan opsi enkripsi dengan lebih mudah. Untuk informasi selengkapnya, lihat [Enkripsi Data](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-data-encryption.html). ## 5.0.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.9.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 2.1.0-amzn-0 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 2.1.0-amzn-0 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 2.1.0-amzn-0 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 2.1.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 2.1.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 2.1.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.10.0-amzn-0 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.46 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,150 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,150 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.16.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 2.0.0 | Klien baris perintah Spark. | | spark-history-server | 2.0.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 2.0.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 2.0.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.1-SNAPSHOT | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 5.0.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-5.0.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j2 | Ubah nilai di HCat log4j2.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-beeline-log4j2 | Ubah nilai dalam file beeline-log4j2.properties Hive. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j2 | Ubah nilai dalam file hive-exec-log 4j2.properties Hive. | | hive-llap-daemon-log4j2 | Ubah nilai dalam file llap-daemon-log 4j2.properties Hive. | | hive-log4j2 | Ubah nilai dalam file hive-log4j2.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-hive-site | Ubah nilai dalam file hive-site.xml Spark | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Versi rilis Amazon EMR 4.x Bagian ini berisi versi aplikasi, catatan rilis, versi komponen, dan klasifikasi konfigurasi yang tersedia di setiap versi rilis Amazon EMR 4.x. Saat meluncurkan cluster, Anda dapat memilih dari beberapa rilis Amazon EMR. Ini memungkinkan Anda untuk menguji dan menggunakan versi aplikasi yang sesuai dengan kebutuhan kompatibilitas Anda. Anda menentukan nomor rilis dengan *label rilis*. Label rilis ada dalam bentuk`emr-x.x.x`. Misalnya, `emr-7.12.0`. Rilis EMR Amazon baru tersedia di berbagai Wilayah selama beberapa hari, dimulai dengan Wilayah pertama pada tanggal rilis awal. Versi rilis terbaru mungkin tidak tersedia di Wilayah Anda selama periode ini. Untuk tabel lengkap versi aplikasi di setiap rilis Amazon EMR 4.x, lihat. [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Topics** + [ # Versi aplikasi di Amazon EMR 4.x rilis ](emr-release-app-versions-4.x.md) + [ # Perbedaan dalam versi rilis Amazon EMR 4.x ](emr-release-differences-4x.md) + [ # Amazon EMR rilis 4.9.6 ](emr-496-release.md) + [ # Amazon EMR rilis 4.9.5 ](emr-495-release.md) + [ # Amazon EMR rilis 4.9.4 ](emr-494-release.md) + [ # Amazon EMR rilis 4.9.3 ](emr-493-release.md) + [ # Amazon EMR rilis 4.9.2 ](emr-492-release.md) + [ # Amazon EMR rilis 4.9.1 ](emr-491-release.md) + [ # Amazon EMR rilis 4.8.5 ](emr-485-release.md) + [ # Amazon EMR rilis 4.8.4 ](emr-484-release.md) + [ # Amazon EMR rilis 4.8.3 ](emr-483-release.md) + [ # Amazon EMR rilis 4.8.2 ](emr-482-release.md) + [ # Amazon EMR rilis 4.8.1 ](emr-481-release.md) + [ # Amazon EMR rilis 4.8.0 ](emr-480-release.md) + [ # Amazon EMR rilis 4.7.4 ](emr-474-release.md) + [ # Amazon EMR rilis 4.7.3 ](emr-473-release.md) + [ # Amazon EMR rilis 4.7.2 ](emr-472-release.md) + [ # Amazon EMR rilis 4.7.1 ](emr-471-release.md) + [ # Amazon EMR rilis 4.7.0 ](emr-470-release.md) + [ # Amazon EMR rilis 4.6.1 ](emr-461-release.md) + [ # Amazon EMR rilis 4.6.0 ](emr-460-release.md) + [ # Amazon EMR rilis 4.5.0 ](emr-450-release.md) + [ # Amazon EMR rilis 4.4.0 ](emr-440-release.md) + [ # Amazon EMR rilis 4.3.0 ](emr-430-release.md) + [ # Amazon EMR rilis 4.2.0 ](emr-420-release.md) + [ # Amazon EMR rilis 4.1.0 ](emr-410-release.md) + [ # Amazon EMR rilis 4.0.0 ](emr-400-release.md) # Versi aplikasi di Amazon EMR 4.x rilis Tabel berikut mencantumkan versi aplikasi yang tersedia di setiap rilis Amazon EMR 4.x. **Informasi versi aplikasi** | | emr-4.9.6 | emr-4.9.5 | emr-4.9.4 | emr-4.9.3 | emr-4.9.2 | emr-4.9.1 | emr-4.8.5 | emr-4.8.4 | emr-4.8.3 | emr-4.8.2 | emr-4.8.1 | emr-4.8.0 | emr-4.7.4 | emr-4.7.3 | emr-4.7.2 | emr-4.7.1 | emr-4.7.0 | emr-4.6.1 | emr-4.6.0 | emr-4.5.0 | emr-4.4.0 | emr-4.3.0 | emr-4.2.0 | emr-4.1.0 | emr-4.0.0 | | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.27 | 1.10.27 | 1.10.27 | 1.10.27 | 1.10.27 | 1.10.27 | Tidak dilacak | Tidak dilacak | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Delta | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Flink | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | 3.6.0 | - | - | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.1 | 1.2.1 | 1.2.1 | 1.2.1 | 1.2.1 | 1.2.0 | 1.2.0 | - | - | - | - | - | - | | HCatalog | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-5 | 1.0.0-amzn-5 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-3 | - | - | - | - | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-0 | 2.7.2-amzn-4 | 2.7.2-amzn-4 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-2 | 2.7.2-amzn-2 | 2.7.2-amzn-1 | 2.7.2-amzn-1 | 2.7.2-amzn-0 | 2.7.1-amzn-1 | 2.7.1-amzn-0 | 2.6.0-amzn-2 | 2.6.0-amzn-1 | 2.6.0-amzn-0 | | Hive | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-5 | 1.0.0-amzn-5 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-3 | 1.0.0-amzn-2 | 1.0.0-amzn-1 | 1.0.0-amzn-1 | 1.0.0-amzn-0 | | Hudi | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-6 | 3.7.1-amzn-6 | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-4 | - | | Iceberg | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | JupyterHub | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Livy | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | MXNet | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.0 | 0.12.0 | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.0 | 0.11.0 | 0.11.0 | 0.10.0 | | Oozie | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | 4.0.1 | - | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | - | - | - | - | - | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | 0,152.3 | 0,151 | 0,151 | 0,148 | 0,148 | 0,148 | 0,147 | 0,147 | 0,143 | 0,143 | 0,140 | 0,136 | 0,130 | 0,125 | 0,119 | - | | Spark | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.2 | 1.6.2 | 1.6.2 | 1.6.2 | 1.6.2 | 1.6.2 | 1.6.1 | 1.6.1 | 1.6.1 | 1.6.1 | 1.6.1 | 1.6.0 | 1.6.0 | 1.5.2 | 1.5.0 | 1.4.1 | | Sqoop | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | - | - | - | - | | TensorFlow | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.3 | 0.8.3 | 0.8.3 | 0.8.3 | 0.8.3 | - | - | - | - | - | - | - | - | | Trino (PrestoSQL) | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Zeppelin | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.5-incubating-amzn-1 | 0.5.5-incubating-amzn-0 | 0.6.0-incubating-SNAPSHOT | - | | ZooKeeper | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | - | - | - | - | - | - | # Perbedaan dalam versi rilis Amazon EMR 4.x Dokumentasi untuk fitur Amazon EMR di *Panduan Pengelolaan Amazon EMR* menentukan versi rilis Amazon EMR yang disediakan fitur, serta perbedaan yang berlaku antara fitur Amazon EMR sejak versi 4.0.0. Dimulai dengan rilis Amazon EMR versi 5.0.0, beberapa aplikasi mendapat peningkatan versi signifikan yang mengubah instalasi atau detail operasional, dan beberapa aplikasi lainnya dipromosikan dari aplikasi sandbox ke aplikasi asli. Setiap topik di bagian ini memberikan perbedaan spesifik aplikasi yang menonjol saat menggunakan versi rilis Amazon EMR 4.x. **Topics** + [ # Aplikasi-aplikasi Sandbox ](emr-sandbox-apps-4x.md) + [ # Pertimbangan untuk menggunakan Hive di Amazon EMR 4.x ](emr-Hive-4x.md) + [ # Pertimbangan untuk menggunakan Pig di Amazon EMR 4.x ](emr-Pig-4x.md) # Aplikasi-aplikasi Sandbox Saat menggunakan versi rilis Amazon EMR 4.x, beberapa aplikasi dianggap sebagai aplikasi *sandbox*. Aplikasi Sandbox adalah versi awal dari aplikasi yang kami sediakan pada saat rilis awal Amazon EMR karena permintaan. Anda dapat menggunakan konsol, AWS CLI, atau API agar Amazon EMR menginstal aplikasi sandbox dengan cara yang sama seperti aplikasi asli, tetapi aplikasi sandbox memiliki dukungan dan dokumentasi terbatas. Aplikasi Sandbox menjadi aplikasi asli yang di-support penuh di Amazon EMR rilis versi 5.0.0 dan versi setelahnya. Berikut ini adalah aplikasi sandbox di versi rilis Amazon EMR 4.x: + Oozie + Presto + Sqoop + Zeppelin + ZooKeeper Saat Anda menginstal aplikasi sandbox, nama aplikasi dilambangkan dengan akhiran `-sandbox`. Misalnya, untuk menginstal versi kotak pasir*Presto*, gunakan`Presto-sandbox`. Instalasi mungkin memakan waktu lebih lama daripada aplikasi yang di-support penuh. Nomor versi yang tercantum untuk setiap aplikasi di bagian ini sesuai dengan versi komunitas aplikasi. ## Oozie (versi sandbox) Oozie tersedia sebagai aplikasi sandbox dimulai dengan Amazon EMR versi rilis 4.1.0. Contoh Oozie tidak diinstal secara default menggunakan versi sandbox. Untuk menginstal contoh, SSH ke simpul utama dan jalankan `install-oozie-examples`. **Informasi versi Oozie-Sandbox** | Label Rilis Amazon EMR | Versi Oozie-Sandbox | Komponen Dipasang Dengan Oozie-Sandbox | | --- | --- | --- | | emr-4.9.6 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.9.5 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.9.4 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.9.3 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.9.2 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.9.1 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.8.5 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.8.4 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.8.3 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.8.2 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.8.1 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.8.0 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.7.4 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.7.3 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.7.2 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.7.1 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.7.0 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.6.1 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.6.0 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.5.0 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.4.0 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.3.0 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.2.0 | 4.2.0 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | | emr-4.1.0 | 4.0.1 | emrfs, emr-ddb, emr-goodies, emr-kinesis, emr-s3-dist-cp, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, oozie-client, oozie-server | ## Presto (versi sandbox) Presto tersedia sebagai aplikasi sandbox dimulai dengan Amazon EMR versi rilis 4.1.0. **Informasi versi Presto-Sandbox** | Label Rilis Amazon EMR | Versi Presto-Sandbox | Komponen Dipasang Dengan Presto-Sandbox | | --- | --- | --- | | emr-4.9.6 | 0.157.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.9.5 | 0.157.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.9.4 | 0.157.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.9.3 | 0.157.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.9.2 | 0.157.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.9.1 | 0.157.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.8.5 | 0.157.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.8.4 | 0.157.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.8.3 | 0.157.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.8.2 | 0,152.3 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.8.1 | 0,151 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.8.0 | 0,151 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.7.4 | 0,148 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.7.3 | 0,148 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.7.2 | 0,148 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.7.1 | 0,147 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.7.0 | 0,147 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hcatalog-server, mysql-server, presto-coordinator, presto-worker | | emr-4.6.1 | 0,143 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hive-metastore-server, mysql-server, presto-coordinator, presto-worker | | emr-4.6.0 | 0,143 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hive-metastore-server, mysql-server, presto-coordinator, presto-worker | | emr-4.5.0 | 0,140 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hive-metastore-server, mysql-server, presto-coordinator, presto-worker | | emr-4.4.0 | 0,136 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hive-metastore-server, mysql-server, presto-coordinator, presto-worker | | emr-4.3.0 | 0,130 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hive-metastore-server, mysql-server, presto-coordinator, presto-worker | | emr-4.2.0 | 0,125 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hive-metastore-server, mysql-server, presto-coordinator, presto-worker | | emr-4.1.0 | 0,119 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, hive-client, hive-metastore-server, mysql-server, presto-coordinator, presto-worker | ## Sqoop (versi sandbox) Sqoop tersedia sebagai aplikasi sandbox dimulai dengan Amazon EMR versi rilis 4.4.0. **Informasi versi Sqoop-Sandbox** | Label Rilis Amazon EMR | Versi Sqoop-Sandbox | Komponen Dipasang Dengan Sqoop-Sandbox | | --- | --- | --- | | emr-4.9.6 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.9.5 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.9.4 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.9.3 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.9.2 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.9.1 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.8.5 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.8.4 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.8.3 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.8.2 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.8.1 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.8.0 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.7.4 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.7.3 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.7.2 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.7.1 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.7.0 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.6.1 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.6.0 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, mysql-server, sqoop-client | | emr-4.5.0 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, sqoop-client | | emr-4.4.0 | 1.4.6 | emrfs, emr-ddb, emr-goodies, hadoop-client, hadoop-mapred, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, sqoop-client | ## Zeppelin (versi sandbox) Zeppelin tersedia sebagai aplikasi sandbox dimulai dengan Amazon EMR versi rilis 4.1.0. **Informasi versi Zeppelin-Sandbox** | Label Rilis Amazon EMR | Versi Zeppelin-Sandbox | Komponen Dipasang Dengan Zeppelin-Sandbox | | --- | --- | --- | | emr-4.9.6 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.9.5 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.9.4 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.9.3 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.9.2 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.9.1 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.8.5 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.8.4 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.8.3 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.8.2 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.8.1 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.8.0 | 0.6.1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.7.4 | 0.5.6-incubating | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.7.3 | 0.5.6-incubating | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.7.2 | 0.5.6-incubating | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.7.1 | 0.5.6-incubating | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.7.0 | 0.5.6-incubating | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.6.1 | 0.5.6-incubating | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.6.0 | 0.5.6-incubating | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.5.0 | 0.5.6-incubating | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.4.0 | 0.5.6-incubating | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.3.0 | 0.5.5-incubating-amzn-1 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.2.0 | 0.5.5-incubating-amzn-0 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | | emr-4.1.0 | 0.6.0-incubating-SNAPSHOT | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, spark-client, spark-history-server, spark-on-yarn, spark-yarn-slave, zeppelin-server | ## ZooKeeper (versi kotak pasir) Zookeeper tersedia sebagai aplikasi sandbox dimulai dengan Amazon EMR rilis versi 4.6.0. **ZooKeeper-Informasi versi Sandbox** | Label Rilis Amazon EMR | ZooKeeper-Versi Kotak Pasir | Komponen Dipasang Dengan ZooKeeper -Sandbox | | --- | --- | --- | | emr-4.9.6 | 3.4.9 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.9.5 | 3.4.9 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.9.4 | 3.4.9 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.9.3 | 3.4.9 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.9.2 | 3.4.9 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.9.1 | 3.4.9 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.8.5 | 3.4.9 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.8.4 | 3.4.9 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.8.3 | 3.4.9 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.8.2 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.8.1 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.8.0 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.7.4 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.7.3 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.7.2 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.7.1 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.7.0 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-kms-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.6.1 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | | emr-4.6.0 | 3.4.8 | emrfs, emr-goodies, hadoop-client, hadoop-hdfs-datanode, hadoop-hdfs-library, hadoop-hdfs-namenode, hadoop-httpfs-server, hadoop-yarn-nodemanager, hadoop-yarn-resourcemanager, zookeeper-client, zookeeper-server | # Pertimbangan untuk menggunakan Hive di Amazon EMR 4.x Bagian ini mencakup perbedaan yang perlu dipertimbangkan saat menggunakan Hive versi 1.0.0 pada versi rilis Amazon EMR 4.x, dibandingkan dengan Hive 2.x pada versi rilis Amazon EMR 5.x. ## Transaksi ACID tidak di-support Hive pada versi rilis Amazon EMR 4.x tidak men-support transaksi ACID dengan data Hive yang disimpan di Amazon S3 saat menggunakan versi rilis 4.x. Jika Anda mencoba membuat tabel transaksional di Amazon S3, akan terjadi pengecualian. ## Membaca dan menulis ke tabel di Amazon S3 Hive pada versi rilis Amazon EMR 4.x dapat menulis langsung ke Amazon S3 tanpa menggunakan file sementara. Ini akan meningkatkan performa, tetapi konsekuensinya adalah Anda tidak dapat membaca dan menulis ke tabel yang sama di Amazon S3 dalam pernyataan Hive yang sama. Solusinya adalah membuat dan menggunakan tabel sementara di HDFS. Contoh berikut menunjukkan cara menggunakan beberapa pernyataan Hive untuk memperbarui tabel di Amazon S3. Pernyataan membuat tabel sementara dalam HDFS bernama `tmp` berdasarkan tabel di Amazon S3 bernama `my_s3_table`. Tabel di Amazon S3 kemudian diperbarui dengan konten tabel sementara. ``` CREATE TEMPORARY TABLE tmp LIKE my_s3_table; INSERT OVERWRITE TABLE tmp SELECT ....; INSERT OVERWRITE TABLE my_s3_table SELECT * FROM tmp; ``` ## Log4j vs. Log4j 2 Hive pada versi rilis Amazon EMR 4.x menggunakan Log4j. Dimulai dengan versi 5.0.0, Log4j 2 dijadikan default. Versi ini mungkin memerlukan konfigurasi logging yang berbeda. Lihat [Apache Log4j 2](http://logging.apache.org/log4j/2.x/) untuk detailnya. ## MapReduce adalah mesin eksekusi default Hive di Amazon EMR 4.x versi rilis MapReduce digunakan sebagai mesin eksekusi default. Dimulai dengan Amazon EMR versi 5.0.0, default-nya adalah Tez, yang memberikan peningkatan performa untuk sebagian besar alur kerja. ## Otorisasi Hive Hive pada versi rilis Amazon EMR 4.x mendukung [Otorisasi Hive](https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Authorization) untuk HDFS tetapi tidak untuk EMRFS dan Amazon S3. Kluster Amazon EMR berjalan dengan otorisasi yang dinonaktifkan secara default. ## Perilaku penggabungan file Hive dengan Amazon S3 Hive di versi rilis Amazon EMR 4.x menggabungkan file kecil di akhir tugas peta-saja jika `hive.merge.mapfiles` adalah `true`. Penggabungan dipicu hanya jika ukuran keluaran rata-rata tugas kurang dari pengaturan `hive.merge.smallfiles.avgsize`. Amazon EMR Hive memiliki perilaku yang persis sama jika path keluaran akhir ada dalam HDFS. Namun, jika path keluaran berada di Amazon S3, parameter `hive.merge.smallfiles.avgsize` akan diabaikan. Dalam situasi itu, tugas gabungan selalu dipicu jika `hive.merge.mapfiles` diatur ke `true`. # Pertimbangan untuk menggunakan Pig di Amazon EMR 4.x Pig versi 0.14.0 diinstal pada klaster yang dibuat menggunakan versi rilis Amazon EMR 4.x. Babi di-upgrade ke versi 0.16.0 di Amazon EMR 5.0.0. Perbedaan signifikan dibahas di bawah ini. ## Mesin eksekusi default yang berbeda Versi babi 0.14.0 di Amazon EMR 4.x versi rilis digunakan MapReduce sebagai mesin eksekusi default. Pig 0.16.0 dan kemudian menggunakan Apache Tez. Anda dapat secara eksplisit mengatur `exectype=mapreduce` klasifikasi `pig-properties` konfigurasi yang akan digunakan. MapReduce ## Fungsi yang ditentukan pengguna Dropped Pig () UDFs Kustom UDFs yang tersedia di Pig di Amazon EMR 4.x versi rilis dihapus dimulai dengan Pig 0.16.0. Sebagian besar UDFs memiliki fungsi setara yang dapat Anda gunakan sebagai gantinya. Tabel berikut mencantumkan fungsi yang dijatuhkan UDFs dan setara. Untuk informasi selengkapnya, lihat [Fungsi Built-in](https://pig.apache.org/docs/r0.16.0/func.html) di situs Apache Pig. | Membuang UDF | Fungsi padanan | | --- | --- | | FORMAT\$1DT(dtformat, date) | GetHour(tanggal), GetMinute (tanggal), GetMonth (tanggal), GetSecond (tanggal), GetWeek (tanggal), GetYear (tanggal), GetDay (tanggal) | | EXTRACT(string, pattern) | REGEX\$1EXTRACT\$1ALL(string, pattern) | | REPLACE(string, pattern, replacement) | REPLACE(string, pattern, replacement) | | DATE\$1TIME() | ToDate() | | DURATION(dt, dt2) | WeeksBetween(dt, dt2), YearsBetween (dt, dt2), (dt, dt2), SecondsBetween (dt, dt2), MonthsBetween (dt, dt2), MinutesBetween (dt, dt2) HoursBetween | | EXTRACT\$1DT(format, date) | GetHour(tanggal), GetMinute (tanggal), GetMonth (tanggal), GetSecond (tanggal), GetWeek (tanggal), GetYear (tanggal), GetDay (tanggal) | | OFFSET\$1DT(date, duration) | AddDuration(tanggal, durasi), SubtractDuration (tanggal, durasi) | | PERIOD(dt, dt2) | WeeksBetween(dt, dt2), YearsBetween (dt, dt2), (dt, dt2), SecondsBetween (dt, dt2), MonthsBetween (dt, dt2), MinutesBetween (dt, dt2) HoursBetween | | CAPITALIZE(string) | UCFIRST(string) | | CONCAT\$1WITH() | CONCAT() | | INDEX\$1OF() | INDEXOF() | | LAST\$1INDEX\$1OF() | LAST\$1INDEXOF() | | SPLIT\$1ON\$1REGEX() | STRSPLT() | | UNCAPITALIZE() | LCFIRST() | Berikut ini UDFs dijatuhkan tanpa setara: FORMAT (), LOCAL\$1DATE (), LOCAL\$1TIME (), CENTER (), LEFT\$1PAD (), REPEAT (), REPLACE\$1ONCE (), RIGHT\$1PAD (), STRIP\$1END (), STRIP\$1START (), SWAP\$1CASE (). ## Perintah Grunt yang dihentikan Beberapa perintah Grunt dihentikan dimulai dengan Pig 0.16.0. Tabel berikut mencantumkan perintah Grunt di Pig 0.14.0 dan perintah padanan dalam versi saat ini, jika berlaku. **Pig 0.14.0 dan padanan perintah Grunt saat ini** | Perintah Grunt Pig 0.14.0 | Perintah Grunt Pig di versi 0.16.0 dan setelahnya | | --- | --- | | kucing < non-hdfs-path >) | fs -cat < non-hdfs-path >; | | cd < non-hdfs-path >; | Tanpa padanan | | ls < non-hdfs-path >; | fs -ls < non-hdfs-path >; | | pindah < non-hdfs-path > < non-hdfs-path >; | fs -mv < non-hdfs-path > < >; non-hdfs-path | | salin < non-hdfs-path > < non-hdfs-path >; | fs -cp < non-hdfs-path > < non-hdfs-path >; | | copyToLocal < non-hdfs-path >; | fs - copyToLocal < non-hdfs-path >; | | copyFromLocal < non-hdfs-path >; | fs - copyFromLocal < non-hdfs-path >; | | mkdir < >; non-hdfs-path | fs -mkdir < >; non-hdfs-path | | rm < non-hdfs-path >; | fs -rm -r -skipTrash < >; non-hdfs-path | | rmf < non-hdfs-path >; | fs -rm -r -skipTrash < >; non-hdfs-path | ## Kemampuan yang dihapus untuk direktori home non-HDFS Pig 0.14.0 pada versi rilis Amazon EMR 4.x memiliki dua mekanisme untuk mengizinkan pengguna selain pengguna `hadoop`, yang tidak memiliki direktori home, untuk menjalankan skrip Pig. Mekanisme pertama adalah fallback otomatis yang mengatur direktori kerja awal ke direktori root jika direktori home tidak ada. Mekanisme kedua adalah properti `pig.initial.fs.name` yang mengizinkan Anda untuk mengubah direktori kerja awal. Mekanisme-mekanisme tersebut tidak tersedia mulai dari Amazon EMR versi 5.0.0, dan pengguna harus memiliki direktori home di HDFS. Ini tidak berlaku untuk pengguna `hadoop` karena direktori home disediakan saat peluncuran. Skrip dijalankan menggunakan default langkah jar Hadoop ke pengguna Hadoop kecuali pengguna lain secara eksplisit ditentukan menggunakan `command-runner.jar`. # Amazon EMR rilis 4.9.6 ## 4.9.6 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.9.6 | emr-4.9.5 | emr-4.9.4 | emr-4.9.3 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## 4.9.6 catatan rilis Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 4.9.6 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.17.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-9 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-9 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-9 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-9 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-9 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-9 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.3 | Klien baris perintah Spark. | | spark-history-server | 1.6.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 4.9.6 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-4.9.6** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.9.5 ## 4.9.5 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.9.5 | emr-4.9.4 | emr-4.9.3 | emr-4.9.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## 4.9.5 catatan rilis Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 4.9.5. Perubahan relatif dilakukan terhadap 4.9.4. Tanggal rilis awal: 29 Agustus 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + HBase + Rilis ini membahas potensi kelemahan keamanan. ## 4.9.5 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.17.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-9 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-9 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-9 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-9 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-9 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-9 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.3 | Klien baris perintah Spark. | | spark-history-server | 1.6.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 4.9.5 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.9.5** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.9.4 ## 4.9.4 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.9.4 | emr-4.9.3 | emr-4.9.2 | emr-4.9.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | | Hive | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## 4.9.4 catatan rilis Catatan rilis berikut mencakup informasi untuk rilis Amazon EMR 4.9.4. Perubahan relatif dilakukan terhadap 4.9.3. Tanggal rilis awal: 29 Maret 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Pembaruan kernel Amazon Linux dari default Amazon Linux AMI untuk Amazon EMR untuk mengatasi potensi kelemahan. ## 4.9.4 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.17.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-9 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-9 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-9 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-9 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-9 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-9 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.3 | Klien baris perintah Spark. | | spark-history-server | 1.6.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 4.9.4 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.9.4** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.9.3 ## 4.9.3 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.9.3 | emr-4.9.2 | emr-4.9.1 | emr-4.8.5 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-8 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-1 | | Hive | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-8 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## 4.9.3 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.9.3. Perubahan relatif dilakukan terhadap rilis Amazon EMR 4.9.2. Tanggal rilis awal: 22 Januari 2018 **Perubahan, penyempurnaan, dan masalah yang diselesaikan** + Pembaruan kernel Amazon Linux dari default Amazon Linux AMI untuk Amazon EMR untuk mengatasi kelemahan terkait dengan eksekusi spekulatif (CVE-2017-5715, CVE-2017-5753, dan CVE-2017-5754). Untuk informasi selengkapnya, lihat [https://aws.amazon.com/security/security-bulletins/AWS-2018-013/](https://aws.amazon.com/security/security-bulletins/AWS-2018-013/). ## 4.9.3 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.17.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-9 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-9 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-9 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-9 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-9 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-9 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.3 | Klien baris perintah Spark. | | spark-history-server | 1.6.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 4.9.3 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.9.3** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.9.2 ## 4.9.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.9.2 | emr-4.9.1 | emr-4.8.5 | emr-4.8.4 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-2 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | | Hive | 1.0.0-amzn-9 | 1.0.0-amzn-9 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## 4.9.2 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.9.2. Perubahan relatif dilakukan terhadap rilis Amazon EMR 4.9.1. Tanggal rilis: 13 Juli 2017 Perubahan kecil, perbaikan bug, dan berbagai peningkatan dibuat dalam rilis ini. ## 4.9.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.3.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.17.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-9 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-9 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-9 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-9 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-9 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-9 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.3 | Klien baris perintah Spark. | | spark-history-server | 1.6.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 4.9.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.9.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.9.1 ## 4.9.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.9.1 | emr-4.8.5 | emr-4.8.4 | emr-4.8.3 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 1.0.0-amzn-9 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | | Hadoop | 2.7.3-amzn-2 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | | Hive | 1.0.0-amzn-9 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0.157.1 | 0.157.1 | 0.157.1 | | Spark | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.3 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.9 | ## 4.9.1 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.9.1. Perubahan relatif dilakukan terhadap rilis Amazon EMR 4.8.4. Tanggal rilis: 10 April 2017 **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Backport [HIVE-9976](https://issues.apache.org/jira/browse/HIVE-9976) dan [HIVE-10106](https://issues.apache.org/jira/browse/HIVE-10106) + Memperbaiki masalah di YARN di mana sejumlah besar node (lebih dari 2.000) dan kontainer (lebih dari 5.000) akan menyebabkan out-of-memory kesalahan, misalnya:`"Exception in thread main java.lang.OutOfMemoryError"`. **Perubahan dan penyempurnaan** + Rilis Amazon EMR sekarang berbasis Amazon Linux 2017.03. Untuk informasi selengkapnya, lihat [https://aws.amazon.com/amazon-linux-ami/2017.03-release-notes/](https://aws.amazon.com/amazon-linux-ami/2017.03-release-notes/). + Menghapus Python 2.6 dari citra Amazon EMR base Linux. Anda dapat menginstal Python 2.6 secara manual jika diperlukan. ## 4.9.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.3.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.15.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-9 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-9 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-9 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-9 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-9 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-9 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.3 | Klien baris perintah Spark. | | spark-history-server | 1.6.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 4.9.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-4.9.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.8.5 ## 4.8.5 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.8.5 | emr-4.8.4 | emr-4.8.3 | emr-4.8.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-7 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-0 | | Hive | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-7 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0.157.1 | 0.157.1 | 0,152.3 | | Spark | 1.6.3 | 1.6.3 | 1.6.3 | 1.6.2 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.9 | 3.4.9 | 3.4.8 | ## 4.8.5 catatan rilis Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 4.8.5 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.14.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-8 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-8 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-8 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-8 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-8 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-8 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.3 | Klien baris perintah Spark. | | spark-history-server | 1.6.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 4.8.5 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.8.5** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.8.4 ## 4.8.4 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.8.4 | emr-4.8.3 | emr-4.8.2 | emr-4.8.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-1 | 2.7.3-amzn-0 | 2.7.2-amzn-4 | | Hive | 1.0.0-amzn-8 | 1.0.0-amzn-8 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0.157.1 | 0,152.3 | 0,151 | | Spark | 1.6.3 | 1.6.3 | 1.6.2 | 1.6.2 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.9 | 3.4.8 | 3.4.8 | ## 4.8.4 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.8.4. Perubahan relatif dilakukan terhadap rilis Amazon EMR 4.8.3. Tanggal rilis: 7 Februari 2017 Perubahan kecil, perbaikan bug, dan berbagai peningkatan dibuat dalam rilis ini. ## 4.8.4 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.14.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-8 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-8 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-8 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-8 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-8 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-8 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.54\$1 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.3 | Klien baris perintah Spark. | | spark-history-server | 1.6.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.25\$1 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 4.8.4 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.8.4** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.8.3 ## 4.8.3 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.8.3 | emr-4.8.2 | emr-4.8.1 | emr-4.8.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.2 | | HCatalog | 1.0.0-amzn-8 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | | Hadoop | 2.7.3-amzn-1 | 2.7.3-amzn-0 | 2.7.2-amzn-4 | 2.7.2-amzn-4 | | Hive | 1.0.0-amzn-8 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0.157.1 | 0,152.3 | 0,151 | 0,151 | | Spark | 1.6.3 | 1.6.2 | 1.6.2 | 1.6.2 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.4 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.6.1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.9 | 3.4.8 | 3.4.8 | 3.4.8 | ## 4.8.3 Catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.8.3. Perubahan relatif dilakukan terhadap rilis Amazon EMR 4.8.2. Tanggal rilis: 29 Desember 2016 **Upgrade** + Presto di-upgrade ke 0.157.1. Untuk informasi selengkapnya, lihat [Catatan Rilis Presto](https://prestodb.io/docs/current/release/release-0.157.1.html) di dokumentasi Presto. + Spark di-upgrade ke 1.6.3. Untuk informasi selengkapnya, lihat [Catatan Rilis Spark](http://spark.apache.org/releases/spark-release-1-6-3.html) di dokumentasi Apache Spark. + Upgrade ke ZooKeeper 3.4.9. Untuk informasi selengkapnya, lihat [Catatan ZooKeeper Rilis](https://zookeeper.apache.org/doc/r3.4.9/releasenotes.html) dalam ZooKeeper dokumentasi Apache. **Perubahan dan penyempurnaan** + Menambahkan dukungan untuk jenis instans Amazon EC2 m4.16xlarge di Amazon EMR versi 4.8.3 dan yang lebih baru, tidak termasuk 5.0.0, 5.0.3, dan 5.2.0. + Rilis Amazon EMR sekarang berbasis Amazon Linux 2016.09. Untuk informasi selengkapnya, lihat [https://aws.amazon.com/amazon-linux-ami/2016.09-release-notes/](https://aws.amazon.com/amazon-linux-ami/2016.09-release-notes/). **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah di Hadoop di mana ReplicationMonitor utas bisa macet untuk waktu yang lama karena perlombaan antara replikasi dan penghapusan file yang sama di cluster besar. + Memperbaiki masalah saat ControlledJob \$1toString gagal dengan pengecualian penunjuk nol (NPE) saat status pekerjaan tidak berhasil diperbarui. ## 4.8.3 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.2.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.13.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-1 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-8 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-8 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-8 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-8 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-8 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-8 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0.157.1 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0.157.1 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.3 | Klien baris perintah Spark. | | spark-history-server | 1.6.3 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.3 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.3 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.9 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.9 | ZooKeeper klien baris perintah. | ## 4.8.3 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.8.3** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.8.2 ## 4.8.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.8.2 | emr-4.8.1 | emr-4.8.0 | emr-4.7.4 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.2 | 1.2.1 | | HCatalog | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-6 | | Hadoop | 2.7.3-amzn-0 | 2.7.2-amzn-4 | 2.7.2-amzn-4 | 2.7.2-amzn-3 | | Hive | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-6 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,152.3 | 0,151 | 0,151 | 0,148 | | Spark | 1.6.2 | 1.6.2 | 1.6.2 | 1.6.2 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.4 | 0.8.3 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.6.1 | 0.5.6-incubating | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 4.8.2 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.8.2. Perubahan relatif dilakukan terhadap rilis Amazon EMR 4.8.0. Tanggal rilis: 24 Oktober 2016 **Upgrade** + Hadoop di-upgrade ke 2.7.3 + Presto di-upgrade ke 0.152.3, yang mencakup support untuk antarmuka web Presto. Anda dapat mengakses antarmuka web Presto pada koordinator Presto dengan menggunakan port 8889. Untuk informasi lebih lanjut tentang antarmuka web Presto, lihat [Antarmuka Web](https://prestodb.io/docs/current/admin/web-interface.html) dalam dokumentasi Presto. + Rilis Amazon EMR sekarang berbasis Amazon Linux 2016.09. Untuk informasi selengkapnya, lihat [https://aws.amazon.com/amazon-linux-ami/2016.09-release-notes/](https://aws.amazon.com/amazon-linux-ami/2016.09-release-notes/). ## 4.8.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 4.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.10.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.3-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.3-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.3-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.3-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.3-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.3-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.3-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.3-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.3-amzn-0 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-7 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-7 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-7 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-7 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-7 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-7 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.52 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,152.3 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,152.3 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.2 | Klien baris perintah Spark. | | spark-history-server | 1.6.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.8.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.8.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.8.1 ## 4.8.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.8.1 | emr-4.8.0 | emr-4.7.4 | emr-4.7.3 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.2 | 1.2.1 | 1.2.1 | | HCatalog | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | | Hadoop | 2.7.2-amzn-4 | 2.7.2-amzn-4 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | | Hive | 1.0.0-amzn-7 | 1.0.0-amzn-7 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,151 | 0,151 | 0,148 | 0,148 | | Spark | 1.6.2 | 1.6.2 | 1.6.2 | 1.6.2 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.4 | 0.8.3 | 0.8.3 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.6.1 | 0.5.6-incubating | 0.5.6-incubating | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 4.8.1 catatan rilis ## 4.8.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.9.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-7 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-7 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-7 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-7 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-7 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-7 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.51 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,151 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,151 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.2 | Klien baris perintah Spark. | | spark-history-server | 1.6.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.8.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-4.8.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.8.0 ## 4.8.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.8.0 | emr-4.7.4 | emr-4.7.3 | emr-4.7.2 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.2 | 1.2.1 | 1.2.1 | 1.2.1 | | HCatalog | 1.0.0-amzn-7 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | | Hadoop | 2.7.2-amzn-4 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | | Hive | 1.0.0-amzn-7 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.2 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,151 | 0,148 | 0,148 | 0,148 | | Spark | 1.6.2 | 1.6.2 | 1.6.2 | 1.6.2 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.4 | 0.8.3 | 0.8.3 | 0.8.3 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.6.1 | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 4.8.0 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.8.0. Perubahan relatif dilakukan terhadap rilis Amazon EMR 4.7.2. Tanggal rilis: 7 September 2016 **Upgrade** + Upgrade ke 1.2.2 HBase + Presto-Sandbox di-upgrade ke 0.151 + Tez di-upgrade ke 0.8.4 + Zeppelin-Sandbox di-upgrade ke 0.6.1 **Perubahan dan penyempurnaan** + Memperbaiki masalah di YARN di mana ApplicationMaster akan mencoba membersihkan wadah yang tidak ada lagi karena instance-nya telah dihentikan. + Memperbaiki URL hive-server2 untuk tindakan Hive2 dalam instans Oozie. + Menambahkan support untuk katalog Presto tambahan. + Melakukan backporting patch: [HIVE-8948](https://issues.apache.org/jira/browse/HIVE-8948), [HIVE-12679](https://issues.apache.org/jira/browse/HIVE-12679), [HIVE-13405](https://issues.apache.org/jira/browse/HIVE-13405), [PHOENIX-3116](https://issues.apache.org/jira/browse/PHOENIX-3116), [HADOOP-12689](https://issues.apache.org/jira/browse/HADOOP-12689) + Menambahkan support untuk konfigurasi keamanan, yang mengizinkan Anda membuat dan menerapkan opsi enkripsi dengan lebih mudah. Untuk informasi selengkapnya, lihat [Enkripsi Data](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-data-encryption.html). ## 4.8.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.9.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-4 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-4 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-4 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-4 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-4 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-4 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-4 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-4 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-4 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-4 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.2 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.2 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.2 | HBase klien baris perintah. | | hbase-rest-server | 1.2.2 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.2 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-7 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-7 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-7 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-7 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-7 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-7 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.51 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,151 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,151 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.2 | Klien baris perintah Spark. | | spark-history-server | 1.6.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.4 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.6.1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.8.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.8.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hiveserver2-site | Ubah nilai dalam file hiveserver2-site.xml Hive Server2 | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-blackhole | Ubah nilai dalam file blackhole.properties Presto. | | presto-connector-cassandra | Ubah nilai dalam file cassandra.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | presto-connector-jmx | Ubah nilai dalam file jmx.properties Presto. | | presto-connector-kafka | Ubah nilai dalam file kafka.properties Presto. | | presto-connector-localfile | Ubah nilai dalam file localfile.properties Presto. | | presto-connector-mongodb | Ubah nilai dalam file mongodb.properties Presto. | | presto-connector-mysql | Ubah nilai dalam file mysql.properties Presto. | | presto-connector-postgresql | Ubah nilai dalam file postgresql.properties Presto. | | presto-connector-raptor | Ubah nilai dalam file raptor.properties Presto. | | presto-connector-redis | Ubah nilai dalam file redis.properties Presto. | | presto-connector-tpch | Ubah nilai dalam file tpch.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.7.4 ## 4.7.4 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.7.4 | emr-4.7.3 | emr-4.7.2 | emr-4.7.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.1 | 1.2.1 | 1.2.1 | 1.2.1 | | HCatalog | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-5 | | Hadoop | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-2 | | Hive | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-5 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.2 | 0.12.0 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,148 | 0,148 | 0,148 | 0,147 | | Spark | 1.6.2 | 1.6.2 | 1.6.2 | 1.6.1 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.3 | 0.8.3 | 0.8.3 | 0.8.3 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 4.7.4 catatan rilis Ini adalah rilis patch untuk menambahkan otentikasi AWS Signature Version 4 untuk permintaan ke Amazon S3. Semua aplikasi dan komponen sama dengan rilis EMR Amazon sebelumnya. **penting** Dalam versi rilis ini, Amazon EMR menggunakan AWS Signature Version 4 secara eksklusif untuk mengautentikasi permintaan ke Amazon S3. Untuk informasi lebih lanjut, lihat [Yang Baru](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-whatsnew.html). ## 4.7.4 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.8.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.1 | HBase klien baris perintah. | | hbase-rest-server | 1.2.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-6 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-6 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-6 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-6 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-6 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-6 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.46 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,148 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,148 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.2 | Klien baris perintah Spark. | | spark-history-server | 1.6.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.3 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.5.6-incubating | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.7.4 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-4.7.4** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.7.3 ## 4.7.3 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.7.3 | emr-4.7.2 | emr-4.7.1 | emr-4.7.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.75 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.1 | 1.2.1 | 1.2.1 | 1.2.1 | | HCatalog | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-5 | 1.0.0-amzn-5 | | Hadoop | 2.7.2-amzn-3 | 2.7.2-amzn-3 | 2.7.2-amzn-2 | 2.7.2-amzn-2 | | Hive | 1.0.0-amzn-6 | 1.0.0-amzn-6 | 1.0.0-amzn-5 | 1.0.0-amzn-5 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.2 | 0.12.0 | 0.12.0 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,148 | 0,148 | 0,147 | 0,147 | | Spark | 1.6.2 | 1.6.2 | 1.6.1 | 1.6.1 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.3 | 0.8.3 | 0.8.3 | 0.8.3 | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 4.7.3 catatan rilis ## 4.7.3 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.8.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.1 | HBase klien baris perintah. | | hbase-rest-server | 1.2.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-6 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-6 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-6 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-6 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-6 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-6 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.46 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,148 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,148 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.2 | Klien baris perintah Spark. | | spark-history-server | 1.6.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.3 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.5.6-incubating | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.7.3 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-4.7.3** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.7.2 ## 4.7.2 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.7.2 | emr-4.7.1 | emr-4.7.0 | emr-4.6.1 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.75 | 1.10.27 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.1 | 1.2.1 | 1.2.1 | 1.2.0 | | HCatalog | 1.0.0-amzn-6 | 1.0.0-amzn-5 | 1.0.0-amzn-5 | 1.0.0-amzn-4 | | Hadoop | 2.7.2-amzn-3 | 2.7.2-amzn-2 | 2.7.2-amzn-2 | 2.7.2-amzn-1 | | Hive | 1.0.0-amzn-6 | 1.0.0-amzn-5 | 1.0.0-amzn-5 | 1.0.0-amzn-4 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-6 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.2 | 0.12.0 | 0.12.0 | 0.11.1 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,148 | 0,147 | 0,147 | 0,143 | | Spark | 1.6.2 | 1.6.1 | 1.6.1 | 1.6.1 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.3 | 0.8.3 | 0.8.3 | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 4.7.2 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR 4.7.2. Tanggal rilis: 15 Juli 2016 **Fitur** + Mahout di-upgrade ke 0.12.2 + Presto di-upgrade ke 0.148 + Spark di-upgrade ke 1.6.2 + Anda sekarang dapat membuat AWSCredentials Provider untuk digunakan dengan EMRFS menggunakan URI sebagai parameter. Untuk informasi selengkapnya, lihat [Membuat AWSCredentials Penyedia untuk EMRFS](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-plan-credentialsprovider.html). + EMRFS sekarang memungkinkan pengguna untuk mengonfigurasi titik akhir DynamoDB kustom untuk metadata Tampilan Konsisten mereka menggunakan properti `fs.s3.consistent.dynamodb.endpoint` di `emrfs-site.xml`. + Menambahkan skrip di `/usr/bin` yang disebut `spark-example`, yang membungkus `/usr/lib/spark/spark/bin/run-example` sehingga Anda dapat menjalankan contoh secara langsung. Misalnya, untuk menjalankan SparkPi contoh yang disertakan dengan distribusi Spark, Anda dapat menjalankan `spark-example SparkPi 100` dari baris perintah atau menggunakan `command-runner.jar` sebagai langkah di API. **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah di mana Oozie tidak menempatkan `spark-assembly.jar` di lokasi yang benar saat Spark juga diinstal, yang mengakibatkan terjadinya gagal peluncuran aplikasi Spark dengan Oozie. + Memperbaiki masalah dengan logging berbasis Spark Log4j di kontainer YARN. ## 4.7.2 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.2.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.1.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.8.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-3 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-3 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-3 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-3 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-3 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-3 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-3 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-3 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-3 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.1 | HBase klien baris perintah. | | hbase-rest-server | 1.2.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-6 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-6 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-6 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-6 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-6 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-6 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.2 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.46 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,148 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,148 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.2 | Klien baris perintah Spark. | | spark-history-server | 1.6.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.3 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.23 | Server HTTP Apache. | | zeppelin-server | 0.5.6-incubating | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.7.2 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.7.2** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hadoop-ssl-server | Ubah konfigurasi server ssl hadoop | | hadoop-ssl-client | Ubah konfigurasi klien ssl hadoop | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.7.1 ## 4.7.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.7.1 | emr-4.7.0 | emr-4.6.1 | emr-4.6.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.75 | 1.10.27 | 1.10.27 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.1 | 1.2.1 | 1.2.0 | 1.2.0 | | HCatalog | 1.0.0-amzn-5 | 1.0.0-amzn-5 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | | Hadoop | 2.7.2-amzn-2 | 2.7.2-amzn-2 | 2.7.2-amzn-1 | 2.7.2-amzn-1 | | Hive | 1.0.0-amzn-5 | 1.0.0-amzn-5 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-7 | 3.7.1-amzn-6 | 3.7.1-amzn-6 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.0 | 0.12.0 | 0.11.1 | 0.11.1 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | 4.7.0- -1.2 HBase | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,147 | 0,147 | 0,143 | 0,143 | | Spark | 1.6.1 | 1.6.1 | 1.6.1 | 1.6.1 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.3 | 0.8.3 | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | 3.4.8 | 3.4.8 | 3.4.8 | ## 4.7.1 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR 4.7.1. Tanggal rilis: 10 Juni 2016 **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah yang memperpanjang waktu startup klaster yang diluncurkan di VPC dengan subnet privat. Bug tersebut hanya memengaruhi klaster yang diluncurkan dengan rilis Amazon EMR 4.7.0. + Memperbaiki masalah yang menangani daftar file dengan tidak benar di Amazon EMR untuk klaster yang diluncurkan dengan rilis Amazon EMR 4.7.0. ## 4.7.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.7.1 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.1 | HBase klien baris perintah. | | hbase-rest-server | 1.2.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-5 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-5 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-5 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-5 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-5 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-5 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.46 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,147 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,147 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.1 | Klien baris perintah Spark. | | spark-history-server | 1.6.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.3 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.18 | Server HTTP Apache. | | zeppelin-server | 0.5.6-incubating | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.7.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.7.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.7.0 ## 4.7.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [https://phoenix.apache.org/](https://phoenix.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://tez.apache.org/](https://tez.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.7.0 | emr-4.6.1 | emr-4.6.0 | emr-4.5.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.75 | 1.10.27 | 1.10.27 | 1.10.27 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.1 | 1.2.0 | 1.2.0 | - | | HCatalog | 1.0.0-amzn-5 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | | Hadoop | 2.7.2-amzn-2 | 2.7.2-amzn-1 | 2.7.2-amzn-1 | 2.7.2-amzn-0 | | Hive | 1.0.0-amzn-5 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-7 | 3.7.1-amzn-6 | 3.7.1-amzn-6 | 3.7.1-amzn-5 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.12.0 | 0.11.1 | 0.11.1 | 0.11.1 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | 4.7.0- -1.2 HBase | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,147 | 0,143 | 0,143 | 0,140 | | Spark | 1.6.1 | 1.6.1 | 1.6.1 | 1.6.1 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | 0.8.3 | - | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | 3.4.8 | 3.4.8 | - | ## Catatan rilis 4.7.0 **penting** Amazon EMR 4.7.0 tidak lagi digunakan. Gunakan Amazon EMR 4.7.1 atau versi setelahnya sebagai gantinya. Tanggal rilis: 2 Juni 2016 **Fitur** + Menambahkan Apache Phoenix 4.7.0 + Menambahkan Apache Tez 0.8.3 + Upgrade ke 1.2.1 HBase + Meng-upgraded Mahout ke versi 0.12.0 + meng-upgrade Presto ke versi 0.147 + Upgrade ke AWS SDK untuk Java 1.10.75 + Flag terakhir telah dihapus dari properti `mapreduce.cluster.local.dir` di `mapred-site.xml` untuk memungkinkan pengguna menjalankan Pig dalam mode lokal. + Driver Amazon Redshift JDBC Tersedai di Klaster Driver Amazon Redshift JDBC sekarang disertakan di `/usr/share/aws/redshift/jdbc`. `/usr/share/aws/redshift/jdbc/RedshiftJDBC41.jar` adalah driver Amazon Redshift yang kompatibel dengan JDBC 4.1 dan `/usr/share/aws/redshift/jdbc/RedshiftJDBC4.jar` driver Amazon Redshift yang kompatibel dengan JDBC 4.0. Untuk informasi selengkapnya, lihat [Mengonfigurasi Koneksi JDBC](https://docs.aws.amazon.com/redshift/latest/mgmt/configure-jdbc-connection.html) di Panduan Manajemen *Amazon Redshift*. + Java 8 Kecuali untuk Presto, OpenJDK 1.7 adalah JDK default yang digunakan untuk semua aplikasi. Namun, OpenJDK 1.7 dan 1.8 semuanya diinstal. Untuk informasi tentang cara mengatur `JAVA_HOME` untuk aplikasi, lihat [Mengonfigurasi Aplikasi untuk Menggunakan Java 8](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps.html#configuring-java8). **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah kernel yang secara signifikan memengaruhi performa pada volume EBS Throughput Optimized HDD (st1) untuk Amazon EMR di emr-4.6.0. + Memperbaiki masalah di mana klaster akan gagal jika ada zona enkripsi HDFS yang ditentukan tanpa memilih Hadoop sebagai aplikasi. + Mengubah kebijakan tulis HDFS default dari `RoundRobin` menjadi `AvailableSpaceVolumeChoosingPolicy`. Beberapa volume tidak digunakan dengan benar dengan RoundRobin konfigurasi, yang mengakibatkan node inti gagal dan HDFS yang tidak dapat diandalkan. + Memperbaiki masalah dengan EMRFS CLI, yang akan menyebabkan pengecualian saat membuat tabel metadata DynamoDB default untuk tampilan yang konsisten. + Memperbaiki masalah kebuntuan di EMRFS yang berpotensi terjadi selama operasi penggantian nama dan penyalinan multi-bagian. + Memperbaiki masalah dengan EMRFS yang menyebabkan CopyPart ukuran default menjadi 5 MB. Default-nya sekarang diatur pada 128 MB. + Memperbaiki masalah dengan konfigurasi pemula Zeppelin yang berpotensi mencegah Anda menghentikan layanan. + Memperbaiki masalah dengan Spark dan Zeppelin, yang mencegah Anda menggunakan skema URI `s3a://` karena `/usr/lib/hadoop/hadoop-aws.jar` tidak dimuat dengan benar di classpath masing-masing. + Melakukan backport [HUE-2484](https://issues.cloudera.org/browse/HUE-2484). + Mem-backport [komit](https://github.com/cloudera/hue/commit/c3c89f085e7a29c9fac7de016d881142d90af3eb) dari Hue 3.9.0 (tidak ada JIRA) untuk memperbaiki masalah dengan sampel browser. HBase + Melakukan backport [HIVE-9073](https://issues.apache.org/jira/browse/HIVE-9073). ## 4.7.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.1.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.2.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.4.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.7.1 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hadoop-yarn-timeline-server | 2.7.2-amzn-2 | Layanan untuk mengambil informasi terkini dan historis untuk aplikasi YARN. | | hbase-hmaster | 1.2.1 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.1 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.1 | HBase klien baris perintah. | | hbase-rest-server | 1.2.1 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.1 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-5 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-5 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-5 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-5 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-5 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-5 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-7 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.12.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5.46 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | phoenix-library | 4.7.0- -1.2 HBase | Perpustakaan phoenix untuk server dan klien | | phoenix-query-server | 4.7.0- -1.2 HBase | Sebuah server ringan yang menyediakan akses JDBC serta Protocol Buffers dan akses format JSON ke API Avatica | | presto-coordinator | 0,147 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,147 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.1 | Klien baris perintah Spark. | | spark-history-server | 1.6.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | tez-on-yarn | 0.8.3 | Aplikasi dan perpustakaan tez YARN. | | webserver | 2.4.18 | Server HTTP Apache. | | zeppelin-server | 0.5.6-incubating | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.7.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.7.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | phoenix-hbase-metrics | Ubah nilai dalam file hadoop-metrics2-hbase.properties Phoenix. | | phoenix-hbase-site | Ubah nilai dalam file hbase-site.xml Phoenix. | | phoenix-log4j | Ubah nilai dalam file log4j.properties Phoenix. | | phoenix-metrics | Ubah nilai dalam file hadoop-metrics2-phoenix.properties Phoenix. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | tez-site | Ubah nilai dalam file tez-site.xml Tez. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.6.1 ## 4.6.1 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.6.1 | emr-4.6.0 | emr-4.5.0 | emr-4.4.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.27 | 1.10.27 | 1.10.27 | 1.10.27 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.0 | 1.2.0 | - | - | | HCatalog | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-3 | | Hadoop | 2.7.2-amzn-1 | 2.7.2-amzn-1 | 2.7.2-amzn-0 | 2.7.1-amzn-1 | | Hive | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-3 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-6 | 3.7.1-amzn-6 | 3.7.1-amzn-5 | 3.7.1-amzn-5 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.1 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | - | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,143 | 0,143 | 0,140 | 0,136 | | Spark | 1.6.1 | 1.6.1 | 1.6.1 | 1.6.0 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | 1.4.6 | | TensorFlow | - | - | - | - | | Tez | - | - | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | 3.4.8 | - | - | ## 4.6.1 catatan rilis ## 4.6.1 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.1.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.3.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.6.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hbase-hmaster | 1.2.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.0 | HBase klien baris perintah. | | hbase-rest-server | 1.2.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-4 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-4 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-4 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-4 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-4 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-4 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-6 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.11.1 | Perpustakaan untuk machine learning. | | mysql-server | 5.5 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | presto-coordinator | 0,143 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,143 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.1 | Klien baris perintah Spark. | | spark-history-server | 1.6.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | webserver | 2.4 | Server HTTP Apache. | | zeppelin-server | 0.5.6-incubating | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.6.1 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **klasifikasi emr-4.6.1** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.6.0 ## 4.6.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hbase.apache.org/](http://hbase.apache.org/), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/), dan [https://zookeeper.apache.org](https://zookeeper.apache.org). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.6.0 | emr-4.5.0 | emr-4.4.0 | emr-4.3.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.27 | 1.10.27 | 1.10.27 | 1.10.27 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.7.2 | | HBase | 1.2.0 | - | - | - | | HCatalog | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-3 | - | | Hadoop | 2.7.2-amzn-1 | 2.7.2-amzn-0 | 2.7.1-amzn-1 | 2.7.1-amzn-0 | | Hive | 1.0.0-amzn-4 | 1.0.0-amzn-4 | 1.0.0-amzn-3 | 1.0.0-amzn-2 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-6 | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-5 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.11.1 | 0.11.1 | 0.11.1 | 0.11.0 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | - | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,143 | 0,140 | 0,136 | 0,130 | | Spark | 1.6.1 | 1.6.1 | 1.6.0 | 1.6.0 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | 1.4.6 | - | | TensorFlow | - | - | - | - | | Tez | - | - | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.6-incubating | 0.5.6-incubating | 0.5.6-incubating | 0.5.5-incubating-amzn-1 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | 3.4.8 | - | - | - | ## 4.6.0 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.6.0. + Ditambahkan HBase 1.2.0 + Menambahkan Zookeeper-Sandbox 3.4.8 + Meng-upgraded Presto-Sandbox ke versi 0.143 + Rilis Amazon EMR sekarang berbasis Amazon Linux 2016.03.0. Untuk informasi selengkapnya, lihat [https://aws.amazon.com/amazon-linux-ami/2016.03-release-notes/](https://aws.amazon.com/amazon-linux-ami/2016.03-release-notes/). + Masalah yang Mempengaruhi Throughput Optimized HDD (st1) TIpe Volume EBS Masalah pada kernel Linux versi 4.2 dan di atasnya secara signifikan memengaruhi performa pada volume Throughput Optimized HDD (st1) EBS untuk EMR. Rilis ini (emr-4.6.0) menggunakan kernel versi 4.4.5 dan karenanya terpengaruh. Oleh karena itu, kami menyarankan untuk tidak menggunakan emr-4.6.0 jika Anda ingin menggunakan volume st1 EBS. Anda dapat menggunakan emr-4.5.0 atau rilis Amazon EMR sebelumnya dengan st1 tanpa dampak. Selain itu, kami menyediakan perbaikan dengan rilis yang akan datang. + Python Default Python 3.4 sekarang diinstal secara default, tetapi Python 2.7 tetap menjadi default sistem. Anda dapat mengonfigurasi Python 3.4 sebagai default sistem menggunakan tindakan bootstrap; Anda dapat menggunakan API konfigurasi untuk mengatur ekspor PYSPARK\$1PYTHON ke dalam klasifikasi `spark-env` untuk memengaruhi versi Python `/usr/bin/python3.4` yang digunakan oleh. PySpark + Java 8 Kecuali untuk Presto, OpenJDK 1.7 adalah JDK default yang digunakan untuk semua aplikasi. Namun, OpenJDK 1.7 dan 1.8 semuanya diinstal. Untuk informasi tentang cara mengatur `JAVA_HOME` untuk aplikasi, lihat [Mengonfigurasi Aplikasi untuk Menggunakan Java 8](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps.html#configuring-java8). **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah ketika penyediaan aplikasi terkadang gagal secara acak karena kata sandi yang dibuat. + Sebelumnya, `mysqld` diinstal pada semua simpul. Sekarang, itu hanya diinstal pada instans utama dan hanya jika aplikasi yang dipilih menyertakan `mysql-server` sebagai komponen. Saat ini, aplikasi berikut meliputi `mysql-server` komponen:, Hive, Hue HCatalog, Presto-Sandbox, dan Sqoop-Sandbox. + Mengubah `yarn.scheduler.maximum-allocation-vcores` ke 80 dari default 32, yang memperbaiki masalah yang diperkenalkan di emr-4.4.0 yang terutama terjadi dengan Spark saat menggunakan opsi `maximizeResourceAllocation` di klaster yang tipe instans intinya adalah salah satu dari beberapa tipe instans besar yang mengatur YARN vcores lebih dari 32; yaitu c4.8xlarge, cc2.8xlarge, hs1.8xlarge, i2.8xlarge, m2.4xlarge, r3.8xlarge, d2.8xlarge, atau m4.10xlarge terpengaruh oleh masalah ini. + s3-dist-cp sekarang menggunakan EMRFS untuk semua nominasi Amazon S3 dan tidak lagi bertahap ke direktori HDFS sementara. + Memperbaiki masalah dengan penanganan pengecualian untuk unggahan multi-part enkripsi di sisi klien. + Menambahkan opsi untuk mengizinkan pengguna mengubah kelas penyimpanan Amazon S3. Secara default pengaturan ini adalah `STANDARD`. Pengaturan klasifikasi konfigurasi `emrfs-site` adalah `fs.s3.storageClass` dan nilai yang mungkin adalah `STANDARD`, `STANDARD_IA`, dan `REDUCED_REDUNDANCY`. Untuk informasi selengkapnya tentang kelas [penyimpanan, lihat Kelas Penyimpanan](https://docs.aws.amazon.com/AmazonS3/latest/userguide/storage-class-intro.html) di *Panduan Pengguna Layanan Penyimpanan Sederhana Amazon*. ## 4.6.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.1.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.3.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.6.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hbase-hmaster | 1.2.0 | Layanan untuk HBase cluster yang bertanggung jawab untuk koordinasi Daerah dan pelaksanaan perintah administratif. | | hbase-region-server | 1.2.0 | Layanan untuk melayani satu atau lebih HBase wilayah. | | hbase-client | 1.2.0 | HBase klien baris perintah. | | hbase-rest-server | 1.2.0 | Layanan menyediakan titik akhir RESTful HTTP untuk HBase. | | hbase-thrift-server | 1.2.0 | Layanan menyediakan titik akhir Thrift ke. HBase | | hcatalog-client | 1.0.0-amzn-4 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-4 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-4 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-4 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-4 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-4 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-6 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.11.1 | Perpustakaan untuk machine learning. | | mysql-server | 5.5 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | presto-coordinator | 0,143 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,143 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.1 | Klien baris perintah Spark. | | spark-history-server | 1.6.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | webserver | 2.4 | Server HTTP Apache. | | zeppelin-server | 0.5.6-incubating | Notebook berbasis web yang memungkinkan analisis data interaktif. | | zookeeper-server | 3.4.8 | Layanan terpusat untuk menjaga informasi konfigurasi, penamaan, yang menyediakan sinkronisasi terdistribusi, dan menyediakan layanan grup. | | zookeeper-client | 3.4.8 | ZooKeeper klien baris perintah. | ## 4.6.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.6.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hbase-env | Ubah nilai HBase di lingkungan. | | hbase-log4j | Ubah nilai dalam file HBase hbase-log4j.properties. | | hbase-metrics | Ubah nilai dalam file HBase hadoop-metrics2-hbaase.properties. | | hbase-policy | Ubah nilai dalam HBase file hbase-policy.xml. | | hbase-site | Ubah nilai dalam HBase file hbase-site.xml. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | | zookeeper-config | Ubah nilai dalam ZooKeeper file zoo.cfg. | | zookeeper-log4j | Ubah nilai dalam file ZooKeeper log4j.properties. | # Amazon EMR rilis 4.5.0 ## 4.5.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/),, [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), dan [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.5.0 | emr-4.4.0 | emr-4.3.0 | emr-4.2.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.27 | 1.10.27 | 1.10.27 | 1.10.27 | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.7.2 | 3.6.0 | | HBase | - | - | - | - | | HCatalog | 1.0.0-amzn-4 | 1.0.0-amzn-3 | - | - | | Hadoop | 2.7.2-amzn-0 | 2.7.1-amzn-1 | 2.7.1-amzn-0 | 2.6.0-amzn-2 | | Hive | 1.0.0-amzn-4 | 1.0.0-amzn-3 | 1.0.0-amzn-2 | 1.0.0-amzn-1 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-5 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.11.1 | 0.11.1 | 0.11.0 | 0.11.0 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.2.0 | | Phoenix | - | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,140 | 0,136 | 0,130 | 0,125 | | Spark | 1.6.1 | 1.6.0 | 1.6.0 | 1.5.2 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | 1.4.6 | - | - | | TensorFlow | - | - | - | - | | Tez | - | - | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.6-incubating | 0.5.6-incubating | 0.5.5-incubating-amzn-1 | 0.5.5-incubating-amzn-0 | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | - | - | - | - | ## 4.5.0 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.5.0. Tanggal rilis: 4 April 2016 **Fitur** + Meng-upgrade Spark ke versi 1.6.1 + Meng-upgrade Hadoop ke versi 2.7.2 + Meng-upgrade Presto ke versi 0.140 + Menambahkan AWS KMS dukungan untuk enkripsi sisi server Amazon S3. **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah ketika server MySQL dan Apache tidak dapat dimulai setelah simpul di-boot ulang. + Memperbaiki masalah di mana IMPORT tidak berfungsi dengan benar dengan tabel yang tidak dipartisi yang disimpan di Amazon S3 + Memperbaiki masalah Presto yang mengharuskan direktori penahapan menjadi `/mnt/tmp` alih-alih `/tmp` saat menulis ke tabel Hive. ## 4.5.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.1.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.2.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.5.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.2-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.2-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.2-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.2-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.2-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.2-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.2-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.2-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.2-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hcatalog-client | 1.0.0-amzn-4 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-4 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-4 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-4 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-4 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-4 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-5 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.11.1 | Perpustakaan untuk machine learning. | | mysql-server | 5.5 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | presto-coordinator | 0,140 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,140 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.1 | Klien baris perintah Spark. | | spark-history-server | 1.6.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | webserver | 2.4 | Server HTTP Apache. | | zeppelin-server | 0.5.6-incubating | Notebook berbasis web yang memungkinkan analisis data interaktif. | ## 4.5.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.5.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | # Amazon EMR rilis 4.4.0 ## 4.4.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [https://cwiki.apache.org/confluence/display/Hive/HCatalog](https://cwiki.apache.org/confluence/display/Hive/HCatalog), [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), [http://sqoop.apache.org/](http://sqoop.apache.org/), dan [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.4.0 | emr-4.3.0 | emr-4.2.0 | emr-4.1.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.27 | 1.10.27 | 1.10.27 | Tidak dilacak | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.7.2 | 3.6.0 | - | | HBase | - | - | - | - | | HCatalog | 1.0.0-amzn-3 | - | - | - | | Hadoop | 2.7.1-amzn-1 | 2.7.1-amzn-0 | 2.6.0-amzn-2 | 2.6.0-amzn-1 | | Hive | 1.0.0-amzn-3 | 1.0.0-amzn-2 | 1.0.0-amzn-1 | 1.0.0-amzn-1 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-4 | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.11.1 | 0.11.0 | 0.11.0 | 0.11.0 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.2.0 | 4.0.1 | | Phoenix | - | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,136 | 0,130 | 0,125 | 0,119 | | Spark | 1.6.0 | 1.6.0 | 1.5.2 | 1.5.0 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | 1.4.6 | - | - | - | | TensorFlow | - | - | - | - | | Tez | - | - | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.6-incubating | 0.5.5-incubating-amzn-1 | 0.5.5-incubating-amzn-0 | 0.6.0-incubating-SNAPSHOT | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | - | - | - | - | ## 4.4.0 catatan rilis Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.4.0. Tanggal rilis: 14 Maret 2016 **Fitur** + Ditambahkan HCatalog 1.0.0 + Menambahkan Sqoop-Sandbox versi 1.4.6 + Meng-upgrade Presto ke versi 0.136 + Meng-upgrade Zeppelin ke versi 0.5.6 + Meng-upgraded Mahout ke versi 0.11.1 + Mengaktifkan `dynamicResourceAllocation` secara default. + Menambahkan tabel semua klasifikasi konfigurasi untuk rilis. Untuk informasi selengkapnya, lihat tabel Klasifikasi Konfigurasi di [Mengonfigurasi Aplikasi](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps.html). **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah di mana `maximizeResourceAllocation` pengaturan tidak akan menyimpan cukup memori untuk ApplicationMaster daemon YARN. + Memperbaiki masalah yang dihadapi dengan DNS kustom. Jika ada entri di `resolve.conf` sebelum entri kustom yang disediakan, maka entri kustom tidak akan dapat diselesaikan. Perilaku ini dipengaruhi oleh kluster di VPC tempat server nama VPC default dimasukkan sebagai entri teratas di `resolve.conf`. + Memperbaiki masalah saat Python default dipindahkan ke versi 2.7 dan boto tidak diinstal untuk versi tersebut. + Memperbaiki masalah ketika kontainer YARN dan aplikasi Spark akan menghasilkan file basis data round robin (rrd) Ganglia yang unik, yang mengakibatkan disk pertama yang terpasang pada instans terisi. Karena perbaikan ini, metrik tingkat kontainer YARN telah dinonaktifkan dan metrik tingkat aplikasi Spark telah dinonaktifkan. + Memperbaiki masalah di log pusher di mana ia akan menghapus semua folder log kosong. Efeknya adalah Hive CLI tidak dapat melakukan log karena log pusher menghapus folder `user` kosong di bawah `/var/log/hive`. + Memperbaiki masalah yang memengaruhi impor Hive, yang memengaruhi partisi dan mengakibatkan kesalahan selama melakukan impor. + Memperbaiki masalah di mana EMRFS dan s3-dist-cp tidak menangani nama bucket yang berisi titik dengan benar. + Mengubah perilaku di EMRFS sehingga dalam bucket yang mengaktifkan-versioning, file penanda `_$folder$` tidak terus-menerus dibuat, yang dapat berkontribusi pada peningkatan performa untuk bucket yang mengaktifkan-versioning. + Mengubah perilaku di EMRFS sehingga tidak menggunakan file instruksi kecuali untuk kasus di mana enkripsi di sisi klien diaktifkan. Jika Anda ingin menghapus file instruksi saat menggunakan enkripsi di sisi klien, Anda dapat mengatur properti emrfs-site.xml, `fs.s3.cse.cryptoStorageMode.deleteInstructionFiles.enabled`, menjadi BETUL. + Mengubah agregasi log YARN untuk mempertahankan log di tujuan agregasi selama dua hari. Tujuan default-nya adalah penyimpanan HDFS klaster Anda. Jika Anda ingin mengubah durasi ini, ubah nilai menggunakan `yarn.log-aggregation.retain-seconds` klasifikasi konfigurasi `yarn-site` saat Anda membuat klaster. Seperti biasa, Anda dapat menyimpan log aplikasi ke Amazon S3 dengan menggunakan parameter `log-uri` saat Anda membuat klaster. **Patch Diterapkan** + [SARANG 9655](https://issues.apache.org/jira/browse/HIVE-9655) + [SARANG 9183](https://issues.apache.org/jira/browse/HIVE-9183) + [HADOOP-12810](https://issues.apache.org/jira/browse/HADOOP-12810) ## 4.4.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.1.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.2.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.4.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.1-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.1-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.1-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.1-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.1-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.1-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.1-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.1-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.1-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hcatalog-client | 1.0.0-amzn-3 | Klien baris perintah 'hcat' untuk memanipulasi hcatalog-server. | | hcatalog-server | 1.0.0-amzn-3 | Penyediaan layanan HCatalog, tabel dan lapisan manajemen penyimpanan untuk aplikasi terdistribusi. | | hcatalog-webhcat-server | 1.0.0-amzn-3 | Titik akhir HTTP menyediakan antarmuka REST ke HCatalog. | | hive-client | 1.0.0-amzn-3 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-3 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-3 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-5 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.11.1 | Perpustakaan untuk machine learning. | | mysql-server | 5.5 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | presto-coordinator | 0,136 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,136 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.0 | Klien baris perintah Spark. | | spark-history-server | 1.6.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | sqoop-client | 1.4.6 | Klien baris perintah Apache Sqoop. | | webserver | 2.4 | Server HTTP Apache. | | zeppelin-server | 0.5.6-incubating | Notebook berbasis web yang memungkinkan analisis data interaktif. | ## 4.4.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.4.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hcatalog-env | Ubah nilai HCatalog di lingkungan. | | hcatalog-server-jndi | Ubah nilai di HCatalog jndi.properties. | | hcatalog-server-proto-hive-site | Ubah nilai HCatalog proto-hive-site dalam.xml's. | | hcatalog-webhcat-env | Ubah nilai di lingkungan HCatalog WebHCat. | | hcatalog-webhcat-log4j | Ubah nilai di HCat log4j.properties HCatalog Web. | | hcatalog-webhcat-site | Ubah nilai dalam file webhcat-site.xml HCatalog WebHCat. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | sqoop-env | Ubah nilai dalam lingkungan Sqoop. | | sqoop-oraoop-site | Ubah nilai dalam file oraoop-site.xml Sqoop OraOop ini. | | sqoop-site | Ubah nilai dalam file sqoop-site.xml Sqoop. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | # Amazon EMR rilis 4.3.0 ## 4.3.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), dan [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.3.0 | emr-4.2.0 | emr-4.1.0 | emr-4.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.27 | 1.10.27 | Tidak dilacak | Tidak dilacak | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.6.0 | - | - | | HBase | - | - | - | - | | HCatalog | - | - | - | - | | Hadoop | 2.7.1-amzn-0 | 2.6.0-amzn-2 | 2.6.0-amzn-1 | 2.6.0-amzn-0 | | Hive | 1.0.0-amzn-2 | 1.0.0-amzn-1 | 1.0.0-amzn-1 | 1.0.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-4 | - | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.11.0 | 0.11.0 | 0.11.0 | 0.10.0 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.0.1 | - | | Phoenix | - | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,130 | 0,125 | 0,119 | - | | Spark | 1.6.0 | 1.5.2 | 1.5.0 | 1.4.1 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | - | - | - | - | | TensorFlow | - | - | - | - | | Tez | - | - | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.5-incubating-amzn-1 | 0.5.5-incubating-amzn-0 | 0.6.0-incubating-SNAPSHOT | - | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | - | - | - | - | ## Catatan rilis 4.3.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.3.0. Tanggal rilis: 19 Januari 2016 **Fitur** + Meng-upgrade Hadoop ke versi 2.7.1 + Meng-upgrade Spark ke versi 1.6.0 + Meng-upgrade Ganglia ke versi 3.7.2 + Meng-upgrade Presto ke versi 0.130 + Amazon EMR membuat beberapa perubahan pada `spark.dynamicAllocation.enabled` saat diatur ke BETUL; secara default SALAH. Jika diatur ke BETUL, hal ini akan memengaruhi default yang diatur oleh pengaturan `maximizeResourceAllocation`: + Jika `spark.dynamicAllocation.enabled` diatur ke BETUL, `spark.executor.instances` tidak diatur oleh `maximizeResourceAllocation`. + Pengaturan `spark.driver.memory` sekarang dikonfigurasi berdasarkan tipe instans di klaster dengan cara yang mirip dengan cara pengaturan `spark.executors.memory`. Namun, karena aplikasi driver Spark dapat berjalan pada instans utama atau salah satu instans inti (misalnya, dalam mode klien YARN dan klaster), pengaturan `spark.driver.memory` diatur berdasarkan tipe instans dari tipe instans yang lebih kecil di antara dua grup instans tersebut. + Pengaturan `spark.default.parallelism` sekarang diatur menjadi dua kali jumlah inti CPU yang tersedia untuk kontainer YARN. Dalam rilis sebelumnya, pengaturannya setengah dari nilai itu. + Perhitungan untuk overhead memori yang dicadangkan untuk proses Spark YARN disesuaikan agar lebih akurat, sehingga akan menghasilkan sedikit peningkatan jumlah total memori yang tersedia untuk Spark (yaitu, `spark.executor.memory`). **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Agregasi log YARN sekarang diaktifkan secara default. + Memperbaiki masalah di mana log tidak akan didorong ke bucket log Amazon S3 untuk klaster saat agregasi log YARN diaktifkan. + Ukuran kontainer YARN sekarang memiliki ukuran minimum baru, yakni 32 di semua tipe simpul. + Memperbaiki masalah dengan Ganglia yang menyebabkan disk berlebihan I/O pada node utama dalam cluster besar. + Memperbaiki masalah yang mencegah log aplikasi didorong ke Amazon S3 saat klaster dimatikan. + Memperbaiki masalah di EMRFS CLI yang menyebabkan perintah tertentu gagal. + Memperbaiki masalah dengan Zeppelin yang mencegah dependensi dimuat di dasar. SparkContext + Memperbaiki masalah yang diakibatkan oleh pengubahan ukuran yang mencoba menambahkan instans. + Memperbaiki masalah di Hive di mana CREATE TABLE AS SELECT membuat panggilan daftar yang berlebihan ke Amazon S3. + Memperbaiki masalah ketika klaster besar tidak tersedia dengan benar saat Hue, Oozie, dan Ganglia diinstal. + Memperbaiki masalah di s3-dist-cp yang akan menghasilkan kode keluar nol meskipun gagal dengan kesalahan. ## 4.3.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.1.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.1.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.3.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.7.2 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.7.2 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.7.1 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.7.1-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.7.1-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.7.1-amzn-0 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.7.1-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.7.1-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.7.1-amzn-0 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.7.1-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.7.1-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.7.1-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hive-client | 1.0.0-amzn-2 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-2 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-2 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-5 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.11.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | presto-coordinator | 0,130 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,130 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.6.0 | Klien baris perintah Spark. | | spark-history-server | 1.6.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.6.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.6.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | webserver | 2.4 | Server HTTP Apache. | | zeppelin-server | 0.5.5-incubating-amzn-1 | Notebook berbasis web yang memungkinkan analisis data interaktif. | ## 4.3.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.3.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | # Amazon EMR rilis 4.2.0 ## 4.2.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://ganglia.info](http://ganglia.info), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), dan [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.3.0 | emr-4.2.0 | emr-4.1.0 | emr-4.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.27 | 1.10.27 | Tidak dilacak | Tidak dilacak | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.6.0 | - | - | | HBase | - | - | - | - | | HCatalog | - | - | - | - | | Hadoop | 2.7.1-amzn-0 | 2.6.0-amzn-2 | 2.6.0-amzn-1 | 2.6.0-amzn-0 | | Hive | 1.0.0-amzn-2 | 1.0.0-amzn-1 | 1.0.0-amzn-1 | 1.0.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-4 | - | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.11.0 | 0.11.0 | 0.11.0 | 0.10.0 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.0.1 | - | | Phoenix | - | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,130 | 0,125 | 0,119 | - | | Spark | 1.6.0 | 1.5.2 | 1.5.0 | 1.4.1 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | - | - | - | - | | TensorFlow | - | - | - | - | | Tez | - | - | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.5-incubating-amzn-1 | 0.5.5-incubating-amzn-0 | 0.6.0-incubating-SNAPSHOT | - | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | - | - | - | - | ## Catatan rilis 4.2.0 Catatan rilis berikut mencakup informasi untuk Amazon EMR versi rilis 4.2.0. Tanggal rilis: 18 November 2015 **Fitur** + Menambahkan support Ganglia + Meng-upgrade Spark ke versi 1.5.2 + Meng-upgrade Presto ke versi 0.125 + Meng-upgrade Oozie ke versi 4.2.0 + Meng-upgrade Zeppelin ke versi 0.5.5 + Upgrade ke AWS SDK untuk Java 1.10.27 **Masalah yang diketahui yang dipecahkan dari rilis sebelumnya** + Memperbaiki masalah dengan EMRFS CLI yang tidak menggunakan nama tabel metadata default. + Memperbaiki masalah yang ditemui saat menggunakan tabel yang didukung ORC di Amazon S3. + Memperbaiki masalah yang dihadapi dengan ketidakcocokan versi Python dalam konfigurasi Spark. + Memperbaiki masalah saat status simpul YARN gagal dilaporkan karena masalah DNS untuk klaster di VPC. + Memperbaiki masalah yang ditemui saat YARN menonaktifkan simpul, yang mengakibatkan aplikasi macet atau ketidakmampuan untuk menjadwalkan aplikasi baru. + Memperbaiki masalah yang ditemui saat klaster dihentikan dengan status TIMED\$1OUT\$1STARTING. + Memperbaiki masalah yang ditemui saat menyertakan dependensi Scala EMRFS di build lain yang dibangun. Dependensi Scala telah dihapus. ## 4.2.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.1.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.0.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.2.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | ganglia-monitor | 3.6.0 | Agen Ganglia tertanam untuk aplikasi ekosistem Hadoop bersama dengan agen pemantauan Ganglia. | | ganglia-metadata-collector | 3.6.0 | Kolektor metadata Ganglia untuk menggabungkan metrik dari agen pemantauan Ganglia. | | ganglia-web | 3.5.10 | Aplikasi web untuk melihat metrik yang dikumpulkan oleh kolektor metadata Ganglia. | | hadoop-client | 2.6.0-amzn-2 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.6.0-amzn-2 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.6.0-amzn-2 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.6.0-amzn-2 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.6.0-amzn-2 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.6.0-amzn-2 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.6.0-amzn-2 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.6.0-amzn-2 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.6.0-amzn-2 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hive-client | 1.0.0-amzn-1 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-5 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.11.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5 | Server basis data MySQL. | | oozie-client | 4.2.0 | Klien baris perintah Oozie. | | oozie-server | 4.2.0 | Layanan untuk menerima permintaan alur kerja Oozie. | | presto-coordinator | 0,125 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,125 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.5.2 | Klien baris perintah Spark. | | spark-history-server | 1.5.2 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.5.2 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.5.2 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | webserver | 2.4 | Server HTTP Apache. | | zeppelin-server | 0.5.5-incubating-amzn-0 | Notebook berbasis web yang memungkinkan analisis data interaktif. | ## 4.2.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.2.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | presto-connector-hive | Ubah nilai dalam file hive.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | spark-metrics | Ubah nilai dalam file metrics.properties Spark. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | # Amazon EMR rilis 4.1.0 ## 4.1.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://gethue.com/](http://gethue.com/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://oozie.apache.org/](http://oozie.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), [https://prestodb.io/](https://prestodb.io/), [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/), dan [https://zeppelin.incubator.apache.org/](https://zeppelin.incubator.apache.org/). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.3.0 | emr-4.2.0 | emr-4.1.0 | emr-4.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.27 | 1.10.27 | Tidak dilacak | Tidak dilacak | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.6.0 | - | - | | HBase | - | - | - | - | | HCatalog | - | - | - | - | | Hadoop | 2.7.1-amzn-0 | 2.6.0-amzn-2 | 2.6.0-amzn-1 | 2.6.0-amzn-0 | | Hive | 1.0.0-amzn-2 | 1.0.0-amzn-1 | 1.0.0-amzn-1 | 1.0.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-4 | - | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.11.0 | 0.11.0 | 0.11.0 | 0.10.0 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.0.1 | - | | Phoenix | - | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,130 | 0,125 | 0,119 | - | | Spark | 1.6.0 | 1.5.2 | 1.5.0 | 1.4.1 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | - | - | - | - | | TensorFlow | - | - | - | - | | Tez | - | - | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.5-incubating-amzn-1 | 0.5.5-incubating-amzn-0 | 0.6.0-incubating-SNAPSHOT | - | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | - | - | - | - | ## Catatan rilis 4.1.0 ## 4.1.0 versi komponen Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.1.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.0.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.1.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | hadoop-client | 2.6.0-amzn-1 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.6.0-amzn-1 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-library | 2.6.0-amzn-1 | Klien dan perpustakaan baris perintah HDFS | | hadoop-hdfs-namenode | 2.6.0-amzn-1 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.6.0-amzn-1 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-kms-server | 2.6.0-amzn-1 | Server manajemen kunci kriptografi berdasarkan API Hadoop. KeyProvider | | hadoop-mapred | 2.6.0-amzn-1 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.6.0-amzn-1 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.6.0-amzn-1 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hive-client | 1.0.0-amzn-1 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-1 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-1 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | hue-server | 3.7.1-amzn-4 | Aplikasi web untuk menganalisis data menggunakan aplikasi ekosistem Hadoop | | mahout-client | 0.11.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5 | Server basis data MySQL. | | oozie-client | 4.0.1 | Klien baris perintah Oozie. | | oozie-server | 4.0.1 | Layanan untuk menerima permintaan alur kerja Oozie. | | presto-coordinator | 0,119 | Layanan untuk menerima kueri dan mengelola eksekusi kueri antara presto-worker. | | presto-worker | 0,119 | Layanan untuk mengeksekusi potongan kueri. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.5.0 | Klien baris perintah Spark. | | spark-history-server | 1.5.0 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.5.0 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.5.0 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | | zeppelin-server | 0.6.0-incubating-SNAPSHOT | Notebook berbasis web yang memungkinkan analisis data interaktif. | ## 4.1.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.1.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hdfs-encryption-zones | Konfigurasikan zona enkripsi HDFS. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | hue-ini | Ubah nilai dalam file ini Hue | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | hadoop-kms-acls | Ubah nilai dalam file kms-acls.xml Hadoop. | | hadoop-kms-env | Ubah nilai dalam lingkungan Hadoop KMS. | | hadoop-kms-log4j | Ubah nilai dalam file kms-log4j.properties Hadoop. | | hadoop-kms-site | Ubah nilai dalam file kms-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | oozie-env | Ubah nilai di lingkungan Oozie. | | oozie-log4j | Ubah nilai dalam file oozie-log4j.properties Oozie. | | oozie-site | Ubah nilai dalam file oozie-site.xml Oozie. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | presto-log | Ubah nilai dalam file log.properties Presto. | | presto-config | Ubah nilai dalam file config.properties Presto. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | | zeppelin-env | Ubah nilai di lingkungan Zeppelin. | # Amazon EMR rilis 4.0.0 ## 4.0.0 versi aplikasi Rilis ini mencakup aplikasi berikut: [http://hadoop.apache.org/docs/current/](http://hadoop.apache.org/docs/current/), [http://hive.apache.org/](http://hive.apache.org/), [http://mahout.apache.org/](http://mahout.apache.org/), [http://pig.apache.org/](http://pig.apache.org/), dan [https://spark.apache.org/docs/latest/](https://spark.apache.org/docs/latest/). Tabel di bawah ini mencantumkan versi aplikasi yang tersedia dalam rilis Amazon EMR ini dan versi aplikasi dalam tiga rilis EMR Amazon sebelumnya (bila berlaku). Untuk riwayat lengkap versi aplikasi untuk setiap rilis Amazon EMR, lihat topik berikut: + [Versi aplikasi di Amazon EMR 7.x rilis](emr-release-app-versions-7.x.md) + [Versi aplikasi di Amazon EMR 6.x rilis](emr-release-app-versions-6.x.md) + [Versi aplikasi di Amazon EMR 5.x rilis](emr-release-app-versions-5.x.md) + [Versi aplikasi di Amazon EMR 4.x rilis](emr-release-app-versions-4.x.md) **Informasi versi aplikasi** | | emr-4.3.0 | emr-4.2.0 | emr-4.1.0 | emr-4.0.0 | | --- | --- | --- | --- | --- | | AWS SDK for Java | 1.10.27 | 1.10.27 | Tidak dilacak | Tidak dilacak | | Python | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | Skala | Tidak dilacak | Tidak dilacak | Tidak dilacak | Tidak dilacak | | AmazonCloudWatchAgent | - | - | - | - | | Delta | - | - | - | - | | Flink | - | - | - | - | | Ganglia | 3.7.2 | 3.6.0 | - | - | | HBase | - | - | - | - | | HCatalog | - | - | - | - | | Hadoop | 2.7.1-amzn-0 | 2.6.0-amzn-2 | 2.6.0-amzn-1 | 2.6.0-amzn-0 | | Hive | 1.0.0-amzn-2 | 1.0.0-amzn-1 | 1.0.0-amzn-1 | 1.0.0-amzn-0 | | Hudi | - | - | - | - | | Hue | 3.7.1-amzn-5 | 3.7.1-amzn-5 | 3.7.1-amzn-4 | - | | Iceberg | - | - | - | - | | JupyterEnterpriseGateway | - | - | - | - | | JupyterHub | - | - | - | - | | Livy | - | - | - | - | | MXNet | - | - | - | - | | Mahout | 0.11.0 | 0.11.0 | 0.11.0 | 0.10.0 | | Oozie | - | - | - | - | | Oozie-Sandbox | 4.2.0 | 4.2.0 | 4.0.1 | - | | Phoenix | - | - | - | - | | Pig | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | 0.14.0-amzn-0 | | Presto | - | - | - | - | | Presto-Sandbox | 0,130 | 0,125 | 0,119 | - | | Spark | 1.6.0 | 1.5.2 | 1.5.0 | 1.4.1 | | Sqoop | - | - | - | - | | Sqoop-Sandbox | - | - | - | - | | TensorFlow | - | - | - | - | | Tez | - | - | - | - | | Trino (PrestoSQL) | - | - | - | - | | Zeppelin | - | - | - | - | | Zeppelin-Sandbox | 0.5.5-incubating-amzn-1 | 0.5.5-incubating-amzn-0 | 0.6.0-incubating-SNAPSHOT | - | | ZooKeeper | - | - | - | - | | ZooKeeper-Sandbox | - | - | - | - | ## Catatan rilis 4.0.0 ## Versi komponen 4.0.0 Komponen yang diinstal oleh Amazon EMR dengan rilis ini tercantum di bawah ini. Beberapa komponen diinstal sebagai bagian dari paket aplikasi big data. Sedangkan komponen lainnya bersifak unik untuk Amazon EMR dan diinstal untuk proses sistem dan fitur. Ini biasanya dimulai dengan `emr` atau `aws`. Paket aplikasi big data dalam rilis Amazon EMR terbaru biasanya versi terbaru yang ditemukan di komunitas. Kami menyediakan rilis komunitas di Amazon EMR secepat mungkin. Beberapa komponen yang ada di Amazon EMR berbeda dari versi komunitas. Komponen ini mempunyai label versi dalam bentuk `CommunityVersion-amzn-EmrVersion`. `EmrVersion` dimulai dari 0. Misalnya, jika komponen komunitas open source bernama `myapp-component` dengan versi 2.2 telah dimodifikasi tiga kali untuk dimasukkan dalam rilis EMR Amazon yang berbeda, versi rilisnya terdaftar sebagai. `2.2-amzn-2` | Komponen | Versi | Deskripsi | | --- | --- | --- | | emr-ddb | 3.0.0 | Konektor Amazon DynamoDB untuk aplikasi ekosistem Hadoop. | | emr-goodies | 2.0.0 | Perpustakaan kenyamanan ekstra untuk ekosistem Hadoop. | | emr-kinesis | 3.0.0 | Konektor Amazon Kinesis untuk aplikasi ekosistem Hadoop. | | emr-s3-dist-cp | 2.0.0 | Aplikasi salinan terdistribusi yang dioptimalkan untuk Amazon S3. | | emrfs | 2.0.0 | Konektor Amazon S3 untuk aplikasi ekosistem Hadoop. | | hadoop-client | 2.6.0-amzn-0 | Klien baris perintah Hadoop seperti 'hdfs', 'Hadoop', atau 'yarn'. | | hadoop-hdfs-datanode | 2.6.0-amzn-0 | Layanan tingkat simpul HDFS untuk menyimpan blok. | | hadoop-hdfs-namenode | 2.6.0-amzn-0 | Layanan HDFS untuk melacak nama file dan lokasi blok. | | hadoop-httpfs-server | 2.6.0-amzn-0 | Titik akhir HTTP untuk operasi HDFS. | | hadoop-mapred | 2.6.0-amzn-0 | MapReduce pustaka mesin eksekusi untuk menjalankan MapReduce aplikasi. | | hadoop-yarn-nodemanager | 2.6.0-amzn-0 | Layanan YARN untuk mengelola kontainer pada simpul individu. | | hadoop-yarn-resourcemanager | 2.6.0-amzn-0 | Layanan YARN untuk mengalokasikan dan mengelola sumber daya klaster dan aplikasi terdistribusi. | | hive-client | 1.0.0-amzn-0 | Klien baris perintah Hive. | | hive-metastore-server | 1.0.0-amzn-0 | Layanan untuk mengakses metastore Hive, repositori semantik yang menyimpan metadata untuk SQL pada operasi Hadoop. | | hive-server | 1.0.0-amzn-0 | Layanan untuk menerima kueri Hive sebagai permintaan web. | | mahout-client | 0.10.0 | Perpustakaan untuk machine learning. | | mysql-server | 5.5 | Server basis data MySQL. | | pig-client | 0.14.0-amzn-0 | Klien baris perintah Pig. | | spark-client | 1.4.1 | Klien baris perintah Spark. | | spark-history-server | 1.4.1 | Web UI untuk melihat log acara untuk seluruh masa pakai aplikasi Spark. | | spark-on-yarn | 1.4.1 | Mesin eksekusi dalam memori untuk YARN. | | spark-yarn-slave | 1.4.1 | Perpustakaan Apache Spark yang dibutuhkan oleh slave YARN. | ## 4.0.0 klasifikasi konfigurasi Klasifikasi konfigurasi memungkinkan Anda menyesuaikan aplikasi. Ini sering kali bersesuaian dengan file XML konfigurasi untuk aplikasi, seperti `hive-site.xml`. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). **Klasifikasi emr-4.0.0** | Klasifikasi | Deskripsi | | --- | --- | | capacity-scheduler | Ubah nilai dalam file capacity-scheduler.xml Hadoop. | | core-site | Ubah nilai dalam file core-site.xml Hadoop. | | emrfs-site | Ubah pengaturan EMRFS. | | hadoop-env | Ubah nilai dalam lingkungan Hadoop untuk semua komponen Hadoop. | | hadoop-log4j | Ubah nilai dalam file log4j.properties Hadoop ini. | | hdfs-site | Ubah nilai dalam hdfs-site.xml HDFS. | | hive-env | Ubah nilai dalam lingkungan Hive. | | hive-exec-log4j | Ubah nilai dalam file hive-exec-log 4j.properties Hive. | | hive-log4j | Ubah nilai dalam file hive-log4j.properties Hive. | | hive-site | Ubah nilai dalam file hive-site.xml Hive | | httpfs-env | Ubah nilai di lingkungan HTTPFS. | | httpfs-site | Ubah nilai dalam file httpfs-site.xml Hadoop. | | mapred-env | Ubah nilai di lingkungan MapReduce aplikasi. | | mapred-site | Ubah nilai dalam file mapred-site.xml MapReduce aplikasi. | | pig-properties | Ubah nilai dalam file pig.properties Pig. | | pig-log4j | Ubah nilai dalam file log4j.properties Pig. | | spark | Pengaturan terkurasi Amazon EMR untuk Apache Spark. | | spark-defaults | Ubah nilai dalam file spark-defaults.conf Spark. | | spark-env | Ubah nilai di lingkungan Spark. | | spark-log4j | Ubah nilai dalam file log4j.properties Spark. | | yarn-env | Ubah nilai di lingkungan YARN. | | yarn-site | Ubah nilai dalam file yarn-site.xml YARN. | # Amazon EMR versi 2.x dan 3.x AMI **catatan** AWS memperbarui konfigurasi TLS untuk semua titik akhir AWS API ke versi minimum TLS 1.2. Amazon EMR merilis 3.10 dan yang lebih rendah hanya mendukung koneksi TLS 1.0/1.1. Setelah 4 Desember 2023, Anda tidak akan dapat membuat cluster dengan Amazon EMR 3.10 dan lebih rendah. Jika Anda menggunakan Amazon EMR 3.10 atau yang lebih rendah, kami sarankan Anda segera menguji dan memigrasikan beban kerja Anda ke rilis Amazon EMR terbaru. Untuk informasi selengkapnya, lihat [Blog AWS Keamanan](https://aws.amazon.com/blogs//security/tls-1-2-required-for-aws-endpoints/). Rilis Amazon EMR 2.x dan 3.x, disebut *Versi AMI*, dibuat tersedia untuk solusi yang sudah ada sebelumnya yang mengharuskan mereka untuk alasan kompatibilitas. Kami tidak menyarankan untuk membuat cluster baru atau solusi baru dengan versi rilis ini. Mereka tidak memiliki fitur rilis baru dan termasuk paket aplikasi usang. Kami menyarankan Anda membangun solusi menggunakan versi rilis Amazon EMR terbaru. Ruang lingkup perbedaan antara versi rilis 2.x dan 3.x series dan versi rilis Amazon EMR terbaru sangat signifikan. Perbedaan tersebut berkisar dari bagaimana Anda membuat dan mengkonfigurasi sebuah cluster ke port dan struktur direktori aplikasi di cluster. Bagian ini mencoba untuk menutupi perbedaan yang paling signifikan untuk Amazon EMR, serta konfigurasi aplikasi tertentu dan perbedaan manajemen. Hal ini tidak komprehensif. Jika Anda membuat dan menggunakan cluster dalam seri 2.x atau 3.x, Anda mungkin mengalami perbedaan yang tidak tercakup dalam bagian ini. **Topics** + [ # Membuat cluster dengan versi AMI sebelumnya dari Amazon EMR ](emr-3x-create.md) + [ # Menginstal aplikasi dengan versi AMI sebelumnya dari Amazon EMR ](emr-3x-install-apps.md) + [ # Menyesuaikan cluster dan aplikasi konfigurasi dengan versi AMI sebelumnya dari Amazon EMR ](emr-3x-customizeappconfig.md) + [ # aplikasi Hive spesifik untuk versi AMI sebelumnya dari Amazon EMR ](emr-3x-hive.md) + [ # HBase spesifikasi aplikasi untuk versi AMI sebelumnya dari Amazon EMR ](emr-3x-hbase.md) + [ # spesifik aplikasi Pig untuk versi AMI sebelumnya dari Amazon EMR ](emr-3x-pig.md) + [ # Spark spesifik aplikasi dengan versi AMI sebelumnya dari Amazon EMR ](emr-3x-spark.md) + [ # Perbedaan DistCp utilitas S3 dengan versi AMI sebelumnya dari Amazon EMR ](emr-3x-s3distcp.md) # Membuat cluster dengan versi AMI sebelumnya dari Amazon EMR Amazon EMR 2.x dan 3.x rilis direferensikan oleh Versi AMI. Dengan rilis Amazon EMR 4.0.0 dan kemudian, rilis direferensikan oleh versi rilis, menggunakan label rilis seperti `emr-5.11.0`. Perubahan ini paling terlihat saat Anda membuat cluster menggunakan AWS CLI atau secara terprogram. Saat Anda menggunakan AWS CLI untuk membuat klaster menggunakan versi rilis AMI, gunakan `--ami-version` opsi, misalnya,`--ami-version 3.11.0`. Banyak pilihan, fitur, dan aplikasi yang diperkenalkan di Amazon EMR 4.0.0 dan kemudian tidak tersedia ketika Anda menentukan `--ami-version`. Untuk informasi selengkapnya, lihat [Buat Gugus](https://docs.aws.amazon.com/cli/latest/reference/emr/create-cluster.html) di *AWS CLI Referensi*. Contoh AWS CLI perintah berikut meluncurkan cluster menggunakan versi AMI. **catatan** Karakter lanjutan baris Linux (\$1) disertakan agar mudah dibaca Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Test cluster" --ami-version 3.11.0 \ --applications Name=Hue Name=Hive Name=Pig \ --use-default-roles --ec2-attributes KeyName=myKey \ --instance-groups InstanceGroupType=MASTER,InstanceCount=1,\ InstanceType=m3.xlarge InstanceGroupType=CORE,InstanceCount=2,\ InstanceType=m3.xlarge --bootstrap-actions Path=s3://elasticmapreduce/bootstrap-actions/configure-hadoop,\ Name="Configuring infinite JVM reuse",Args=["-m","mapred.job.reuse.jvm.num.tasks=-1"] ``` Pemrograman, semua versi rilis Amazon EMR menggunakan `RunJobFlowRequest` di API EMR untuk membuat cluster. Berikut contoh kode Java menciptakan sebuah cluster menggunakan AMI versi rilis 3.11.0. ``` RunJobFlowRequest request = new RunJobFlowRequest() .withName("AmiVersion Cluster") .withAmiVersion("3.11.0") .withInstances(new JobFlowInstancesConfig() .withEc2KeyName("myKeyPair") .withInstanceCount(1) .withKeepJobFlowAliveWhenNoSteps(true) .withMasterInstanceType("m3.xlarge") .withSlaveInstanceType("m3.xlarge"); ``` Berikut ini `RunJobFlowRequest` panggilan menggunakan label rilis sebagai gantinya: ``` RunJobFlowRequest request = new RunJobFlowRequest() .withName("ReleaseLabel Cluster") .withReleaseLabel("emr-7.12.0") .withInstances(new JobFlowInstancesConfig() .withEc2KeyName("myKeyPair") .withInstanceCount(1) .withKeepJobFlowAliveWhenNoSteps(true) .withMasterInstanceType("m3.xlarge") .withSlaveInstanceType("m3.xlarge"); ``` ## Mengonfigurasi ukuran cluster Ketika cluster Anda berjalan, Hadoop menentukan jumlah mapper dan peredam tugas yang diperlukan untuk memproses data. Cluster yang lebih besar harus memiliki lebih banyak tugas untuk penggunaan sumber daya yang lebih baik dan waktu pemrosesan yang. Biasanya, cluster EMR tetap ukuran yang sama selama seluruh cluster; Anda menetapkan jumlah tugas ketika Anda membuat cluster. Ketika Anda mengubah ukuran cluster berjalan, Anda dapat bervariasi pengolahan selama eksekusi cluster. Oleh karena itu, alih-alih menggunakan sejumlah tugas tetap, Anda dapat memvariasikan jumlah tugas selama kehidupan cluster. Ada dua opsi konfigurasi untuk membantu mengatur jumlah tugas yang ideal: + `mapred.map.tasksperslot` + `mapred.reduce.tasksperslot` Anda dapat mengatur kedua pilihan di `mapred-conf.xml` file. Ketika Anda mengirimkan pekerjaan ke cluster, klien pekerjaan memeriksa jumlah total saat peta dan mengurangi slot tersedia clusterwide. Klien pekerjaan kemudian menggunakan persamaan berikut untuk mengatur jumlah tugas: + `mapred.map.tasks` =` mapred.map.tasksperslot` \$1 slot peta di cluster + `mapred.reduce.tasks` = `mapred.reduce.tasksperslot` \$1 mengurangi slot di cluster Klien pekerjaan hanya membaca `tasksperslot` parameter jika jumlah tugas tidak dikonfigurasi. Anda dapat mengganti jumlah tugas setiap saat, baik untuk semua cluster melalui tindakan bootstrap atau secara individual per pekerjaan dengan menambahkan langkah untuk mengubah konfigurasi. Amazon EMR tahan kegagalan node tugas dan terus eksekusi cluster bahkan jika node tugas menjadi tidak tersedia. Amazon EMR secara otomatis ketentuan node tugas tambahan untuk menggantikan orang-orang yang gagal. Anda dapat memiliki nomor yang berbeda dari node tugas untuk setiap langkah cluster. Anda juga dapat menambahkan langkah untuk menjalankan cluster untuk mengubah jumlah node tugas. Karena semua langkah dijamin untuk menjalankan secara berurutan secara default, Anda dapat menentukan jumlah menjalankan tugas node untuk setiap langkah. # Menginstal aplikasi dengan versi AMI sebelumnya dari Amazon EMR Saat menggunakan versi AMI, aplikasi diinstal dengan berbagai cara, termasuk menggunakan `NewSupportedProducts` parameter untuk [RunJobFlow](https://docs.aws.amazon.com/ElasticMapReduce/latest/API/API_RunJobFlow.html)tindakan, menggunakan tindakan bootstrap, dan menggunakan tindakan [Langkah](https://docs.aws.amazon.com/ElasticMapReduce/latest/API/API_Step.html). # Menyesuaikan cluster dan aplikasi konfigurasi dengan versi AMI sebelumnya dari Amazon EMR Rilis Amazon EMR versi 4.0.0 memperkenalkan metode sederhana untuk mengkonfigurasi aplikasi menggunakan klasifikasi konfigurasi. Untuk informasi selengkapnya, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). Bila menggunakan versi AMI, Anda mengkonfigurasi aplikasi menggunakan tindakan bootstrap bersama dengan argumen yang Anda lulus. Misalnya, `configure-hadoop` dan `configure-daemons` tindakan bootstrap mengatur Hadoop dan Yarn—properti lingkungan khusus seperti `--namenode-heap-size`. Dalam versi yang lebih baru, ini dikonfigurasi menggunakan `hadoop-env` dan `yarn-env` klasifikasi konfigurasi. Untuk tindakan bootstrap yang melakukan konfigurasi umum, lihat [emr-bootstrap-actions repositori di Github](https://github.com/awslabs/emr-bootstrap-actions). Tabel berikut memetakan tindakan bootstrap untuk klasifikasi konfigurasi dalam versi rilis Amazon EMR yang lebih baru. **Hadoop** | Nama file aplikasi yang terdampak | Tindakan bootstrap versi AMI | Klasifikasi konfigurasi | | --- | --- | --- | | core-site.xml | configure-hadoop -c | core-site | | log4j.properties | configure-hadoop -l | hadoop-log4j | | hdfs-site.xml | configure-hadoop -s | hdfs-site | | tidak berlaku | T/A | hdfs-encryption-zones | | mapred-site.xml | configure-hadoop -m | mapred-site | | yarn-site.xml | configure-hadoop -y | yarn-site | | httpfs-site.xml | configure-hadoop -t | httpfs-site | | capacity-scheduler.xml | configure-hadoop -z | capacity-scheduler | | yarn-env.sh | configure-daemons --resourcemanager-opts | yarn-env | **Hive** | Nama file aplikasi yang terdampak | Tindakan bootstrap versi AMI | Klasifikasi konfigurasi | | --- | --- | --- | | hive-env.sh | tidak berlaku | hive-env | | hive-site.xml | hive-script --install-hive-site \$1\$1MY\$1HIVE\$1SITE\$1FILE\$1 | hive-site | | hive-exec-log4j.properties | tidak ada | hive-exec-log4j | | hive-log4j.properties | T/A | hive-log4j | **EMRFS** | Nama file aplikasi yang terdampak | Tindakan bootstrap versi AMI | Klasifikasi konfigurasi | | --- | --- | --- | | emrfs-site.xml | configure-hadoop -e | emrfs-site | | tidak berlaku | s3get -s s3://custom-provider.jar -d /usr/share/aws/emr/auxlib/ | emrfs-site (dengan pengaturan baru fs.s3.cse.encryptionMaterialsProvider.uri) | Untuk daftar semua klasifikasi, lihat [Konfigurasikan aplikasi](emr-configure-apps.md). ## Variabel lingkungan aplikasi Bila menggunakan versi AMI, `hadoop-user-env.sh` digunakan bersama dengan `configure-daemons` tindakan bootstrap untuk mengkonfigurasi lingkungan Hadoop. Skrip mencakup tindakan berikut: ``` #!/bin/bash export HADOOP_USER_CLASSPATH_FIRST=true; echo "HADOOP_CLASSPATH=/path/to/my.jar" >> /home/hadoop/conf/hadoop-user-env.sh ``` Di Amazon EMR rilis 4.x, Anda melakukan hal yang sama menggunakan `hadoop-env` klasifikasi konfigurasi, seperti yang ditunjukkan dalam contoh berikut: ``` [       {          "Classification":"hadoop-env",          "Properties":{          },          "Configurations":[             {                "Classification":"export",                "Properties":{                   "HADOOP_USER_CLASSPATH_FIRST":"true",                   "HADOOP_CLASSPATH":"/path/to/my.jar"                }             }          ]       }    ] ``` Sebagai contoh lain, menggunakan `configure-daemons` dan melewati `--namenode-heap-size=2048` dan `--namenode-opts=-XX:GCTimeRatio=19` setara dengan klasifikasi konfigurasi berikut. ``` [       {          "Classification":"hadoop-env",          "Properties":{          },          "Configurations":[             {                "Classification":"export",                "Properties":{                   "HADOOP_DATANODE_HEAPSIZE": "2048", "HADOOP_NAMENODE_OPTS": "-XX:GCTimeRatio=19"                }             }          ]       }    ] ``` Variabel lingkungan aplikasi lainnya tidak lagi didefinisikan dalam `/home/hadoop/.bashrc`. Sebaliknya, mereka terutama diatur dalam `/etc/default` file per komponen atau aplikasi, seperti `/etc/default/hadoop`. Skrip pembungkus yang `/usr/bin/` diinstal oleh aplikasi juga RPMs dapat mengatur variabel lingkungan tambahan sebelum melibatkan skrip bin yang sebenarnya. ## Port layanan Saat menggunakan versi AMI, beberapa layanan menggunakan port kustom. **Perubahan dalam pengaturan port** | Pengaturan | AMI versi 3.x | Default sumber terbuka | | --- | --- | --- | | fs.default.name | hdfs://emrDeterminedIP:9000 | default (hdfs: emrDeterminedIP //:8020) | | dfs.datanode.address | 0.0.0.0:9200 | default (0.0.0.0:50010) | | dfs.datanode.http.address | 0.0.0.0:9102 | default (0.0.0.0:50075) | | dfs.datanode.https.address | 0.0.0.0:9402 | default (0.0.0.0:50475) | | dfs.datanode.ipc.alamat | 0.0.0.0:9201 | default (0.0.0.0:50020) | | dfs.http.address | 0.0.0.0:9101 | default (0.0.0.0:50070) | | dfs.https.address | 0.0.0.0:9202 | default (0.0.0.0:50470) | | dfs.secondary.http.address | 0.0.0.0:9104 | default (0.0.0.0:50090) | | yarn.nodemanager.alamat | 0.0.0.0:9103 | default (\$1 \$1yarn.nodemanager.hostname\$1: 0) | | yarn.nodemanager.localizer.alamat | 0.0.0.0:9033 | default (\$1 \$1yarn.nodemanager.hostname\$1: 8040) | | yarn.nodemanager.webapp.address | 0.0.0.0:9035 | default (\$1 \$1yarn.nodemanager.hostname\$1: 8042) | | yarn.resourcemanager.address | emrDeterminedIP:9022 | default (\$1\$1yarn.resourcemanager.hostname\$1:8032) | | yarn.resourcemanager.admin.address | emrDeterminedIP:9025 | default (\$1\$1yarn.resourcemanager.hostname\$1:8033) | | yarn.resourcemanager.resource-tracker.address | emrDeterminedIP:9023 | default (\$1\$1yarn.resourcemanager.hostname\$1:8031) | | yarn.resourcemanager.scheduler.address | emrDeterminedIP:9024 | default (\$1\$1yarn.resourcemanager.hostname\$1:8030) | | yarn.resourcemanager.webapp.address | 0.0.0.0:9026 | default (\$1\$1yarn.resourcemanager.hostname\$1:8088) | | yarn.web-proxy.address | emrDeterminedIP:9046 | default (no-value) | | yarn.resourcemanager.hostname | 0.0.0.0 (default) | emrDeterminedIP | **catatan** *emrDeterminedIP*Ini adalah alamat IP yang dihasilkan oleh Amazon EMR. ## Pengguna Saat menggunakan versi AMI, pengguna `hadoop` menjalankan semua proses dan memiliki semua file. Di Amazon EMR rilis versi 4.0.0 dan kemudian, pengguna ada di aplikasi dan komponen tingkat. ## Urutan instalasi, artefak diinstal, dan lokasi file log Ketika menggunakan versi AMI, artefak aplikasi dan direktori konfigurasi mereka diinstal di `/home/hadoop/application` direktori. Misalnya, jika Anda menginstal Hive, direktori akan `/home/hadoop/hive`. Di Amazon EMR rilis 4.0.0 dan kemudian, artefak aplikasi diinstal di `/usr/lib/application` direktori. Bila menggunakan versi AMI, file log ditemukan di berbagai tempat. Tabel di bawah daftar lokasi. **Perubahan di lokasi log di Amazon S3** | Daemon atau aplikasi | Lokasi direktori | | --- | --- | | Status instans | node//instance-state/ instance-id | | hadoop-hdfs-namenode | daemon//instance-id.log hadoop-hadoop-namenode | | hadoop-hdfs-datanode | daemon//instance-id.log hadoop-hadoop-datanode | | hadoop-benang () ResourceManager | daemon//instance-idyarn-hadoop-resourcemanager | | hadoop-yarn (Server Proksi) | daemon//instance-idyarn-hadoop-proxyserver | | mapred-historyserver | daemon//instance-id | | httpfs | daemon/ /httpfs.log instance-id | | hive-server | simpul/ /hive-server/hive-server.log instance-id | | hive-metastore | simpul/ /apps/hive.log instance-id | | Hive CLI | simpul/ /apps/hive.log instance-id | | aplikasi BEARN log pengguna dan log kontainer | Percobaan tugas/ | | Mahout | Tidak Berlaku | | Pig | Tidak Berlaku | | spark-historyserver | Tidak Berlaku | | berkas riwayat pekerjaan mapreduce | Pekerjaan/ | ## Perintah Saat menggunakan versi AMI, banyak skrip atau program, seperti `/home/hadoop/contrib/streaming/hadoop-streaming.jar`, tidak ditempatkan pada lingkungan path login shell, sehingga Anda perlu menentukan path lengkap ketika Anda menggunakan file jar seperti command-runner.jar atau script-runner.jar untuk mengeksekusi script. Parameter `command-runner.jar` terletak di AMI sehingga tidak perlu mengetahui URI lengkap seperti halnya dengan `script-runner.jar`. ## Faktor replikasi Faktor replikasi memungkinkan Anda mengkonfigurasi kapan untuk memulai Hadoop JVM. Anda dapat memulai Hadoop JVM baru untuk setiap tugas, yang menyediakan isolasi tugas yang lebih baik, atau Anda dapat berbagi JVMs antar tugas, memberikan overhead kerangka kerja yang lebih rendah. Jika Anda memproses banyak file kecil, masuk akal untuk menggunakan kembali JVM berkali-kali untuk amortisasi biaya start-up. Namun, jika setiap tugas membutuhkan waktu yang lama atau proses sejumlah besar data, maka Anda mungkin memilih untuk tidak menggunakan kembali JVM untuk memastikan bahwa semua memori dibebaskan untuk tugas-tugas berikutnya. Bila menggunakan versi AMI, Anda dapat menyesuaikan faktor replikasi menggunakan `configure-hadoop` tindakan bootstrap untuk mengatur `mapred.job.reuse.jvm.num.tasks` properti. Contoh berikut menunjukkan pengaturan faktor penggunaan kembali JVM untuk penggunaan kembali JVM tak terbatas. **catatan** Karakter kelanjutan baris Linux (\$1) disertakan untuk memudahkan pembacaan. Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Test cluster" --ami-version 3.11.0 \ --applications Name=Hue Name=Hive Name=Pig \ --use-default-roles --ec2-attributes KeyName=myKey \ --instance-groups InstanceGroupType=MASTER,InstanceCount=1,InstanceType=m3.xlarge \ InstanceGroupType=CORE,InstanceCount=2,InstanceType=m3.xlarge \ --bootstrap-actions Path=s3://elasticmapreduce/bootstrap-actions/configure-hadoop,\ Name="Configuring infinite JVM reuse",Args=["-m","mapred.job.reuse.jvm.num.tasks=-1"] ``` # aplikasi Hive spesifik untuk versi AMI sebelumnya dari Amazon EMR ## File log Menggunakan Amazon EMR AMI versi 2.x dan 3.x, log Hive disimpan ke `/mnt/var/log/apps/`. Untuk mendukung versi bersamaan Hive, versi Hive yang Anda jalankan menentukan nama file log, seperti yang ditunjukkan pada tabel berikut. | Versi Hive | Nama file log | | --- | --- | | 0.13.1 | hive.log Dimulai dengan versi ini, Amazon EMR menggunakan nama file tidak berversi, `hive.log`. Versi minor berbagi lokasi log yang sama sebagai versi utama. | | 0.11.0 | hive\$10110.log Versi minor dari Hive 0.11.0, seperti 0.11.0.1, berbagi lokasi file log yang sama sebagai Hive 0.11.0. | | 0.8.1 | hive\$1081.log Versi minor dari Hive 0.8.1, seperti Hive 0.8.1.1, berbagi lokasi file log yang sama sebagai Hive 0.8.1. | | 0.7.1 | hive\$107\$11.log Versi minor dari Hive 0.7.1, seperti Hive 0.7.1.3 dan Hive 0.7.1.4, berbagi lokasi file log yang sama sebagai Hive 0.7.1. | | 0,7 | hive\$107.log | | 0,5 | hive\$105.log | | 0,4 | hive.log | ## Fungsionalitas input terpisah Untuk menerapkan fungsi input split menggunakan versi Hive lebih awal dari 0.13.1 (Amazon EMR AMI versi sebelumnya 3.11.0), gunakan berikut: ``` hive> set hive.input.format=org.apache.hadoop.hive.ql.io.HiveCombineSplitsInputFormat; hive> set mapred.min.split.size=100000000; ``` Fungsi ini diusangkan dengan Hive 0.13.1. Untuk mendapatkan fungsi format input split yang sama di Amazon EMR AMI Versi 3.11.0, gunakan berikut ini: ``` set hive.hadoop.supports.splittable.combineinputformat=true; ``` ## Port layanan penghematan Hemat adalah kerangka RPC yang mendefinisikan format serialisasi biner kompak digunakan untuk bertahan struktur data untuk analisis kemudian. Biasanya, Hive mengkonfigurasi server untuk beroperasi pada port berikut. | Versi Hive | Angka port | | --- | --- | | Hive 0.13.1 | 10000 | | Hive 0.11.0 | 10004 | | Hive 0.8.1 | 10003 | | Hive 0.7.1 | 10002 | | Hive 0.7 | 10001 | | Hive 0.5 | 10000 | Untuk informasi selengkapnya tentang menginstal layanan ini, lihat [http://wiki.apache.org/thrift/](http://wiki.apache.org/thrift/). ## Gunakan Hive untuk memulihkan partisi Amazon EMR termasuk pernyataan dalam bahasa query Hive yang pulih partisi dari tabel data yang terletak di Amazon S3. Contoh berikut menunjukkan hal ini. ``` CREATE EXTERNAL TABLE (json string) raw_impression PARTITIONED BY (dt string) LOCATION 's3://elastic-mapreduce/samples/hive-ads/tables/impressions'; ALTER TABLE logs RECOVER PARTITIONS; ``` Direktori partisi dan data harus berada di lokasi yang ditentukan dalam definisi tabel dan harus diberi nama sesuai dengan konvensi Hive: misalnya, `dt=2009-01-01`. **catatan** Setelah Hive 0.13.1 kemampuan ini didukung native menggunakan `msck repair table` dan karenanya `recover partitions` tidak didukung. Untuk informasi lebih lanjut, lihat [https://cwiki.apache. org/confluence/display/Hive/LanguageManual\$1 DDL](https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL). ## Lulus variabel Hive untuk script Untuk meneruskan variabel ke langkah Hive menggunakan AWS CLI, ketik perintah berikut, ganti *myKey* dengan nama key pair EC2 Anda, dan ganti *amzn-s3-demo-bucket* dengan nama bucket Anda. Dalam contoh ini, `SAMPLE` adalah nilai variabel yang didahului oleh `-d`beralih. Variabel ini didefinisikan dalam script Hive sebagai: `${SAMPLE}`. **catatan** Karakter kelanjutan baris Linux (\$1) disertakan untuk memudahkan pembacaan. Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Test cluster" --ami-version 3.9 \ --applications Name=Hue Name=Hive Name=Pig \ --use-default-roles --ec2-attributes KeyName=myKey \ --instance-type m3.xlarge --instance-count 3 \ --steps Type=Hive,Name="Hive Program",ActionOnFailure=CONTINUE,\ Args=[-f,s3://elasticmapreduce/samples/hive-ads/libs/response-time-stats.q,-d,\ INPUT=s3://elasticmapreduce/samples/hive-ads/tables,-d,OUTPUT=s3://amzn-s3-demo-bucket/hive-ads/output/,\ -d,SAMPLE=s3://elasticmapreduce/samples/hive-ads/] ``` ## Tentukan lokasi metastore eksternal Prosedur berikut menunjukkan cara untuk menimpa nilai konfigurasi default untuk lokasi metastore Hive dan mulai cluster menggunakan lokasi metastore ulang. **Untuk membuat metastore terletak di luar cluster EMR** 1. Buat database MySQL atau Aurora menggunakan Amazon RDS. Untuk informasi tentang cara membuat database Amazon RDS, lihat [Memulai dengan Amazon RDS](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_GettingStarted.html). 1. Ubah grup keamanan Anda untuk mengizinkan koneksi JDBC antara database Anda dan grup keamanan **ElasticMapReduce-Master**. Untuk informasi tentang cara mengubah grup keamanan untuk akses, lihat, lihat [Grup keamanan Amazon RDS](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Overview.RDSSecurityGroups.html) di *Panduan Pengguna Amazon RDS*. 1. Mengatur nilai-nilai konfigurasi JDBC di `hive-site.xml`: 1. Buat `hive-site.xml` file konfigurasi yang berisi berikut ini: ``` javax.jdo.option.ConnectionURL jdbc:mariadb://hostname:3306/hive?createDatabaseIfNotExist=true JDBC connect string for a JDBC metastore javax.jdo.option.ConnectionUserName hive Username to use against metastore database javax.jdo.option.ConnectionPassword password Password to use against metastore database ``` *hostname*adalah alamat DNS dari instans Amazon RDS yang menjalankan database. *username*dan *password* merupakan kredensyal untuk database Anda. Untuk informasi selengkapnya tentang menghubungkan ke MySQL dan Aurora database instans, lihat [Menghubungkan ke instans DB yang menjalankan mesin basis data MySQL](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_ConnectToInstance.html) dan [Menghubungkan ke klaster DB Aurora](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Aurora.Connecting.html) di *Panduan Pengguna Amazon RDS*. Driver JDBC diinstal oleh Amazon EMR. **catatan** Properti nilai tidak boleh mengandung spasi atau pengembalian carriage. Ini akan muncul semua pada satu baris. 1. Simpan file `hive-site.xml` Anda ke lokasi di Amazon S3, seperti `s3://amzn-s3-demo-bucket/hive-site.xml`. 1. Buat cluster, menentukan lokasi Amazon S3 dari disesuaikan `hive-site.xml` file. Contoh perintah berikut menunjukkan AWS CLI perintah yang melakukan hal ini. **catatan** Karakter lanjutan baris Linux (\$1) disertakan agar mudah dibaca Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Test cluster" --ami-version 3.10 \ --applications Name=Hue Name=Hive Name=Pig \ --use-default-roles --ec2-attributes KeyName=myKey \ --instance-type m3.xlarge --instance-count 3 \ --bootstrap-actions Name="Install Hive Site Configuration",\ Path="s3://region.elasticmapreduce/libs/hive/hive-script",\ Args=["--base-path","s3://elasticmapreduce/libs/hive","--install-hive-site",\ "--hive-site=s3://amzn-s3-demo-bucket/hive-site.xml","--hive-versions","latest"] ``` ## Connect ke Hive menggunakan JDBC Untuk terhubung ke Hive melalui JDBC mengharuskan Anda untuk men-download driver JDBC dan menginstal klien SQL. Contoh berikut menunjukkan menggunakan SQL Workbench/J untuk terhubung ke Hive menggunakan JDBC. **Untuk men-download driver JDBC** 1. Men-download dan ekstrak driver yang sesuai dengan versi Hive yang ingin Anda akses. Versi Hive berbeda tergantung pada AMI yang Anda pilih saat membuat klaster Amazon EMR. + [Sarang 0.13.1 JDBC driver: JDBC\$11.0.4.1004.zip https://amazon-odbc-jdbc-drivers.s3.amazonaws.com/public/ AmazonHive](https://amazon-odbc-jdbc-drivers.s3.amazonaws.com/public/AmazonHiveJDBC_1.0.4.1004.zip) + Driver Hive 0.11.0 JDBC: [https://mvnrepository.com/artifact/org.apache.hive/hive-jdbc/0.11.0](https://mvnrepository.com/artifact/org.apache.hive/hive-jdbc/0.11.0) + Driver Hive 0.8.1 JDBC: [https://mvnrepository.com/artifact/org.apache.hive/hive-jdbc/0.8.1](https://mvnrepository.com/artifact/org.apache.hive/hive-jdbc/0.8.1) 1. Instal SQL Workbench/J. Untuk informasi lebih lanjut, lihat [Menginstal dan memulai SQL Workbench/J di Manual Pengguna SQL](http://www.sql-workbench.net/manual/install.html) Manual. Workbench/J 1. Buat terowongan SSH ke node master cluster. Port untuk koneksi berbeda tergantung pada versi Hive. Contoh perintah disediakan dalam tabel di bawah ini untuk Linux `ssh` pengguna dan perintah PuTTY untuk pengguna Windows **Perintah SSH Linux** [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-3x-hive.html) **Pengaturan terowongan Windows PuTTY** [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-3x-hive.html) 1. Tambahkan driver JDBC ke SQL Workbench. 1. Di **Pilih Profil Koneksi** kotak dialog, pilih **Mengelola driver**. 1. Pilih **Buat entri baru** (halaman kosong) ikon. 1. Di kolom **Nama**, ketikkan **Hive JDBC**. 1. Untuk **Pustaka**, klik ikon **Pilih file JAR**. 1. Pilih file JAR seperti yang ditunjukkan dalam tabel berikut. **** [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-3x-hive.html) 1. Pada kotak dialog **Pilih satu driver**, pilih driver sesuai dengan tabel berikut ini dan klik **OKE**. [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-3x-hive.html) 1. Ketika Anda kembali ke **Pilih Profil Koneksi** kotak dialog, verifikasi bahwa **Driver** bidang diatur ke **Hive JDBC** dan menyediakan koneksi JDBC string di **URL** kolom sesuai dengan tabel berikut. [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-3x-hive.html) Jika cluster Anda menggunakan AMI versi 3.3.1 atau yang lebih baru, di **Pilih Profil Koneksi** kotak dialog, jenis **hadoop** di **Nama pengguna** Bidang. # HBase spesifikasi aplikasi untuk versi AMI sebelumnya dari Amazon EMR ## HBase Versi yang didukung | HBase versi | Versi AMI | AWS CLI parameter konfigurasi | HBase detail versi | | --- | --- | --- | --- | | [0.94.18](https://svn.apache.org/repos/asf/hbase/branches/0.94/CHANGES.txt) | 3.1.0 dan versi yang lebih baru | `--ami-version 3.1` `--ami-version 3.2` `--ami-version 3.3` `--applications Name=HBase` | [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-3x-hbase.html) | | [0.94.7](https://svn.apache.org/repos/asf/hbase/branches/0.94/CHANGES.txt) | 3.0-3.0.4 | `--ami-version 3.0` `--applications Name=HBase` | | [0,92](https://svn.apache.org/repos/asf/hbase/branches/0.92/CHANGES.txt) | 2.2 dan versi yang lebih baru | `--ami-version 2.2 or later` `--applications Name=HBase` | ## HBase prasyarat cluster Cluster yang dibuat menggunakan Amazon EMR AMI versi 2.x dan 3.x harus memenuhi persyaratan berikut untuk. HBase + AWS CLI (opsional) —Untuk berinteraksi dengan HBase menggunakan baris perintah, unduh dan instal versi terbaru dari file. AWS CLI Untuk informasi selengkapnya, lihat [Menginstal AWS Command Line Interface](https://docs.aws.amazon.com/cli/latest/userguide/installing.html) dalam *AWS Command Line Interface Panduan Pengguna *. + Setidaknya dua contoh (opsional) —The cluster master node menjalankan HBase master server dan Zookeeper, dan node tugas menjalankan server wilayah HBase. Untuk kinerja terbaik, klaster HBase harus berjalan pada setidaknya dua instans EC2, tetapi Anda dapat menjalankan HBase pada satu node untuk tujuan evaluasi. + Cluster yang berjalan lama— HBase hanya berjalan pada cluster yang berjalan lama. Secara default, konsol CLI dan Amazon EMR membuat cluster lama berjalan. + Sebuah key pair Amazon EC2 set (disarankan) -Untuk menggunakan protokol jaringan Secure Shell (SSH) untuk terhubung dengan node master dan menjalankan perintah shell HBase, Anda harus menggunakan key pair Amazon EC2 ketika Anda membuat cluster. + Versi AMI dan Hadoop yang benar— HBase cluster saat ini hanya didukung pada Hadoop 20.205 atau yang lebih baru. + Ganglia (opsional) —Untuk memantau metrik HBase kinerja, instal Ganglia saat Anda membuat cluster. + Bucket Amazon S3 untuk log (opsional) —Log untuk HBase tersedia di node master. Jika Anda ingin log ini disalin ke Amazon S3, tentukan bucket S3 untuk menerima file log saat Anda membuat kluster. ## Membuat cluster dengan HBase Tabel berikut mencantumkan opsi yang tersedia saat menggunakan konsol untuk membuat cluster dengan HBase menggunakan versi rilis Amazon EMR AMI. | Bidang | Tindakan | | --- | --- | | Pulihkan dari cadangan | Tentukan apakah akan memuat HBase klaster terlebih dahulu dengan data yang disimpan di Amazon S3. | | Lokasi Backup | Tentukan URI mana cadangan dari yang untuk mengembalikan berada di Amazon S3. | | Versi Backup | Opsional, tentukan nama versi cadangan di Lokasi Backup untuk digunakan. Jika Anda membiarkan bidang ini kosong, Amazon EMR menggunakan cadangan terbaru di Lokasi Cadangan untuk mengisi cluster baru. HBase | | Jadwalkan Pencadangan Reguler | Menentukan apakah untuk menjadwalkan backup tambahan otomatis. Cadangan pertama adalah cadangan penuh untuk membuat baseline untuk masa depan tambahan backup. | | Cadangan yang konsisten | Menentukan apakah backup harus konsisten. Cadangan konsisten adalah salah satu yang berhenti menulis operasi selama tahap cadangan awal, sinkronisasi di node. Setiap operasi tulis dengan demikian dijeda ditempatkan dalam antrian dan dilanjutkan saat sinkronisasi selesai. | | Frekuensi Backup | Jumlah days/hours/minutes antara backup terjadwal. | | Lokasi Backup | Amazon S3 URI dimana backup disimpan. Lokasi cadangan untuk setiap HBase cluster harus berbeda untuk memastikan bahwa backup diferensial tetap benar. | | Waktu mulai Backup | Tentukan kapan cadangan pertama harus terjadi. Anda dapat mengatur ini ke now, yang menyebabkan cadangan pertama untuk memulai segera setelah cluster berjalan, atau masukkan tanggal dan waktu di [Format ISO](http://www.w3.org/TR/NOTE-datetime). Sebagai contoh, 2012-06-15T 20:00 Z akan menetapkan waktu mulai 15 Juni 2012 di 20:00 UTC. | Contoh AWS CLI perintah berikut meluncurkan cluster dengan HBase dan aplikasi lainnya: **catatan** Karakter lanjutan baris Linux (\$1) disertakan agar mudah dibaca Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Test cluster" --ami-version 3.3 \ --applications Name=Hue Name=Hive Name=Pig Name=HBase \ --use-default-roles --ec2-attributes KeyName=myKey \ --instance-type c1.xlarge --instance-count 3 --termination-protected ``` Setelah koneksi antara Hive dan HBase cluster dibuat (seperti yang ditunjukkan pada prosedur sebelumnya), Anda dapat mengakses data yang disimpan di HBase cluster dengan membuat tabel eksternal di Hive. Contoh berikut, ketika dijalankan dari prompt Hive, membuat tabel eksternal yang mereferensikan data yang disimpan dalam HBase tabel yang disebut`inputTable`. Anda kemudian dapat referensi `inputTable` dalam pernyataan Hive untuk query dan memodifikasi data yang disimpan dalam HBase cluster. **catatan** Contoh berikut menggunakan **protobuf-java-2.4.0a.jar** di AMI 2.3.3, tetapi Anda harus memodifikasi contoh untuk mencocokkan versi Anda. Untuk memeriksa versi Protokol Buffer JAR Anda memiliki, jalankan perintah pada prompt perintah Hive: `! ls /home/hadoop/lib;`. ``` add jar lib/emr-metrics-1.0.jar ; add jar lib/protobuf-java-2.4.0a.jar ; set hbase.zookeeper.quorum=ec2-107-21-163-157.compute-1.amazonaws.com ; create external table inputTable (key string, value string) stored by 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' with serdeproperties ("hbase.columns.mapping" = ":key,f1:col1") tblproperties ("hbase.table.name" = "t1"); select count(*) from inputTable ; ``` ## Menyesuaikan konfigurasi HBase Meskipun pengaturan default harus berfungsi untuk sebagian besar aplikasi, Anda memiliki fleksibilitas untuk mengubah pengaturan HBase konfigurasi Anda. Untuk melakukannya, jalankan salah satu dari dua skrip tindakan bootstrap: + **configure-hbase-daemons**—Mengkonfigurasi properti daemon master, regionserver, dan zookeeper. Properti ini termasuk ukuran heap dan opsi untuk diteruskan ke Java Virtual Machine (JVM) ketika daemon dimulai. HBase Anda mengatur properti ini sebagai argumen dalam tindakan bootstrap. Tindakan bootstrap ini memodifikasi file konfigurasi/home/hadoop/conf/hbase-user-env.sh pada HBase cluster. + **configurre-hbase** —Mengonfigurasi pengaturan HBase khusus situs seperti port yang harus diikat oleh HBase master dan jumlah maksimum kali klien CLI klien harus mencoba lagi suatu tindakan. Anda dapat mengatur ini one-by-one, sebagai argumen dalam tindakan bootstrap, atau Anda dapat menentukan lokasi file konfigurasi XMLdi Amazon S3. Tindakan bootstrap ini memodifikasi file konfigurasi/home/hadoop/conf/hbase-site.xml pada HBase cluster. **catatan** Skrip ini, seperti tindakan bootstrap lainnya, hanya dapat dijalankan ketika cluster dibuat; Anda tidak dapat menggunakannya untuk mengubah konfigurasi HBase cluster yang sedang berjalan. Saat Anda menjalankan tindakan **configurre-hbase** atau **configure-hbase-daemons**bootstrap, nilai yang Anda tentukan akan menggantikan nilai default. Setiap nilai yang Anda tidak secara eksplisit mengatur menerima nilai default. Mengkonfigurasi HBase dengan tindakan bootstrap ini analog dengan menggunakan tindakan bootstrap di Amazon EMR untuk mengonfigurasi pengaturan Hadoop dan properti daemon Hadoop. Perbedaannya adalah bahwa HBase tidak memiliki opsi memori per proses. Sebagai gantinya, opsi memori diatur menggunakan `--daemon-opts` argumen, di *daemon* mana diganti dengan nama daemon untuk dikonfigurasi. ### Konfigurasikan HBase daemon Amazon EMR menyediakan tindakan bootstrap,`s3://region.elasticmapreduce/bootstrap-actions/configure-hbase-daemons`, yang dapat Anda gunakan untuk mengubah konfigurasi HBase daemon, di mana *region* wilayah tempat Anda meluncurkan cluster Anda. HBase Untuk mengonfigurasi HBase daemon menggunakan AWS CLI, tambahkan tindakan `configure-hbase-daemons` bootstrap saat Anda meluncurkan cluster untuk mengonfigurasi satu atau beberapa HBase daemon. Anda dapat mengatur properti berikut. | Properti | Deskripsi | | --- | --- | | hbase-master-opts | Pilihan yang mengontrol bagaimana JVM menjalankan daemon master. Jika diatur, ini menimpa variabel default HBASE\$1MASTER\$1OPTS. | | regionserver-opts | Pilihan yang mengontrol bagaimana JVM menjalankan daemon server daerah. Jika diatur, ini menimpa variabel HBASE\$1REGIONSERVER\$1OPTS default. | | zookeeper-opts | Pilihan yang mengontrol bagaimana JVM berjalan daemon zookeeper. Jika diatur, ini menimpa variabel HBASE\$1ZOOKEEPER\$1OPTS default. | Untuk informasi selengkapnya tentang opsi ini, lihat [hbase-env.sh](https://hbase.apache.org/book.html#hbase.env.sh) di HBase dokumentasi. Sebuah tindakan bootstrap untuk mengkonfigurasi nilai-nilai untuk `zookeeper-opts` dan `hbase-master-opts` ditunjukkan dalam contoh berikut. **catatan** Karakter kelanjutan baris Linux (\$1) disertakan untuk memudahkan pembacaan. Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Test cluster" --ami-version 3.3 \ --applications Name=Hue Name=Hive Name=Pig Name=HBase \ --use-default-roles --ec2-attributes KeyName=myKey \ --instance-type c1.xlarge --instance-count 3 --termination-protected \ --bootstrap-actions Path=s3://elasticmapreduce/bootstrap-actions/configure-hbase-daemons,\ Args=["--hbase-zookeeper-opts=-Xmx1024m -XX:GCTimeRatio=19","--hbase-master-opts=-Xmx2048m","--hbase-regionserver-opts=-Xmx4096m"] ``` ### Konfigurasikan pengaturan HBase situs Amazon EMR menyediakan tindakan bootstrap,`s3://elasticmapreduce/bootstrap-actions/configure-hbase`, yang dapat Anda gunakan untuk mengubah konfigurasi. HBase Anda dapat mengatur nilai konfigurasi one-by-one, sebagai argumen dalam tindakan bootstrap, atau Anda dapat menentukan lokasi file konfigurasi XMLdi Amazon S3. Pengaturan nilai konfigurasi one-by-one berguna jika Anda hanya perlu mengatur beberapa pengaturan konfigurasi. Pengaturan mereka menggunakan file XML berguna jika Anda memiliki banyak perubahan untuk membuat, atau jika Anda ingin menyimpan pengaturan konfigurasi Anda untuk digunakan kembali. **catatan** Anda dapat mengawali nama bucket Amazon S3 dengan awalan wilayah, `s3://region.elasticmapreduce/bootstrap-actions/configure-hbase` seperti, *region* di mana wilayah tempat Anda meluncurkan klaster. HBase Tindakan bootstrap ini memodifikasi file `/home/hadoop/conf/hbase-site.xml` konfigurasi pada HBase cluster. Tindakan bootstrap hanya dapat dijalankan ketika HBase cluster diluncurkan. Untuk informasi selengkapnya tentang setelan HBase situs yang dapat Anda konfigurasikan, lihat [Konfigurasi default](http://hbase.apache.org/book.html#config.files) dalam HBase dokumentasi. Atur tindakan `configure-hbase` bootstrap saat Anda meluncurkan HBase cluster dan tentukan nilai `hbase-site.xml` yang akan diubah. **Untuk menentukan pengaturan HBase situs individual menggunakan AWS CLI** + Untuk mengubah `hbase.hregion.max.filesize` pengaturan, ketik perintah berikut dan ganti *myKey* dengan nama key pair Amazon EC2 Anda. **catatan** Karakter lanjutan baris Linux (\$1) disertakan agar mudah dibaca Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Test cluster" --ami-version 3.3 \ --applications Name=Hue Name=Hive Name=Pig Name=HBase \ --use-default-roles --ec2-attributes KeyName=myKey \ --instance-type c1.xlarge --instance-count 3 --termination-protected \ --bootstrap-actions Path=s3://elasticmapreduce/bootstrap-actions/configure-hbase,Args=["-s","hbase.hregion.max.filesize=52428800"] ``` **Untuk menentukan pengaturan HBase situs dengan file XMLmenggunakan AWS CLI** 1. Buat versi khusus `hbase-site.xml`. File kustom Anda harus XML yang valid. Untuk mengurangi kemungkinan terjadinya kesalahan, mulailah dengan salinan default`hbase-site.xml`, yang terletak di simpul HBase master EMR Amazon di`/home/hadoop/conf/hbase-site.xml`, dan edit salinan file itu alih-alih membuat file dari awal. Anda dapat memberikan nama baru pada file baru, atau meninggalkannya sebagai `hbase-site.xml`. 1. Unggah file pembuangan `hbase-site.xml` ke bucket Amazon S3 Anda. Itu harus memiliki izin yang ditetapkan sehingga AWS akun yang meluncurkan cluster dapat mengakses file. Jika AWS akun yang meluncurkan cluster juga memiliki bucket Amazon S3, ia memiliki akses. 1. Atur tindakan bootstrap **configurre-hbase** saat Anda meluncurkan HBase cluster, dan sertakan lokasi file kustom Anda. `hbase-site.xml` Contoh berikut menetapkan nilai konfigurasi HBase situs untuk yang ditentukan dalam file`s3://amzn-s3-demo-bucket/my-hbase-site.xml`. Ketik perintah berikut, ganti *myKey* dengan nama key pair EC2 Anda, dan ganti *amzn-s3-demo-bucket* dengan nama bucket Amazon S3 Anda. **catatan** Karakter lanjutan baris Linux (\$1) disertakan agar mudah dibaca Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Test cluster" --ami-version 3.3 \ --applications Name=Hue Name=Hive Name=Pig Name=HBase \ --use-default-roles --ec2-attributes KeyName=myKey \ --instance-type c1.xlarge --instance-count 3 --termination-protected \ --bootstrap-actions Path=s3://elasticmapreduce/bootstrap-actions/configure-hbase,Args=["--site-config-file","s3://amzn-s3-demo-bucket/config.xml"] ``` Jika Anda menentukan lebih dari satu opsi untuk menyesuaikan HBase operasi, Anda harus menambahkan setiap pasangan kunci-nilai dengan sakelar `-s` opsi, seperti yang ditunjukkan pada contoh berikut: ``` --bootstrap-actions s3://elasticmapreduce/bootstrap-actions/configure-hbase,Args=["-s","zookeeper.session.timeout=60000"] ``` Dengan set proxy dan koneksi SSH terbuka, Anda dapat melihat HBase UI dengan membuka jendela browser dengan http: //:60010/master-status*master-public-dns-name*, di mana alamat DNS publik *master-public-dns-name* dari node master di cluster. HBase Anda dapat melihat HBase log saat ini dengan menggunakan SSH untuk terhubung ke node master, dan menavigasi ke direktori. `mnt/var/log/hbase` Log ini tidak tersedia setelah klaster dihentikan kecuali Anda mengaktifkan pencatatan ke Amazon S3 ketika klaster diluncurkan. ## Cadangkan dan pulihkan HBase Amazon EMR menyediakan kemampuan untuk mencadangkan HBase data Anda ke Amazon S3, baik secara manual atau pada jadwal otomatis. Anda dapat melakukan backup penuh dan inkremental. Setelah Anda memiliki versi HBase data yang dicadangkan, Anda dapat mengembalikan versi tersebut ke cluster. HBase Anda dapat memulihkan ke HBase klaster yang sedang berjalan, atau meluncurkan klaster baru yang telah diisi sebelumnya dengan data cadangan. Selama proses pencadangan, HBase terus jalankan perintah tulis. Meskipun ini memastikan bahwa cluster Anda tetap tersedia di seluruh cadangan, ada risiko inkonsistensi antara data yang didukung dan operasi tulis dijalankan secara paralel. Untuk memahami ketidakkonsistenan yang mungkin timbul, Anda harus mempertimbangkan bahwa HBase mendistribusikan operasi tulis di seluruh node di klasternya. Jika operasi menulis terjadi setelah node tertentu disurvei, data yang tidak termasuk dalam arsip cadangan. Anda bahkan mungkin menemukan bahwa penulisan sebelumnya ke HBase cluster (dikirim ke node yang telah disurvei) mungkin tidak ada dalam arsip cadangan, sedangkan penulisan nanti (dikirim ke node sebelum disurvei) disertakan. Jika cadangan yang konsisten diperlukan, Anda harus menjeda penulisan HBase selama bagian awal proses pencadangan, sinkronisasi di seluruh node. Anda dapat melakukannya dengan menentukan parameter `--consistent` ketika meminta cadangan. Dengan parameter ini, menulis selama periode ini antri dan dijalankan segera setelah sinkronisasi selesai. Anda juga dapat menjadwalkan pencadangan berulang, yang menyelesaikan inkonsistensi dari waktu ke waktu, karena data yang terlewatkan pada suatu pencadangan akan dicadangkan pada sesi berikutnya. Saat Anda mencadangkan HBase data, Anda harus menentukan direktori cadangan yang berbeda untuk setiap cluster. Cara mudah untuk melakukannya adalah dengan menggunakan pengidentifikasi cluster sebagai bagian dari jalan yang ditentukan untuk direktori cadangan. Misalnya, `s3://amzn-s3-demo-bucket/backups/j-3AEXXXXXX16F2`. Ini memastikan bahwa setiap backup incremental future mengacu pada cluster yang benar. HBase Ketika Anda siap untuk menghapus file cadangan lama yang tidak lagi diperlukan, kami sarankan Anda terlebih dahulu melakukan backup penuh HBase data Anda. Hal ini memastikan bahwa semua data dipertahankan dan menyediakan dasar untuk backup tambahan masa depan. Setelah backup penuh selesai, Anda dapat menavigasi ke lokasi cadangan dan secara manual menghapus file cadangan lama. Proses HBase pencadangan menggunakan S3 DistCp untuk operasi penyalinan, yang memiliki batasan tertentu mengenai ruang penyimpanan file sementara. ### Cadangkan dan pulihkan HBase menggunakan konsol Konsol menyediakan kemampuan untuk meluncurkan cluster baru dan mengisinya dengan data dari HBase cadangan sebelumnya. Ini juga memberi Anda kemampuan untuk menjadwalkan pencadangan data inkremental secara berkala. HBase Fungsi cadangan dan pemulihan tambahan, seperti kemampuan untuk memulihkan data ke cluster yang sudah berjalan, melakukan backup manual, dan jadwal backup penuh otomatis, tersedia menggunakan CLI. **Untuk mengisi cluster baru dengan HBase data yang diarsipkan menggunakan konsol** 1. Arahkan ke konsol EMR Amazon baru dan pilih **Beralih ke konsol lama** dari navigasi samping. Untuk informasi selengkapnya tentang apa yang diharapkan saat beralih ke konsol lama, lihat [Menggunakan konsol lama](https://docs.aws.amazon.com/emr/latest/ManagementGuide/whats-new-in-console.html#console-opt-in). 1. Pilih **Buat klaster**. 1. Di bagian **Konfigurasi Perangkat Lunak**, untuk **Aplikasi Tambahan**, pilih **HBase**dan **Konfigurasi dan tambahkan**. 1. Pada **Tambahkan Aplikasi** kotak dialog, periksa **Pulihkan dari Backup**. 1. Untuk **Lokasi Cadangan**, tentukan lokasi cadangan yang akan dimuat ke dalam HBase cluster baru. Ini harus menjadi URL Amazon S3 formulir `s3://amzn-s3-demo-bucket/backups/`. 1. Untuk **Versi Backup**, Anda memiliki pilihan untuk menentukan nama versi cadangan untuk dimuat dengan menetapkan nilai. Jika Anda tidak menetapkan nilai untuk **Versi Backup**, Amazon EMR memuat cadangan terbaru di lokasi yang ditentukan. 1. Pilih **Tambahkan** dan lanjutkan untuk membuat cluster dengan pilihan lain seperti yang diinginkan. **Untuk menjadwalkan pencadangan HBase data otomatis menggunakan konsol** 1. Di bagian **Konfigurasi Perangkat Lunak**, untuk **Aplikasi Tambahan**, pilih **HBase**dan **Konfigurasi dan tambahkan**. 1. Pilih **Jadwalkan Backup reguler**. 1. Menentukan apakah backup harus konsisten. Cadangan konsisten adalah salah satu yang berhenti menulis operasi selama tahap cadangan awal, sinkronisasi di node. Setiap operasi tulis sehingga berhenti ditempatkan dalam antrian dan melanjutkan ketika sinkronisasi selesai. 1. Mengatur seberapa sering backup harus terjadi dengan memasukkan nomor untuk **Frekuensi Backup** dan memilih **hari**, **Jam**, atau **Menit**. Cadangan otomatis pertama yang berjalan adalah cadangan penuh; setelah itu, Amazon EMR menyimpan backup tambahan berdasarkan jadwal yang Anda tentukan. 1. Tentukan lokasi di Amazon S3 tempat backup harus disimpan. Setiap HBase cluster harus dicadangkan ke lokasi terpisah di Amazon S3 untuk memastikan bahwa cadangan tambahan dihitung dengan benar. 1. Tentukan kapan cadangan pertama harus terjadi dengan menetapkan nilai untuk **Waktu Mulai Backup**. Anda dapat mengatur ini ke`now`, yang menyebabkan cadangan pertama untuk memulai segera setelah cluster berjalan, atau masukkan tanggal dan waktu di [Format ISO](http://www.w3.org/TR/NOTE-datetime). Sebagai contoh, 2013-09-26T 20:00 Z, menetapkan waktu mulai 26 September 2013 di 20:00 UTC. 1. Pilih **Tambahkan**. 1. Lanjutkan dengan menciptakan cluster dengan pilihan lain seperti yang diinginkan. ## Monitor HBase dengan CloudWatch Amazon EMR melaporkan tiga metrik CloudWatch yang dapat Anda gunakan untuk memantau cadangan Anda. HBase Metrik ini didorong ke CloudWatch interval lima menit, dan disediakan tanpa biaya. | Metrik | Deskripsi | | --- | --- | | HBaseBackupFailed | Apakah cadangan terakhir gagal. Ini diatur ke 0 secara default dan diperbarui ke 1 jika upaya cadangan sebelumnya gagal. Metrik ini hanya dilaporkan untuk HBase cluster. Kasus penggunaan: Pantau HBase cadangan Unit: *Jumlah* | | HBaseMostRecentBackupDuration | Jumlah waktu yang dibutuhkan cadangan sebelumnya untuk menyelesaikan. Metrik ini diatur terlepas dari apakah cadangan terakhir selesai berhasil atau gagal. Saat cadangan sedang berlangsung, metrik ini akan mengembalikan jumlah menit setelah pencadangan dimulai. Metrik ini hanya dilaporkan untuk HBase cluster. Kasus penggunaan: Monitor HBase Backup Unit: *Menit* | | HBaseTimeSinceLastSuccessfulBackup | Jumlah menit berlalu setelah HBase pencadangan terakhir yang berhasil dimulai di cluster Anda. Metrik ini hanya dilaporkan untuk HBase cluster. Kasus penggunaan: Pantau HBase cadangan Unit: *Menit* | ## Konfigurasikan Ganglia untuk HBase Anda mengkonfigurasi Ganglia untuk HBase menggunakan tindakan **configure-hbase-for-ganglia**bootstrap. Tindakan bootstrap ini dikonfigurasi HBase untuk mempublikasikan metrik ke Ganglia. Anda harus mengkonfigurasi HBase dan Ganglia ketika Anda meluncurkan cluster; pelaporan Ganglia tidak dapat ditambahkan ke cluster yang sedang berjalan. Ganglia juga menyimpan file log di server di `/mnt/var/log/ganglia/rrds`. Jika Anda mengonfigurasi kluster Anda untuk menahan file log ke bucket Amazon S3, log file Ganglia akan tetap berada di sana juga. Untuk meluncurkan cluster dengan Ganglia HBase, gunakan tindakan **configure-hbase-for-ganglia**bootstrap seperti yang ditunjukkan pada contoh berikut. **catatan** Karakter lanjutan baris Linux (\$1) disertakan agar mudah dibaca Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Test cluster" --ami-version 3.3 \ --applications Name=Hue Name=Hive Name=Pig Name=HBase Name=Ganglia \ --use-default-roles --ec2-attributes KeyName=myKey \ --instance-type c1.xlarge --instance-count 3 --termination-protected \ --bootstrap-actions Path=s3://elasticmapreduce/bootstrap-actions/configure-hbase-for-ganglia ``` Setelah cluster diluncurkan dengan Ganglia dikonfigurasi, Anda dapat mengakses grafik Ganglia dan laporan menggunakan antarmuka grafis yang berjalan pada node master. # spesifik aplikasi Pig untuk versi AMI sebelumnya dari Amazon EMR ## Versi Pig yang Didukung Versi Pig Anda dapat menambahkan ke cluster Anda tergantung pada versi Amazon EMR AMI dan versi Hadoop Anda gunakan. Tabel di bawah ini menunjukkan versi AMI dan versi Hadoop yang kompatibel dengan versi yang berbeda dari Pig. Kami merekomendasikan menggunakan versi terbaru yang tersedia dari Pig untuk mengambil keuntungan dari peningkatan kinerja dan fungsionalitas baru. Saat Anda menggunakan API untuk menginstal Pig, versi default digunakan kecuali Anda menentukan `--pig-versions` sebagai argumen untuk langkah yang memuat Pig ke cluster selama panggilan ke [RunJobFlow](https://docs.aws.amazon.com/ElasticMapReduce/latest/API/API_RunJobFlow.html). | Versi Pig | Versi AMI | Parameter konfigurasi | Rincian versi Pig | | --- | --- | --- | --- | | 0.12.0[Catatan rilis](http://pig.apache.org/releases.html#14+October%2C+2013%3A+release+0.12.0+available)[Dokumentasi](http://pig.apache.org/docs/r0.12.0/) | 3.1.0 dan versi yang lebih baru | `--ami-version 3.1` `--ami-version 3.2` `--ami-version 3.3` | Menambahkan dukungan untuk hal berikut: [\[See the AWS documentation website for more details\]](http://docs.aws.amazon.com/id_id/emr/latest/ReleaseGuide/emr-3x-pig.html) | | 0.11.1.1[Catatan rilis](http://pig.apache.org/releases.html#1+April%2C+2013%3A+release+0.11.1+available)[Dokumentasi](http://pig.apache.org/docs/r0.11.1/) | 2.2 dan versi yang lebih baru | `--pig-versions 0.11.1.1` `--ami-version 2.2` | Meningkatkan kinerja perintah LOAD dengan PigStorage jika input berada di Amazon S3. | | 0.11.1[Catatan rilis](http://pig.apache.org/releases.html#1+April%2C+2013%3A+release+0.11.1+available)[Dokumentasi](http://pig.apache.org/docs/r0.11.1/) | 2.2 dan versi yang lebih baru | `--pig-versions 0.11.1` `--ami-version 2.2` | Menambahkan dukungan untuk JDK 7, Hadoop 2, fungsi yang ditentukan pengguna Groovy, optimasi, operator baru, SchemaTuple dan banyak lagi. Untuk informasi selengkapnya, lihat [Pig 0.11.1 log perubahan](http://svn.apache.org/repos/asf/pig/tags/release-0.11.1/CHANGES.txt). | | 0.9.2.2[Catatan rilis](http://pig.apache.org/releases.html#22+January%2C+2012%3A+release+0.9.2+available)[Dokumentasi](http://pig.apache.org/docs/r0.9.2/index.html) | 2.2 dan versi yang lebih baru | `--pig-versions 0.9.2.2` `--ami-version 2.2` | Menambahkan dukungan untuk Hadoop 1.0.3. | | 0.9.2.1[Catatan rilis](http://pig.apache.org/releases.html#22+January%2C+2012%3A+release+0.9.2+available)[Dokumentasi](http://pig.apache.org/docs/r0.9.2/index.html) | 2.2 dan versi yang lebih baru | `--pig-versions 0.9.2.1` `--ami-version 2.2` | Menambahkan dukungan untuk MapR. | | 0.9.2[Catatan rilis](http://pig.apache.org/releases.html#22+January%2C+2012%3A+release+0.9.2+available)[Dokumentasi](http://pig.apache.org/docs/r0.9.2/index.html) | 2.2 dan versi yang lebih baru | `--pig-versions 0.9.2` `--ami-version 2.2` | Termasuk beberapa peningkatan kinerja dan perbaikan bug. Untuk informasi lengkap tentang perubahan untuk Pig 0.9.2, pergi ke [Pig 0.9.2 perubahan log](http://svn.apache.org/repos/asf/pig/tags/release-0.9.2/CHANGES.txt). | | 0.9.1[Catatan rilis](http://pig.apache.org/releases.html#5+October%2C+2011%3A+release+0.9.1+available)[Dokumentasi](http://pig.apache.org/docs/r0.9.1/) | 2.0 | `--pig-versions 0.9.1` `--ami-version 2.0` | | 0,6[Catatan rilis](http://pig.apache.org/releases.html#1+March%2C+2010%3A+release+0.6.0+available) | 1.0 | `--pig-versions 0.6` `--ami-version 1.0` | | 0,3[Catatan rilis](http://pig.apache.org/releases.html#25+June%2C+2009%3A+release+0.3.0+available) | 1.0 | `--pig-versions 0.3` `--ami-version 1.0` | ## Rincian versi Pig Amazon EMR mendukung rilis Pig tertentu yang mungkin memiliki tambahan Amazon EMR patch diterapkan. Anda dapat mengkonfigurasi versi Pig untuk berjalan pada cluster Amazon EMR. Untuk informasi selengkapnya tentang cara melakukan ini, lihat [Apache Pig](emr-pig.md). Bagian berikut menjelaskan versi Pig yang berbeda dan patch diterapkan pada versi dimuat di Amazon EMR. ### Patch Pig Bagian ini menjelaskan patch kustom yang diterapkan ke versi Pig yang tersedia dengan Amazon EMR. #### Pig 0.11.1.1 patch Versi Amazon EMR dari Pig 0.11.1.1 adalah rilis pemeliharaan yang meningkatkan kinerja perintah LOAD dengan PigStorage jika input berada di Amazon S3. #### Pig 0.11.1 patch Versi Amazon EMR dari Pig 0.11.1 berisi semua pembaruan yang disediakan oleh Apache Software Foundation dan kumulatif patch Amazon EMR dari Pig versi 0.9.2.2. Namun, tidak ada patch khusus Amazon EMR baru di Pig 0.11.1. #### Pig 0,9.2 patch Apache Pig 0.9.2 adalah rilis pemeliharaan Pig. Tim Amazon EMR telah menerapkan patch berikut untuk versi Amazon EMR dari Pig 0.9.2. | Patch | Deskripsi | | --- | --- | | Pig-1429 | Tambahkan tipe data Boolean untuk Pig sebagai tipe data kelas pertama. Untuk informasi lebih lanjut, kunjungi [https://issues.apache. org/jira/browse/PIG-1429](https://issues.apache.org/jira/browse/PIG-1429). **Status:** Diterapkan **Diperbaiki di Apache Pig Versi:** 0.10 | | Pig-1824 | Support modul impor di Jython UDF. Untuk informasi lebih lanjut, kunjungi [https://issues.apache. org/jira/browse/PIG-1824](https://issues.apache.org/jira/browse/PIG-1824). **Status:** Diterapkan **Diperbaiki di Apache Pig Versi:** 0.10 | | Pig-2010 | Bundel terdaftar JARs pada cache terdistribusi. Untuk informasi lebih lanjut, kunjungi [https://issues.apache. org/jira/browse/PIG-2010](https://issues.apache.org/jira/browse/PIG-2010). **Status:** Diterapkan **Diperbaiki di Apache Pig Versi:** 0.11 | | Pig-2456 | Tambahkan \$1 /.pigbootup file di mana pengguna dapat menentukan laporan Pig default. Untuk informasi lebih lanjut, kunjungi [https://issues.apache. org/jira/browse/PIG-2456](https://issues.apache.org/jira/browse/PIG-2456). **Status:** Diterapkan **Diperbaiki di Apache Pig Versi:** 0.11 | | Pig-2623 | Support menggunakan jalur Amazon S3 untuk mendaftar. UDFs Untuk informasi lebih lanjut, kunjungi [https://issues.apache. org/jira/browse/PIG-2623](https://issues.apache.org/jira/browse/PIG-2623). **Status:** Diterapkan **Diperbaiki di Apache Pig Versi:** 0.10, 0.11 | #### Pig 0,9.1 patch Tim Amazon EMR telah menerapkan patch berikut untuk versi Amazon EMR Pig 0.9.1. | Patch | Deskripsi | | --- | --- | | Support file JAR dan script Pig di dfs | Menambahkan dukungan untuk menjalankan script dan mendaftarkan file JAR disimpan dalam HDFS, Amazon S3, atau sistem file terdistribusi lainnya. Untuk informasi lebih lanjut, kunjungi [https://issues.apache. org/jira/browse/PIG-1505](https://issues.apache.org/jira/browse/PIG-1505). **Status:** Diterapkan **Diperbaiki di Apache Pig Versi:** 0.8.0 | | Support beberapa sistem file di Pig | Tambahkan dukungan untuk skrip Pig untuk membaca data dari satu sistem file dan menuliskannya ke yang lain. Untuk informasi lebih lanjut, kunjungi [https://issues.apache. org/jira/browse/PIG-1564](https://issues.apache.org/jira/browse/PIG-1564). **Status:** Tidak Diterapkan **Diperbaiki di Apache Pig Versi:** tidak berlaku | | Tambahkan datetime dan string Piggybank UDFs | Tambahkan datetime dan string UDFs untuk mendukung skrip Pig kustom. Untuk informasi lebih lanjut, kunjungi [https://issues.apache. org/jira/browse/PIG-1565](https://issues.apache.org/jira/browse/PIG-1565). **Status:** Tidak Diterapkan **Diperbaiki di Apache Pig Versi:** tidak berlaku | ## Interaktif dan kluster Pig batch Amazon EMR memungkinkan Anda untuk menjalankan skrip Pig dalam dua mode: + Interaktif + Batch Saat Anda meluncurkan cluster yang berjalan lama menggunakan konsol atau AWS CLI, Anda dapat terhubung menggunakan **ssh** ke node master sebagai pengguna Hadoop dan menggunakan shell Grunt untuk mengembangkan dan menjalankan skrip Pig Anda secara interaktif. Menggunakan Pig interaktif memungkinkan Anda untuk merevisi script Pig lebih mudah dari modus batch. Setelah Anda berhasil merevisi script Pig dalam mode interaktif, Anda dapat meng-upload script ke Amazon S3 dan menggunakan modus batch untuk menjalankan script dalam produksi. Anda juga dapat mengirimkan perintah Pig interaktif pada cluster berjalan untuk menganalisis dan mengubah data yang diperlukan. Dalam modus batch, Anda meng-upload script Pig Anda ke Amazon S3, dan kemudian mengirimkan pekerjaan ke cluster sebagai langkah. Langkah Pig dapat diserahkan ke cluster berjalan lama atau cluster sementara. # Spark spesifik aplikasi dengan versi AMI sebelumnya dari Amazon EMR ## Gunakan Spark secara interaktif atau dalam mode batch Amazon EMR memungkinkan Anda untuk menjalankan aplikasi Spark dalam dua mode: + Interaktif + Batch Saat Anda meluncurkan cluster yang berjalan lama menggunakan konsol atau AWS CLI, Anda dapat terhubung menggunakan SSH ke node master sebagai pengguna Hadoop dan menggunakan shell Spark untuk mengembangkan dan menjalankan aplikasi Spark Anda secara interaktif. Menggunakan Spark interaktif memungkinkan Anda untuk prototipe atau uji aplikasi Spark lebih mudah daripada di lingkungan batch. Setelah Anda berhasil merevisi aplikasi Spark dalam mode interaktif, Anda dapat menempatkan bahwa JAR aplikasi atau program Python dalam sistem file lokal ke node master cluster di Amazon S3. Anda kemudian dapat mengirimkan aplikasi sebagai alur kerja batch. Dalam modus batch, meng-upload Spark script untuk Amazon S3 atau sistem file node master lokal, dan kemudian mengirimkan pekerjaan ke cluster sebagai langkah. Langkah percikan dapat diserahkan ke cluster berjalan lama atau cluster sementara. ## Membuat cluster dengan Spark diinstal **Untuk melancarkan kluster dengan Spark dipasang menggunakan konsol** 1. Arahkan ke konsol EMR Amazon baru dan pilih **Beralih ke konsol lama** dari navigasi samping. Untuk informasi selengkapnya tentang apa yang diharapkan saat beralih ke konsol lama, lihat [Menggunakan konsol lama](https://docs.aws.amazon.com/emr/latest/ManagementGuide/whats-new-in-console.html#console-opt-in). 1. Pilih **Buat kluster**. 1. Untuk **Pengaturan perangkat lunak**, pilih versi rilis AMI yang Anda butuhkan. 1. Untuk **Aplikasi yang akan dipasang** Pilih **Spark** dari daftar, lalu pilih **Konfigurasikan dan tambahkan**. 1. Menambahkan argumen untuk mengubah konfigurasi Spark seperti yang diinginkan. Untuk informasi selengkapnya, lihat [Konfigurasi Spark](#emr-3x-spark-configure). Pilih **Tambahkan**. 1. Pilih opsi lain yang diperlukan, lalu pilih **Buat kluster**. Contoh berikut menunjukkan cara membuat klaster dengan Spark menggunakan Java: ``` AmazonElasticMapReduceClient emr = new AmazonElasticMapReduceClient(credentials); SupportedProductConfig sparkConfig = new SupportedProductConfig() .withName("Spark"); RunJobFlowRequest request = new RunJobFlowRequest() .withName("Spark Cluster") .withAmiVersion("3.11.0") .withNewSupportedProducts(sparkConfig) .withInstances(new JobFlowInstancesConfig() .withEc2KeyName("myKeyName") .withInstanceCount(1) .withKeepJobFlowAliveWhenNoSteps(true) .withMasterInstanceType("m3.xlarge") .withSlaveInstanceType("m3.xlarge") ); RunJobFlowResult result = emr.runJobFlow(request); ``` ## Konfigurasi Spark Anda mengonfigurasi Spark saat membuat cluster dengan menjalankan aksi bootstrap yang terletak di [awslabs/emr-bootstrap-actions/sparkrepositori di Github](https://github.com/awslabs/emr-bootstrap-actions/tree/master/spark). Untuk argumen bahwa tindakan bootstrap menerima, lihat [README](https://github.com/aws-samples/emr-bootstrap-actions/blob/master/spark/examples/README.md) dalam repositori itu. Tindakan bootstrap mengkonfigurasi properti di `$SPARK_CONF_DIR/spark-defaults.conf` file. Untuk informasi lebih lanjut tentang pengaturan, lihat topik Spark Konfigurasi dalam dokumentasi Spark. Anda dapat mengganti “terbaru” di URL berikut dengan nomor versi Spark yang Anda instal, misalnya, `2.2.0` [http://spark.apache.org/docs/latest/configuration.html](http://spark.apache.org/docs/latest/configuration.html). Anda juga dapat mengkonfigurasi Spark dinamis pada saat setiap pengajuan aplikasi. Pengaturan untuk secara otomatis memaksimalkan alokasi sumber daya untuk pelaksana tersedia menggunakan `spark` File konfigurasi. Untuk informasi selengkapnya, lihat [Menimpa pengaturan konfigurasi default Spark](#emr-3x-spark-dynamic-configuration). ### Mengubah pengaturan default Spark Contoh berikut menunjukkan cara membuat klaster dengan `spark.executor.memory` diatur ke 2G menggunakan AWS CLI. **catatan** Karakter lanjutan baris Linux (\$1) disertakan agar mudah dibaca Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr create-cluster --name "Spark cluster" --ami-version 3.11.0 \ --applications Name=Spark, Args=[-d,spark.executor.memory=2G] --ec2-attributes KeyName=myKey \ --instance-type m3.xlarge --instance-count 3 --use-default-roles ``` ### Kirim pekerjaan ke Spark Untuk mengirimkan pekerjaan ke sebuah cluster, gunakan langkah untuk menjalankan `spark-submit` pada cluster EMR Anda. Tambahkan langkah menggunakan `addJobFlowSteps` metode di [AmazonElasticMapReduceClient](https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/elasticmapreduce/AmazonElasticMapReduceClient.html): ``` AWSCredentials credentials = new BasicAWSCredentials(accessKey, secretKey); AmazonElasticMapReduceClient emr = new AmazonElasticMapReduceClient(credentials); StepFactory stepFactory = new StepFactory(); AddJobFlowStepsRequest req = new AddJobFlowStepsRequest(); req.withJobFlowId("j-1K48XXXXXXHCB"); List stepConfigs = new ArrayList(); StepConfig sparkStep = new StepConfig() .withName("Spark Step") .withActionOnFailure("CONTINUE") .withHadoopJarStep(stepFactory.newScriptRunnerStep("/home/hadoop/spark/bin/spark-submit","--class","org.apache.spark.examples.SparkPi","/home/hadoop/spark/lib/spark-examples-1.3.1-hadoop2.4.0.jar","10")); stepConfigs.add(sparkStep); req.withSteps(stepConfigs); AddJobFlowStepsResult result = emr.addJobFlowSteps(req); ``` ### Menimpa pengaturan konfigurasi default Spark Anda mungkin ingin menimpa Spark nilai konfigurasi default secara per aplikasi. Anda dapat melakukan ini ketika Anda mengirimkan aplikasi menggunakan langkah, yang pada dasarnya melewati opsi untuk `spark-submit`. Misalnya, Anda mungkin ingin mengubah memori yang dialokasikan untuk proses pelaksana dengan mengubah `spark.executor.memory`. Anda dapat menyediakan `--executor-memory` beralih dengan argumen seperti berikut: ``` /home/hadoop/spark/bin/spark-submit --executor-memory 1g --class org.apache.spark.examples.SparkPi /home/hadoop/spark/lib/spark-examples*.jar 10 ``` Demikian pula, Anda dapat menyetel `--executor-cores` dan `--driver-memory`. Dalam satu langkah, Anda akan memberikan argumen berikut untuk langkah: ``` --executor-memory 1g --class org.apache.spark.examples.SparkPi /home/hadoop/spark/lib/spark-examples*.jar 10 ``` Anda juga dapat menyetel pengaturan yang mungkin tidak memiliki sakelar bawaan menggunakan `--conf` Pilihan. Untuk informasi selengkapnya tentang pengaturan lain yang merdu, lihat [Dinamis memuat properti Spark](https://spark.apache.org/docs/latest/configuration.html#dynamically-loading-spark-properties) topik dalam dokumentasi Apache Spark. # Perbedaan DistCp utilitas S3 dengan versi AMI sebelumnya dari Amazon EMR ## DistCp Versi S3 didukung di Amazon EMR DistCp Versi S3 berikut didukung dalam rilis Amazon EMR AMI. DistCpVersi S3 setelah 1.0.7 ditemukan langsung di cluster. Gunakan JAR di `/home/hadoop/lib` untuk fitur terbaru. | Versi | Deskripsi | Tanggal rilis | | --- | --- | --- | | 1.0.8 | Menambahkan --appendToLastFile, --requirePreviousManifest, dan --storageClass Pilihan. | 3 Januari 2014 | | 1.0.7 | Menambahkan opsi --s3ServerSideEncryption. | 2 Mei 2013 | | 1.0.6 | Menambahkan opsi --s3Endpoint. | 6 Agustus 2012 | | 1.0.5 | Meningkatkan kemampuan untuk menentukan versi S3 mana yang DistCp akan dijalankan. | 27 Juni 2012 | | 1.0.4 | Meningkatkan --deleteOnSuccess Pilihan. | 19 Juni 2012 | | 1.0.3 | Menambahkan dukungan untuk --numberFiles dan --startingIndex Pilihan. | 12 Juni 2012 | | 1.0.2 | Meningkatkan penamaan file saat menggunakan grup. | 6 Juni 2012 | | 1.0.1 | Rilis awal S3DistCp. | 19 Januari 2012 | ## Tambahkan langkah DistCp penyalinan S3 ke cluster Untuk menambahkan langkah DistCp penyalinan S3 ke cluster yang sedang berjalan, ketik perintah berikut, ganti *j-3GYXXXXXX9IOK* dengan ID klaster, dan ganti *amzn-s3-demo-bucket* dengan nama bucket Amazon S3. **catatan** Karakter lanjutan baris Linux (\$1) disertakan agar mudah dibaca Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr add-steps --cluster-id j-3GYXXXXXX9IOK \ --steps Type=CUSTOM_JAR,Name="S3DistCp step",Jar=/home/hadoop/lib/emr-s3distcp-1.0.jar,\ Args=["--s3Endpoint,s3-eu-west-1.amazonaws.com",\ "--src,s3://amzn-s3-demo-bucket/logs/j-3GYXXXXXX9IOJ/node/",\ "--dest,hdfs:///output",\ "--srcPattern,.*[a-zA-Z,]+"] ``` **Example Muat CloudFront log Amazon ke HDFS** Contoh ini memuat CloudFront log Amazon ke HDFS dengan menambahkan langkah ke cluster yang sedang berjalan. Dalam prosesnya, itu mengubah format kompresi dari Gzip ( CloudFrontdefault) ke LZO. Hal ini berguna karena data yang dikompresi menggunakan LZO dapat dibagi menjadi beberapa peta karena didekompresi, sehingga Anda tidak perlu menunggu sampai kompresi selesai, seperti yang Anda lakukan dengan Gzip. Ini memberikan kinerja yang lebih baik ketika Anda menganalisis data menggunakan Amazon EMR. Contoh ini juga meningkatkan kinerja dengan menggunakan ekspresi reguler yang ditentukan dalam `--groupBy` pilihan untuk menggabungkan semua log untuk jam tertentu ke dalam satu file. Kluster Amazon EMR lebih efisien ketika memproses beberapa, besar, file LZO terkompresi daripada ketika memproses banyak, kecil, file terkompresi GZIP. Untuk membagi file LZO, Anda harus mengindeks mereka dan menggunakan perpustakaan pihak ketiga hadoop-lzo. Untuk memuat CloudFront log Amazon ke HDFS, ketik perintah berikut, ganti *j-3GYXXXXXX9IOK* dengan ID cluster Anda, dan ganti *amzn-s3-demo-bucket* dengan nama bucket Amazon S3 Anda. Karakter lanjutan baris Linux (\$1) disertakan agar mudah dibaca Karakter ini bisa dihapus atau digunakan dalam perintah Linux. Untuk Windows, hapus atau ganti dengan tanda sisipan (^). ``` aws emr add-steps --cluster-id j-3GYXXXXXX9IOK \ --steps Type=CUSTOM_JAR,Name="S3DistCp step",Jar=/home/hadoop/lib/emr-s3distcp-1.0.jar,\ Args=["--src,s3://amzn-s3-demo-bucket/cf","--dest,hdfs:///local",\ "--groupBy,.*XABCD12345678.([0-9]+-[0-9]+-[0-9]+-[0-9]+).*",\ "--targetSize,128", "--outputCodec,lzo","--deleteOnSuccess"] ``` Pertimbangkan kasus di mana contoh sebelumnya dijalankan di atas file CloudFront log berikut. ``` s3://amzn-s3-demo-bucket/cf/XABCD12345678.2012-02-23-01.HLUS3JKx.gz s3://amzn-s3-demo-bucket/cf/XABCD12345678.2012-02-23-01.I9CNAZrg.gz s3://amzn-s3-demo-bucket/cf/XABCD12345678.2012-02-23-02.YRRwERSA.gz s3://amzn-s3-demo-bucket/cf/XABCD12345678.2012-02-23-02.dshVLXFE.gz s3://amzn-s3-demo-bucket/cf/XABCD12345678.2012-02-23-02.LpLfuShd.gz ``` S3 DistCp menyalin, menggabungkan, dan mengompres file ke dalam dua file berikut, di mana nama file ditentukan oleh kecocokan yang dibuat oleh ekspresi reguler. ``` hdfs:///local/2012-02-23-01.lzo hdfs:///local/2012-02-23-02.lzo ```