Amazon EMR on EKS 6.3.0 releases - Amazon EMR

Amazon EMR on EKS 6.3.0 releases

The following Amazon EMR 6.3.0 releases are available for Amazon EMR on EKS. Select a specific emr-6.3.0-XXXX release to view more details such as the related container image tag.

Release notes for Amazon EMR 6.3.0

  • New features ‐ Beginning with Amazon EMR 6.3.0 in the 6.x release series, Amazon EMR on EKS supports Spark’s pod template feature. You can also turn on the Spark event log rotation feature for Amazon EMR on EKS. For more information, see Using pod templates and Using Spark event log rotation.

  • Supported applications ‐ Spark 3.1.1-amzn-0, Jupyter Enterprise Gateway (endpoints, public preview).

  • Supported components ‐ aws-hm-client (Glue connector), aws-sagemaker-spark-sdk, emr-s3-select, emrfs, emr-ddb, hudi-spark.

  • Supported configuration classifications:

    Classifications Descriptions

    core-site

    Change values in Hadoop’s core-site.xml file.

    emrfs-site

    Change EMRFS settings.

    spark-metrics

    Change values in Spark's metrics.properties file.

    spark-defaults

    Change values in Spark's spark-defaults.conf file.

    spark-env

    Change values in the Spark environment.

    spark-hive-site

    Change values in Spark's hive-site.xml file.

    spark-log4j

    Change values in Spark's log4j.properties file.

    Configuration classifications allow you to customize applications. These often correspond to a configuration XML file for the application, such as spark-hive-site.xml. For more information, see Configuring Applications.