Classification

class aws_cdk.aws_stepfunctions_tasks.Classification(classification_statement)

Bases: object

The classification within a EMR Containers application configuration.

Class can be extended to add other classifications. For example, new Classification(‘xxx-yyy’);

ExampleMetadata:: infused

Example:

tasks.EmrContainersStartJobRun(self, "EMR Containers Start Job Run",
    virtual_cluster=tasks.VirtualClusterInput.from_virtual_cluster_id("de92jdei2910fwedz"),
    release_label=tasks.ReleaseLabel.EMR_6_2_0,
    job_name="EMR-Containers-Job",
    job_driver=tasks.JobDriver(
        spark_submit_job_driver=tasks.SparkSubmitJobDriver(
            entry_point=sfn.TaskInput.from_text("local:///usr/lib/spark/examples/src/main/python/pi.py")
        )
    ),
    application_config=[tasks.ApplicationConfiguration(
        classification=tasks.Classification.SPARK_DEFAULTS,
        properties={
            "spark.executor.instances": "1",
            "spark.executor.memory": "512M"
        }
    )]
)

Creates a new Classification.

Parameters:: classification_statement (str) – A literal string in case a new EMR classification is released, if not already defined.

Attributes

SPARK = <aws_cdk.aws_stepfunctions_tasks.Classification object>

SPARK_DEFAULTS = <aws_cdk.aws_stepfunctions_tasks.Classification object>

SPARK_ENV = <aws_cdk.aws_stepfunctions_tasks.Classification object>

SPARK_HIVE_SITE = <aws_cdk.aws_stepfunctions_tasks.Classification object>

SPARK_LOG4_J = <aws_cdk.aws_stepfunctions_tasks.Classification object>

SPARK_METRICS = <aws_cdk.aws_stepfunctions_tasks.Classification object>

classification_statement: A literal string in case a new EMR classification is released, if not already defined.