Class PySparkFlexEtlJobProps.Jsii$Proxy
- All Implemented Interfaces:
JobProps,PySparkFlexEtlJobProps,SparkJobProps,software.amazon.jsii.JsiiSerializable
- Enclosing interface:
PySparkFlexEtlJobProps
PySparkFlexEtlJobProps-
Nested Class Summary
Nested classes/interfaces inherited from class software.amazon.jsii.JsiiObject
software.amazon.jsii.JsiiObject.InitializationModeNested classes/interfaces inherited from interface software.amazon.awscdk.services.glue.alpha.PySparkFlexEtlJobProps
PySparkFlexEtlJobProps.Builder, PySparkFlexEtlJobProps.Jsii$Proxy -
Constructor Summary
ConstructorsModifierConstructorDescriptionprotectedJsii$Proxy(PySparkFlexEtlJobProps.Builder builder) Constructor that initializes the object based on literal property values passed by thePySparkFlexEtlJobProps.Builder.protectedJsii$Proxy(software.amazon.jsii.JsiiObjectRef objRef) Constructor that initializes the object based on values retrieved from the JsiiObject. -
Method Summary
Modifier and TypeMethodDescriptioncom.fasterxml.jackson.databind.JsonNodefinal booleanfinal List<IConnection> (experimental) Connections (optional) List of connections to use for this Glue job Connections are used to connect to other AWS Service or resources within a VPC.final ContinuousLoggingProps(experimental) Enables continuous logging with the specified props.(experimental) Default Arguments (optional) The default arguments for every run of this Glue job, specified as name-value pairs.final String(experimental) Description (optional) Developer-specified description of the Glue job.final Boolean(experimental) Enable profiling metrics for the Glue job.final Boolean(experimental) Enable observability metrics for the Glue job.final Boolean(experimental) Enables the collection of metrics for job profiling.(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.(experimental) Extra Jars S3 URL (optional) S3 URL where additional jar dependencies are located.final Boolean(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.(experimental) Extra Python Files S3 URL (optional) S3 URL where additional python dependencies are located.final GlueVersion(experimental) Glue Version The version of Glue to use to execute this job.final String(experimental) Name of the Glue job (optional) Developer-specified name of the Glue job.final Number(experimental) Max Concurrent Runs (optional) The maximum number of runs this Glue job can concurrently run.final Number(experimental) Max Retries (optional) Maximum number of retry attempts Glue performs if the job fails.final Duration(experimental) Specifies configuration properties of a notification (optional).final Number(experimental) Number of Workers (optional) Number of workers for Glue to use during job execution.final IRolegetRole()(experimental) IAM Role (required) IAM Role to use for Glue job execution Must be specified by the developer because the L2 doesn't have visibility into the actions the script(s) takes during the job execution The role must trust the Glue service principal (glue.amazonaws.com) and be granted sufficient permissions.final Code(experimental) Script Code Location (required) Script to run when the Glue job executes.final ISecurityConfiguration(experimental) Security Configuration (optional) Defines the encryption options for the Glue job.final SparkUIProps(experimental) Enables the Spark UI debugging and monitoring with the specified props.getTags()(experimental) Tags (optional) A list of key:value pairs of tags to apply to this Glue job resources.final Duration(experimental) Timeout (optional) The maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status.final WorkerType(experimental) Worker Type (optional) Type of Worker for Glue to use during job execution Enum options: Standard, G_1X, G_2X, G_025X.final inthashCode()Methods inherited from class software.amazon.jsii.JsiiObject
jsiiAsyncCall, jsiiAsyncCall, jsiiCall, jsiiCall, jsiiGet, jsiiGet, jsiiSet, jsiiStaticCall, jsiiStaticCall, jsiiStaticGet, jsiiStaticGet, jsiiStaticSet, jsiiStaticSet
-
Constructor Details
-
Jsii$Proxy
protected Jsii$Proxy(software.amazon.jsii.JsiiObjectRef objRef) Constructor that initializes the object based on values retrieved from the JsiiObject.- Parameters:
objRef- Reference to the JSII managed object.
-
Jsii$Proxy
Constructor that initializes the object based on literal property values passed by thePySparkFlexEtlJobProps.Builder.
-
-
Method Details
-
getExtraFiles
Description copied from interface:PySparkFlexEtlJobProps(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.Default: - no extra files specified.
- Specified by:
getExtraFilesin interfacePySparkFlexEtlJobProps- See Also:
-
getExtraJars
Description copied from interface:PySparkFlexEtlJobProps(experimental) Extra Jars S3 URL (optional) S3 URL where additional jar dependencies are located.Default: - no extra jar files
- Specified by:
getExtraJarsin interfacePySparkFlexEtlJobProps
-
getExtraJarsFirst
Description copied from interface:PySparkFlexEtlJobProps(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.Default: false - priority is not given to user-provided jars
- Specified by:
getExtraJarsFirstin interfacePySparkFlexEtlJobProps- See Also:
-
getExtraPythonFiles
Description copied from interface:PySparkFlexEtlJobProps(experimental) Extra Python Files S3 URL (optional) S3 URL where additional python dependencies are located.Default: - no extra files
- Specified by:
getExtraPythonFilesin interfacePySparkFlexEtlJobProps
-
getNotifyDelayAfter
Description copied from interface:PySparkFlexEtlJobProps(experimental) Specifies configuration properties of a notification (optional).After a job run starts, the number of minutes to wait before sending a job run delay notification.
Default: - undefined
- Specified by:
getNotifyDelayAfterin interfacePySparkFlexEtlJobProps
-
getEnableMetrics
Description copied from interface:SparkJobProps(experimental) Enable profiling metrics for the Glue job.When enabled, adds '--enable-metrics' to job arguments.
Default: true
- Specified by:
getEnableMetricsin interfaceSparkJobProps
-
getEnableObservabilityMetrics
Description copied from interface:SparkJobProps(experimental) Enable observability metrics for the Glue job.When enabled, adds '--enable-observability-metrics': 'true' to job arguments.
Default: true
- Specified by:
getEnableObservabilityMetricsin interfaceSparkJobProps
-
getSparkUI
Description copied from interface:SparkJobProps(experimental) Enables the Spark UI debugging and monitoring with the specified props.Default: - Spark UI debugging and monitoring is disabled.
- Specified by:
getSparkUIin interfaceSparkJobProps- See Also:
-
getRole
Description copied from interface:JobProps(experimental) IAM Role (required) IAM Role to use for Glue job execution Must be specified by the developer because the L2 doesn't have visibility into the actions the script(s) takes during the job execution The role must trust the Glue service principal (glue.amazonaws.com) and be granted sufficient permissions. -
getScript
Description copied from interface:JobProps(experimental) Script Code Location (required) Script to run when the Glue job executes.Can be uploaded from the local directory structure using fromAsset or referenced via S3 location using fromBucket
-
getConnections
Description copied from interface:JobProps(experimental) Connections (optional) List of connections to use for this Glue job Connections are used to connect to other AWS Service or resources within a VPC.Default: [] - no connections are added to the job
- Specified by:
getConnectionsin interfaceJobProps
-
getContinuousLogging
Description copied from interface:JobProps(experimental) Enables continuous logging with the specified props.Default: - continuous logging is enabled.
- Specified by:
getContinuousLoggingin interfaceJobProps- See Also:
-
getDefaultArguments
Description copied from interface:JobProps(experimental) Default Arguments (optional) The default arguments for every run of this Glue job, specified as name-value pairs.Default: - no arguments
- Specified by:
getDefaultArgumentsin interfaceJobProps- See Also:
-
getDescription
Description copied from interface:JobProps(experimental) Description (optional) Developer-specified description of the Glue job.Default: - no value
- Specified by:
getDescriptionin interfaceJobProps
-
getEnableProfilingMetrics
Description copied from interface:JobProps(experimental) Enables the collection of metrics for job profiling.Default: - no profiling metrics emitted.
- Specified by:
getEnableProfilingMetricsin interfaceJobProps- See Also:
-
getGlueVersion
Description copied from interface:JobProps(experimental) Glue Version The version of Glue to use to execute this job.Default: 3.0 for ETL
- Specified by:
getGlueVersionin interfaceJobProps
-
getJobName
Description copied from interface:JobProps(experimental) Name of the Glue job (optional) Developer-specified name of the Glue job.Default: - a name is automatically generated
- Specified by:
getJobNamein interfaceJobProps
-
getMaxConcurrentRuns
Description copied from interface:JobProps(experimental) Max Concurrent Runs (optional) The maximum number of runs this Glue job can concurrently run.An error is returned when this threshold is reached. The maximum value you can specify is controlled by a service limit.
Default: 1
- Specified by:
getMaxConcurrentRunsin interfaceJobProps
-
getMaxRetries
Description copied from interface:JobProps(experimental) Max Retries (optional) Maximum number of retry attempts Glue performs if the job fails.Default: 0
- Specified by:
getMaxRetriesin interfaceJobProps
-
getNumberOfWorkers
Description copied from interface:JobProps(experimental) Number of Workers (optional) Number of workers for Glue to use during job execution.Default: 10
- Specified by:
getNumberOfWorkersin interfaceJobProps
-
getSecurityConfiguration
Description copied from interface:JobProps(experimental) Security Configuration (optional) Defines the encryption options for the Glue job.Default: - no security configuration.
- Specified by:
getSecurityConfigurationin interfaceJobProps
-
getTags
Description copied from interface:JobProps(experimental) Tags (optional) A list of key:value pairs of tags to apply to this Glue job resources.Default: {} - no tags
-
getTimeout
Description copied from interface:JobProps(experimental) Timeout (optional) The maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status.Specified in minutes.
Default: 2880 (2 days for non-streaming)
- Specified by:
getTimeoutin interfaceJobProps
-
getWorkerType
Description copied from interface:JobProps(experimental) Worker Type (optional) Type of Worker for Glue to use during job execution Enum options: Standard, G_1X, G_2X, G_025X.G_4X, G_8X, Z_2X
Default: WorkerType.G_1X
- Specified by:
getWorkerTypein interfaceJobProps
-
$jsii$toJson
@Internal public com.fasterxml.jackson.databind.JsonNode $jsii$toJson()- Specified by:
$jsii$toJsonin interfacesoftware.amazon.jsii.JsiiSerializable
-
equals
-
hashCode
public final int hashCode()
-