Class SparkJob
java.lang.Object
software.amazon.jsii.JsiiObject
software.constructs.Construct
software.amazon.awscdk.Resource
software.amazon.awscdk.services.glue.alpha.JobBase
software.amazon.awscdk.services.glue.alpha.Job
software.amazon.awscdk.services.glue.alpha.SparkJob
- All Implemented Interfaces:
IEnvironmentAware,IResource,IJob,IGrantable,software.amazon.jsii.JsiiSerializable,software.constructs.IConstruct,software.constructs.IDependable
- Direct Known Subclasses:
PySparkEtlJob,PySparkFlexEtlJob,PySparkStreamingJob,ScalaSparkEtlJob,ScalaSparkFlexEtlJob,ScalaSparkStreamingJob
@Generated(value="jsii-pacmak/1.120.0 (build 192dc88)",
date="2025-12-05T22:26:49.952Z")
@Stability(Experimental)
public abstract class SparkJob
extends Job
(experimental) Base class for different types of Spark Jobs.
Example:
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import software.amazon.awscdk.services.glue.alpha.*;
import software.amazon.awscdk.services.iam.*;
Role role;
IJob sparkJob = SparkJob.fromJobAttributes(this, "MySparkJob", JobAttributes.builder()
.jobName("jobName")
// the properties below are optional
.role(role)
.build());
-
Nested Class Summary
Nested classes/interfaces inherited from class software.amazon.jsii.JsiiObject
software.amazon.jsii.JsiiObject.InitializationModeNested classes/interfaces inherited from interface software.constructs.IConstruct
software.constructs.IConstruct.Jsii$DefaultNested classes/interfaces inherited from interface software.amazon.awscdk.services.glue.alpha.IJob
IJob.Jsii$DefaultNested classes/interfaces inherited from interface software.amazon.awscdk.IResource
IResource.Jsii$Default -
Constructor Summary
ConstructorsModifierConstructorDescriptionprotectedSparkJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode) protectedSparkJob(software.amazon.jsii.JsiiObjectRef objRef) protectedSparkJob(software.constructs.Construct scope, String id, SparkJobProps props) -
Method Summary
Modifier and TypeMethodDescription(experimental) The principal to grant permissions to.getRole()(experimental) The IAM role Glue assumes to run this job.(experimental) The Spark UI logs location if Spark UI monitoring and debugging is enabled.protected voidsetupExtraCodeArguments(Map<String, String> args, SparkExtraCodeProps props) (experimental) Set the arguments for extraCode-related properties.Methods inherited from class software.amazon.awscdk.services.glue.alpha.Job
checkNoReservedArgs, checkNoReservedArgs, codeS3ObjectUrl, fromJobAttributes, setupContinuousLogging, setupContinuousLoggingMethods inherited from class software.amazon.awscdk.services.glue.alpha.JobBase
buildJobArn, getJobArn, getJobName, metric, metric, metricFailure, metricFailure, metricSuccess, metricSuccess, metricTimeout, metricTimeout, onEvent, onEvent, onFailure, onFailure, onStateChange, onStateChange, onSuccess, onSuccess, onTimeout, onTimeoutMethods inherited from class software.amazon.awscdk.Resource
applyRemovalPolicy, generatePhysicalName, getEnv, getPhysicalName, getResourceArnAttribute, getResourceNameAttribute, getStack, isOwnedResource, isResourceMethods inherited from class software.constructs.Construct
getNode, isConstruct, toStringMethods inherited from class software.amazon.jsii.JsiiObject
jsiiAsyncCall, jsiiAsyncCall, jsiiCall, jsiiCall, jsiiGet, jsiiGet, jsiiSet, jsiiStaticCall, jsiiStaticCall, jsiiStaticGet, jsiiStaticGet, jsiiStaticSet, jsiiStaticSetMethods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, waitMethods inherited from interface software.constructs.IConstruct
getNodeMethods inherited from interface software.amazon.awscdk.interfaces.IEnvironmentAware
getEnvMethods inherited from interface software.amazon.awscdk.IResource
applyRemovalPolicy, getStackMethods inherited from interface software.amazon.jsii.JsiiSerializable
$jsii$toJson
-
Constructor Details
-
SparkJob
protected SparkJob(software.amazon.jsii.JsiiObjectRef objRef) -
SparkJob
protected SparkJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode) -
SparkJob
@Stability(Experimental) protected SparkJob(@NotNull software.constructs.Construct scope, @NotNull String id, @NotNull SparkJobProps props) - Parameters:
scope- This parameter is required.id- This parameter is required.props- This parameter is required.
-
-
Method Details
-
nonExecutableCommonArguments
@Stability(Experimental) @NotNull protected Map<String,String> nonExecutableCommonArguments(@NotNull SparkJobProps props) - Parameters:
props- This parameter is required.
-
setupExtraCodeArguments
@Stability(Experimental) protected void setupExtraCodeArguments(@NotNull Map<String, String> args, @NotNull SparkExtraCodeProps props) (experimental) Set the arguments for extraCode-related properties.- Parameters:
args- This parameter is required.props- This parameter is required.
-
getGrantPrincipal
(experimental) The principal to grant permissions to.- Specified by:
getGrantPrincipalin interfaceIGrantable- Specified by:
getGrantPrincipalin classJobBase
-
getRole
(experimental) The IAM role Glue assumes to run this job. -
getSparkUILoggingLocation
(experimental) The Spark UI logs location if Spark UI monitoring and debugging is enabled.- See Also:
-