Class CfnJob
- All Implemented Interfaces:
IConstruct,IDependable,IInspectable,software.amazon.jsii.JsiiSerializable,software.constructs.IConstruct
AWS::DataBrew::Job.
Specifies a new DataBrew job.
Example:
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import software.amazon.awscdk.services.databrew.*;
CfnJob cfnJob = CfnJob.Builder.create(this, "MyCfnJob")
.name("name")
.roleArn("roleArn")
.type("type")
// the properties below are optional
.databaseOutputs(List.of(DatabaseOutputProperty.builder()
.databaseOptions(DatabaseTableOutputOptionsProperty.builder()
.tableName("tableName")
// the properties below are optional
.tempDirectory(S3LocationProperty.builder()
.bucket("bucket")
// the properties below are optional
.bucketOwner("bucketOwner")
.key("key")
.build())
.build())
.glueConnectionName("glueConnectionName")
// the properties below are optional
.databaseOutputMode("databaseOutputMode")
.build()))
.dataCatalogOutputs(List.of(DataCatalogOutputProperty.builder()
.databaseName("databaseName")
.tableName("tableName")
// the properties below are optional
.catalogId("catalogId")
.databaseOptions(DatabaseTableOutputOptionsProperty.builder()
.tableName("tableName")
// the properties below are optional
.tempDirectory(S3LocationProperty.builder()
.bucket("bucket")
// the properties below are optional
.bucketOwner("bucketOwner")
.key("key")
.build())
.build())
.overwrite(false)
.s3Options(S3TableOutputOptionsProperty.builder()
.location(S3LocationProperty.builder()
.bucket("bucket")
// the properties below are optional
.bucketOwner("bucketOwner")
.key("key")
.build())
.build())
.build()))
.datasetName("datasetName")
.encryptionKeyArn("encryptionKeyArn")
.encryptionMode("encryptionMode")
.jobSample(JobSampleProperty.builder()
.mode("mode")
.size(123)
.build())
.logSubscription("logSubscription")
.maxCapacity(123)
.maxRetries(123)
.outputLocation(OutputLocationProperty.builder()
.bucket("bucket")
// the properties below are optional
.bucketOwner("bucketOwner")
.key("key")
.build())
.outputs(List.of(OutputProperty.builder()
.location(S3LocationProperty.builder()
.bucket("bucket")
// the properties below are optional
.bucketOwner("bucketOwner")
.key("key")
.build())
// the properties below are optional
.compressionFormat("compressionFormat")
.format("format")
.formatOptions(OutputFormatOptionsProperty.builder()
.csv(CsvOutputOptionsProperty.builder()
.delimiter("delimiter")
.build())
.build())
.maxOutputFiles(123)
.overwrite(false)
.partitionColumns(List.of("partitionColumns"))
.build()))
.profileConfiguration(ProfileConfigurationProperty.builder()
.columnStatisticsConfigurations(List.of(ColumnStatisticsConfigurationProperty.builder()
.statistics(StatisticsConfigurationProperty.builder()
.includedStatistics(List.of("includedStatistics"))
.overrides(List.of(StatisticOverrideProperty.builder()
.parameters(Map.of(
"parametersKey", "parameters"))
.statistic("statistic")
.build()))
.build())
// the properties below are optional
.selectors(List.of(ColumnSelectorProperty.builder()
.name("name")
.regex("regex")
.build()))
.build()))
.datasetStatisticsConfiguration(StatisticsConfigurationProperty.builder()
.includedStatistics(List.of("includedStatistics"))
.overrides(List.of(StatisticOverrideProperty.builder()
.parameters(Map.of(
"parametersKey", "parameters"))
.statistic("statistic")
.build()))
.build())
.entityDetectorConfiguration(EntityDetectorConfigurationProperty.builder()
.entityTypes(List.of("entityTypes"))
// the properties below are optional
.allowedStatistics(AllowedStatisticsProperty.builder()
.statistics(List.of("statistics"))
.build())
.build())
.profileColumns(List.of(ColumnSelectorProperty.builder()
.name("name")
.regex("regex")
.build()))
.build())
.projectName("projectName")
.recipe(RecipeProperty.builder()
.name("name")
// the properties below are optional
.version("version")
.build())
.tags(List.of(CfnTag.builder()
.key("key")
.value("value")
.build()))
.timeout(123)
.validationConfigurations(List.of(ValidationConfigurationProperty.builder()
.rulesetArn("rulesetArn")
// the properties below are optional
.validationMode("validationMode")
.build()))
.build();
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic interfaceConfiguration of statistics that are allowed to be run on columns that contain detected entities.static final classA fluent builder forCfnJob.static interfaceSelector of a column from a dataset for profile job configuration.static interfaceConfiguration for column evaluations for a profile job.static interfaceRepresents a set of options that define how DataBrew will write a comma-separated value (CSV) file.static interfaceRepresents a JDBC database output object which defines the output destination for a DataBrew recipe job to write into.static interfaceRepresents options that specify how and where DataBrew writes the database output generated by recipe jobs.static interfaceRepresents options that specify how and where in the AWS Glue Data Catalog DataBrew writes the output generated by recipe jobs.static interfaceConfiguration of entity detection for a profile job.static interfaceA sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.static interfaceRepresents a set of options that define the structure of comma-separated (CSV) job output.static interfaceThe location in Amazon S3 or AWS Glue Data Catalog where the job writes its output.static interfaceRepresents options that specify how and where in Amazon S3 DataBrew writes the output generated by recipe jobs or profile jobs.static interfaceConfiguration for profile jobs.static interfaceRepresents one or more actions to be performed on a DataBrew dataset.static interfaceRepresents an Amazon S3 location (bucket name, bucket owner, and object key) where DataBrew can read input data, or write output from a job.static interfaceRepresents options that specify how and where DataBrew writes the Amazon S3 output generated by recipe jobs.static interfaceOverride of a particular evaluation for a profile job.static interfaceConfiguration of evaluations for a profile job.static interfaceConfiguration for data quality validation.Nested classes/interfaces inherited from class software.amazon.jsii.JsiiObject
software.amazon.jsii.JsiiObject.InitializationModeNested classes/interfaces inherited from interface software.amazon.awscdk.core.IConstruct
IConstruct.Jsii$DefaultNested classes/interfaces inherited from interface software.constructs.IConstruct
software.constructs.IConstruct.Jsii$DefaultNested classes/interfaces inherited from interface software.amazon.awscdk.core.IInspectable
IInspectable.Jsii$Default, IInspectable.Jsii$Proxy -
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final StringThe CloudFormation resource type name for this resource class. -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionRepresents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into.One or more artifacts that represent the AWS Glue Data Catalog output from running the job.A dataset that the job is to process.The Amazon Resource Name (ARN) of an encryption key that is used to protect the job output.The encryption mode for the job, which can be one of the following:.A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.The current status of Amazon CloudWatch logging for the job.The maximum number of nodes that can be consumed when the job processes data.The maximum number of times to retry the job after a job run fails.getName()The unique name of the job.AWS::DataBrew::Job.OutputLocation.One or more artifacts that represent output from running the job.Configuration for profile jobs.The name of the project that the job is associated with.A series of data transformation steps that the job runs.The Amazon Resource Name (ARN) of the role to be assumed for this job.getTags()Metadata tags that have been applied to the job.The job's timeout in minutes.getType()The job type of the job, which must be one of the following:.List of validation configurations that are applied to the profile job.voidinspect(TreeInspector inspector) Examines the CloudFormation resource and discloses attributes.renderProperties(Map<String, Object> props) voidsetDatabaseOutputs(List<Object> value) Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into.voidsetDatabaseOutputs(IResolvable value) Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into.voidsetDataCatalogOutputs(List<Object> value) One or more artifacts that represent the AWS Glue Data Catalog output from running the job.voidsetDataCatalogOutputs(IResolvable value) One or more artifacts that represent the AWS Glue Data Catalog output from running the job.voidsetDatasetName(String value) A dataset that the job is to process.voidsetEncryptionKeyArn(String value) The Amazon Resource Name (ARN) of an encryption key that is used to protect the job output.voidsetEncryptionMode(String value) The encryption mode for the job, which can be one of the following:.voidsetJobSample(IResolvable value) A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.voidA sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.voidsetLogSubscription(String value) The current status of Amazon CloudWatch logging for the job.voidsetMaxCapacity(Number value) The maximum number of nodes that can be consumed when the job processes data.voidsetMaxRetries(Number value) The maximum number of times to retry the job after a job run fails.voidThe unique name of the job.voidsetOutputLocation(IResolvable value) AWS::DataBrew::Job.OutputLocation.voidAWS::DataBrew::Job.OutputLocation.voidsetOutputs(List<Object> value) One or more artifacts that represent output from running the job.voidsetOutputs(IResolvable value) One or more artifacts that represent output from running the job.voidConfiguration for profile jobs.voidConfiguration for profile jobs.voidsetProjectName(String value) The name of the project that the job is associated with.voidsetRecipe(IResolvable value) A series of data transformation steps that the job runs.voidsetRecipe(CfnJob.RecipeProperty value) A series of data transformation steps that the job runs.voidsetRoleArn(String value) The Amazon Resource Name (ARN) of the role to be assumed for this job.voidsetTimeout(Number value) The job's timeout in minutes.voidThe job type of the job, which must be one of the following:.voidsetValidationConfigurations(List<Object> value) List of validation configurations that are applied to the profile job.voidList of validation configurations that are applied to the profile job.Methods inherited from class software.amazon.awscdk.core.CfnResource
addDeletionOverride, addDependsOn, addMetadata, addOverride, addPropertyDeletionOverride, addPropertyOverride, applyRemovalPolicy, applyRemovalPolicy, applyRemovalPolicy, getAtt, getCfnOptions, getCfnResourceType, getMetadata, getUpdatedProperites, isCfnResource, shouldSynthesize, toString, validatePropertiesMethods inherited from class software.amazon.awscdk.core.CfnRefElement
getRefMethods inherited from class software.amazon.awscdk.core.CfnElement
getCreationStack, getLogicalId, getStack, isCfnElement, overrideLogicalIdMethods inherited from class software.amazon.awscdk.core.Construct
getNode, isConstruct, onPrepare, onSynthesize, onValidate, prepare, synthesize, validateMethods inherited from class software.amazon.jsii.JsiiObject
jsiiAsyncCall, jsiiAsyncCall, jsiiCall, jsiiCall, jsiiGet, jsiiGet, jsiiSet, jsiiStaticCall, jsiiStaticCall, jsiiStaticGet, jsiiStaticGet, jsiiStaticSet, jsiiStaticSetMethods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, waitMethods inherited from interface software.amazon.jsii.JsiiSerializable
$jsii$toJson
-
Field Details
-
CFN_RESOURCE_TYPE_NAME
The CloudFormation resource type name for this resource class.
-
-
Constructor Details
-
CfnJob
protected CfnJob(software.amazon.jsii.JsiiObjectRef objRef) -
CfnJob
protected CfnJob(software.amazon.jsii.JsiiObject.InitializationMode initializationMode) -
CfnJob
@Stability(Stable) public CfnJob(@NotNull Construct scope, @NotNull String id, @NotNull CfnJobProps props) Create a newAWS::DataBrew::Job.- Parameters:
scope-- scope in which this resource is defined.
id-- scoped id of the resource.
props-- resource properties.
-
-
Method Details
-
inspect
Examines the CloudFormation resource and discloses attributes.- Specified by:
inspectin interfaceIInspectable- Parameters:
inspector-- tree inspector to collect and process attributes.
-
renderProperties
@Stability(Stable) @NotNull protected Map<String,Object> renderProperties(@NotNull Map<String, Object> props) - Overrides:
renderPropertiesin classCfnResource- Parameters:
props- This parameter is required.
-
getCfnProperties
- Overrides:
getCfnPropertiesin classCfnResource
-
getTags
Metadata tags that have been applied to the job. -
getName
The unique name of the job. -
setName
The unique name of the job. -
getRoleArn
The Amazon Resource Name (ARN) of the role to be assumed for this job. -
setRoleArn
The Amazon Resource Name (ARN) of the role to be assumed for this job. -
getType
The job type of the job, which must be one of the following:.PROFILE- A job to analyze a dataset, to determine its size, data types, data distribution, and more.RECIPE- A job to apply one or more transformations to a dataset.
-
setType
The job type of the job, which must be one of the following:.PROFILE- A job to analyze a dataset, to determine its size, data types, data distribution, and more.RECIPE- A job to apply one or more transformations to a dataset.
-
getDatabaseOutputs
Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into. -
setDatabaseOutputs
Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into. -
setDatabaseOutputs
Represents a list of JDBC database output objects which defines the output destination for a DataBrew recipe job to write into. -
getDataCatalogOutputs
One or more artifacts that represent the AWS Glue Data Catalog output from running the job. -
setDataCatalogOutputs
One or more artifacts that represent the AWS Glue Data Catalog output from running the job. -
setDataCatalogOutputs
One or more artifacts that represent the AWS Glue Data Catalog output from running the job. -
getDatasetName
A dataset that the job is to process. -
setDatasetName
A dataset that the job is to process. -
getEncryptionKeyArn
The Amazon Resource Name (ARN) of an encryption key that is used to protect the job output.For more information, see Encrypting data written by DataBrew jobs
-
setEncryptionKeyArn
The Amazon Resource Name (ARN) of an encryption key that is used to protect the job output.For more information, see Encrypting data written by DataBrew jobs
-
getEncryptionMode
The encryption mode for the job, which can be one of the following:.SSE-KMS- Server-side encryption with keys managed by AWS KMS .SSE-S3- Server-side encryption with keys managed by Amazon S3.
-
setEncryptionMode
The encryption mode for the job, which can be one of the following:.SSE-KMS- Server-side encryption with keys managed by AWS KMS .SSE-S3- Server-side encryption with keys managed by Amazon S3.
-
getJobSample
A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.If a
JobSamplevalue isn't provided, the default value is used. The default value is CUSTOM_ROWS for the mode parameter and 20,000 for the size parameter. -
setJobSample
A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.If a
JobSamplevalue isn't provided, the default value is used. The default value is CUSTOM_ROWS for the mode parameter and 20,000 for the size parameter. -
setJobSample
A sample configuration for profile jobs only, which determines the number of rows on which the profile job is run.If a
JobSamplevalue isn't provided, the default value is used. The default value is CUSTOM_ROWS for the mode parameter and 20,000 for the size parameter. -
getLogSubscription
The current status of Amazon CloudWatch logging for the job. -
setLogSubscription
The current status of Amazon CloudWatch logging for the job. -
getMaxCapacity
The maximum number of nodes that can be consumed when the job processes data. -
setMaxCapacity
The maximum number of nodes that can be consumed when the job processes data. -
getMaxRetries
The maximum number of times to retry the job after a job run fails. -
setMaxRetries
The maximum number of times to retry the job after a job run fails. -
getOutputLocation
AWS::DataBrew::Job.OutputLocation. -
setOutputLocation
AWS::DataBrew::Job.OutputLocation. -
setOutputLocation
AWS::DataBrew::Job.OutputLocation. -
getOutputs
One or more artifacts that represent output from running the job. -
setOutputs
One or more artifacts that represent output from running the job. -
setOutputs
One or more artifacts that represent output from running the job. -
getProfileConfiguration
Configuration for profile jobs.Configuration can be used to select columns, do evaluations, and override default parameters of evaluations. When configuration is undefined, the profile job will apply default settings to all supported columns.
-
setProfileConfiguration
Configuration for profile jobs.Configuration can be used to select columns, do evaluations, and override default parameters of evaluations. When configuration is undefined, the profile job will apply default settings to all supported columns.
-
setProfileConfiguration
@Stability(Stable) public void setProfileConfiguration(@Nullable CfnJob.ProfileConfigurationProperty value) Configuration for profile jobs.Configuration can be used to select columns, do evaluations, and override default parameters of evaluations. When configuration is undefined, the profile job will apply default settings to all supported columns.
-
getProjectName
The name of the project that the job is associated with. -
setProjectName
The name of the project that the job is associated with. -
getRecipe
A series of data transformation steps that the job runs. -
setRecipe
A series of data transformation steps that the job runs. -
setRecipe
A series of data transformation steps that the job runs. -
getTimeout
The job's timeout in minutes.A job that attempts to run longer than this timeout period ends with a status of
TIMEOUT. -
setTimeout
The job's timeout in minutes.A job that attempts to run longer than this timeout period ends with a status of
TIMEOUT. -
getValidationConfigurations
List of validation configurations that are applied to the profile job. -
setValidationConfigurations
List of validation configurations that are applied to the profile job. -
setValidationConfigurations
List of validation configurations that are applied to the profile job.
-