Class CfnEndpoint.S3SettingsProperty.Jsii$Proxy
- All Implemented Interfaces:
CfnEndpoint.S3SettingsProperty,software.amazon.jsii.JsiiSerializable
- Enclosing interface:
CfnEndpoint.S3SettingsProperty
CfnEndpoint.S3SettingsProperty-
Nested Class Summary
Nested classes/interfaces inherited from class software.amazon.jsii.JsiiObject
software.amazon.jsii.JsiiObject.InitializationModeNested classes/interfaces inherited from interface software.amazon.awscdk.services.dms.CfnEndpoint.S3SettingsProperty
CfnEndpoint.S3SettingsProperty.Builder, CfnEndpoint.S3SettingsProperty.Jsii$Proxy -
Constructor Summary
ConstructorsModifierConstructorDescriptionprotectedConstructor that initializes the object based on literal property values passed by theCfnEndpoint.S3SettingsProperty.Builder.protectedJsii$Proxy(software.amazon.jsii.JsiiObjectRef objRef) Constructor that initializes the object based on values retrieved from the JsiiObject. -
Method Summary
Modifier and TypeMethodDescriptioncom.fasterxml.jackson.databind.JsonNodefinal booleanfinal ObjectAn optional parameter that, when set totrueory, you can use to add column name information to the .csv output file.final ObjectUse the S3 target endpoint settingAddTrailingPaddingCharacterto add padding on string data.final StringAn optional parameter to set a folder name in the S3 bucket.final StringThe name of the S3 bucket.final StringA value that enables AWS DMS to specify a predefined (canned) access control list (ACL) for objects created in an Amazon S3 bucket as .csv or .parquet files.final ObjectA value that enables a change data capture (CDC) load to write INSERT and UPDATE operations to .csv or .parquet (columnar storage) output files.final ObjectA value that enables a change data capture (CDC) load to write only INSERT operations to .csv or columnar storage (.parquet) output files.final NumberMaximum length of the interval, defined in seconds, after which to output a file to Amazon S3.final NumberMinimum file size, defined in kilobytes, to reach for a file output to Amazon S3.final StringSpecifies the folder path of CDC files.final StringAn optional parameter.final StringThe delimiter used to separate columns in the .csv file for both source and target.final StringThis setting only applies if your Amazon S3 output files during a change data capture (CDC) load are written in .csv format.final StringAn optional parameter that specifies how AWS DMS treats null values.final StringThe delimiter used to separate rows in the .csv file for both source and target.final StringThe format of the data that you want to use for output.final NumberThe size of one data page in bytes.final StringSpecifies a date separating delimiter to use during folder partitioning.final ObjectWhen set totrue, this parameter partitions S3 bucket folders based on transaction commit dates.final StringIdentifies the sequence of the date format to use during folder partitioning.final StringWhen creating an S3 target endpoint, setDatePartitionTimezoneto convert the current UTC time into a specified time zone.final NumberThe maximum size of an encoded dictionary page of a column.final ObjectA value that enables statistics for Parquet pages and row groups.final StringThe type of encoding that you're using:.final StringThe type of server-side encryption that you want to use for your data.final StringTo specify a bucket owner and prevent sniping, you can use theExpectedBucketOwnerendpoint setting.final StringThe external table definition.final ObjectWhen true, allows AWS Glue to catalog your S3 bucket.final NumberWhen this value is set to 1, AWS DMS ignores the first row header in a .csv file.final ObjectA value that enables a full load to write INSERT operations to the comma-separated value (.csv) output files only to indicate how the rows were added to the source database.final NumberA value that specifies the maximum size (in KB) of any .csv file to be created while migrating to an S3 target during full load.final ObjectA value that specifies the precision of anyTIMESTAMPcolumn values that are written to an Amazon S3 object file in .parquet format.final StringThe version of the Apache Parquet format that you want to use:parquet_1_0(the default) orparquet_2_0.final ObjectIf this setting is set totrue, AWS DMS saves the transaction order for a change data capture (CDC) load on the Amazon S3 target specified byCdcPath.final ObjectFor an S3 source, when this value is set totrueory, each leading double quotation mark has to be followed by an ending double quotation mark.final NumberThe number of rows in a row group.final StringIf you are usingSSE_KMSfor theEncryptionMode, provide the AWS KMS key ID.final StringA required parameter that specifies the Amazon Resource Name (ARN) used by the service to access the IAM role.final StringA value that when nonblank causes AWS DMS to add a column with timestamp information to the endpoint data for an Amazon S3 target.final ObjectThis setting applies if the S3 output files during a change data capture (CDC) load are written in .csv format.final ObjectWhen set to true, this parameter uses the task start time as the timestamp column value instead of the time data is written to target.final inthashCode()Methods inherited from class software.amazon.jsii.JsiiObject
jsiiAsyncCall, jsiiAsyncCall, jsiiCall, jsiiCall, jsiiGet, jsiiGet, jsiiSet, jsiiStaticCall, jsiiStaticCall, jsiiStaticGet, jsiiStaticGet, jsiiStaticSet, jsiiStaticSet
-
Constructor Details
-
Jsii$Proxy
protected Jsii$Proxy(software.amazon.jsii.JsiiObjectRef objRef) Constructor that initializes the object based on values retrieved from the JsiiObject.- Parameters:
objRef- Reference to the JSII managed object.
-
Jsii$Proxy
Constructor that initializes the object based on literal property values passed by theCfnEndpoint.S3SettingsProperty.Builder.
-
-
Method Details
-
getAddColumnName
Description copied from interface:CfnEndpoint.S3SettingsPropertyAn optional parameter that, when set totrueory, you can use to add column name information to the .csv output file.The default value is
false. Valid values aretrue,false,y, andn.Returns union: either
BooleanorIResolvable- Specified by:
getAddColumnNamein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getAddTrailingPaddingCharacter
Description copied from interface:CfnEndpoint.S3SettingsPropertyUse the S3 target endpoint settingAddTrailingPaddingCharacterto add padding on string data.The default value is
false.Returns union: either
BooleanorIResolvable- Specified by:
getAddTrailingPaddingCharacterin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getBucketFolder
Description copied from interface:CfnEndpoint.S3SettingsPropertyAn optional parameter to set a folder name in the S3 bucket.If provided, tables are created in the path
*bucketFolder* / *schema_name* / *table_name* /. If this parameter isn't specified, the path used is*schema_name* / *table_name* /.- Specified by:
getBucketFolderin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getBucketName
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe name of the S3 bucket.- Specified by:
getBucketNamein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCannedAclForObjects
Description copied from interface:CfnEndpoint.S3SettingsPropertyA value that enables AWS DMS to specify a predefined (canned) access control list (ACL) for objects created in an Amazon S3 bucket as .csv or .parquet files. For more information about Amazon S3 canned ACLs, see Canned ACL in the Amazon S3 Developer Guide .The default value is NONE. Valid values include NONE, PRIVATE, PUBLIC_READ, PUBLIC_READ_WRITE, AUTHENTICATED_READ, AWS_EXEC_READ, BUCKET_OWNER_READ, and BUCKET_OWNER_FULL_CONTROL.
- Specified by:
getCannedAclForObjectsin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCdcInsertsAndUpdates
Description copied from interface:CfnEndpoint.S3SettingsPropertyA value that enables a change data capture (CDC) load to write INSERT and UPDATE operations to .csv or .parquet (columnar storage) output files. The default setting isfalse, but whenCdcInsertsAndUpdatesis set totrueory, only INSERTs and UPDATEs from the source database are migrated to the .csv or .parquet file.For .csv file format only, how these INSERTs and UPDATEs are recorded depends on the value of the
IncludeOpForFullLoadparameter. IfIncludeOpForFullLoadis set totrue, the first field of every CDC record is set to eitherIorUto indicate INSERT and UPDATE operations at the source. But ifIncludeOpForFullLoadis set tofalse, CDC records are written without an indication of INSERT or UPDATE operations at the source. For more information about how these settings work together, see Indicating Source DB Operations in Migrated S3 Data in the AWS Database Migration Service User Guide .AWS DMS supports the use of the
CdcInsertsAndUpdatesparameter in versions 3.3.1 and later.CdcInsertsOnlyandCdcInsertsAndUpdatescan't both be set totruefor the same endpoint. Set eitherCdcInsertsOnlyorCdcInsertsAndUpdatestotruefor the same endpoint, but not both.Returns union: either
BooleanorIResolvable- Specified by:
getCdcInsertsAndUpdatesin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCdcInsertsOnly
Description copied from interface:CfnEndpoint.S3SettingsPropertyA value that enables a change data capture (CDC) load to write only INSERT operations to .csv or columnar storage (.parquet) output files. By default (thefalsesetting), the first field in a .csv or .parquet record contains the letter I (INSERT), U (UPDATE), or D (DELETE). These values indicate whether the row was inserted, updated, or deleted at the source database for a CDC load to the target.If
CdcInsertsOnlyis set totrueory, only INSERTs from the source database are migrated to the .csv or .parquet file. For .csv format only, how these INSERTs are recorded depends on the value ofIncludeOpForFullLoad. IfIncludeOpForFullLoadis set totrue, the first field of every CDC record is set to I to indicate the INSERT operation at the source. IfIncludeOpForFullLoadis set tofalse, every CDC record is written without a first field to indicate the INSERT operation at the source. For more information about how these settings work together, see Indicating Source DB Operations in Migrated S3 Data in the AWS Database Migration Service User Guide .AWS DMS supports the interaction described preceding between the
CdcInsertsOnlyandIncludeOpForFullLoadparameters in versions 3.1.4 and later.CdcInsertsOnlyandCdcInsertsAndUpdatescan't both be set totruefor the same endpoint. Set eitherCdcInsertsOnlyorCdcInsertsAndUpdatestotruefor the same endpoint, but not both.Returns union: either
BooleanorIResolvable- Specified by:
getCdcInsertsOnlyin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCdcMaxBatchInterval
Description copied from interface:CfnEndpoint.S3SettingsPropertyMaximum length of the interval, defined in seconds, after which to output a file to Amazon S3.When
CdcMaxBatchIntervalandCdcMinFileSizeare both specified, the file write is triggered by whichever parameter condition is met first within an AWS DMS CloudFormation template.The default value is 60 seconds.
- Specified by:
getCdcMaxBatchIntervalin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCdcMinFileSize
Description copied from interface:CfnEndpoint.S3SettingsPropertyMinimum file size, defined in kilobytes, to reach for a file output to Amazon S3.When
CdcMinFileSizeandCdcMaxBatchIntervalare both specified, the file write is triggered by whichever parameter condition is met first within an AWS DMS CloudFormation template.The default value is 32 MB.
- Specified by:
getCdcMinFileSizein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCdcPath
Description copied from interface:CfnEndpoint.S3SettingsPropertySpecifies the folder path of CDC files.For an S3 source, this setting is required if a task captures change data; otherwise, it's optional. If
CdcPathis set, AWS DMS reads CDC files from this path and replicates the data changes to the target endpoint. For an S3 target if you setPreserveTransactionstotrue, AWS DMS verifies that you have set this parameter to a folder path on your S3 target where AWS DMS can save the transaction order for the CDC load. AWS DMS creates this CDC folder path in either your S3 target working directory or the S3 target location specified byBucketFolderandBucketName.For example, if you specify
CdcPathasMyChangedData, and you specifyBucketNameasMyTargetBucketbut do not specifyBucketFolder, AWS DMS creates the CDC folder path following:MyTargetBucket/MyChangedData.If you specify the same
CdcPath, and you specifyBucketNameasMyTargetBucketandBucketFolderasMyTargetData, AWS DMS creates the CDC folder path following:MyTargetBucket/MyTargetData/MyChangedData.For more information on CDC including transaction order on an S3 target, see Capturing data changes (CDC) including transaction order on the S3 target .
This setting is supported in AWS DMS versions 3.4.2 and later.
- Specified by:
getCdcPathin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCompressionType
Description copied from interface:CfnEndpoint.S3SettingsPropertyAn optional parameter.When set to GZIP it enables the service to compress the target files. To allow the service to write the target files uncompressed, either set this parameter to NONE (the default) or don't specify the parameter at all. This parameter applies to both .csv and .parquet file formats.
- Specified by:
getCompressionTypein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCsvDelimiter
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe delimiter used to separate columns in the .csv file for both source and target. The default is a comma.- Specified by:
getCsvDelimiterin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCsvNoSupValue
Description copied from interface:CfnEndpoint.S3SettingsPropertyThis setting only applies if your Amazon S3 output files during a change data capture (CDC) load are written in .csv format. IfUseCsvNoSupValueis set to true, specify a string value that you want AWS DMS to use for all columns not included in the supplemental log. If you do not specify a string value, AWS DMS uses the null value for these columns regardless of theUseCsvNoSupValuesetting.This setting is supported in AWS DMS versions 3.4.1 and later.
- Specified by:
getCsvNoSupValuein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCsvNullValue
Description copied from interface:CfnEndpoint.S3SettingsPropertyAn optional parameter that specifies how AWS DMS treats null values.While handling the null value, you can use this parameter to pass a user-defined string as null when writing to the target. For example, when target columns are not nullable, you can use this option to differentiate between the empty string value and the null value. So, if you set this parameter value to the empty string ("" or ''), AWS DMS treats the empty string as the null value instead of
NULL.The default value is
NULL. Valid values include any valid string.- Specified by:
getCsvNullValuein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getCsvRowDelimiter
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe delimiter used to separate rows in the .csv file for both source and target.The default is a carriage return (
\n).- Specified by:
getCsvRowDelimiterin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getDataFormat
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe format of the data that you want to use for output. You can choose one of the following:.csv: This is a row-based file format with comma-separated values (.csv).parquet: Apache Parquet (.parquet) is a columnar storage file format that features efficient compression and provides faster query response.
- Specified by:
getDataFormatin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getDataPageSize
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe size of one data page in bytes.This parameter defaults to 1024 * 1024 bytes (1 MiB). This number is used for .parquet file format only.
- Specified by:
getDataPageSizein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getDatePartitionDelimiter
Description copied from interface:CfnEndpoint.S3SettingsPropertySpecifies a date separating delimiter to use during folder partitioning.The default value is
SLASH. Use this parameter whenDatePartitionedEnabledis set totrue.- Specified by:
getDatePartitionDelimiterin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getDatePartitionEnabled
Description copied from interface:CfnEndpoint.S3SettingsPropertyWhen set totrue, this parameter partitions S3 bucket folders based on transaction commit dates.The default value is
false. For more information about date-based folder partitioning, see Using date-based folder partitioning .Returns union: either
BooleanorIResolvable- Specified by:
getDatePartitionEnabledin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getDatePartitionSequence
Description copied from interface:CfnEndpoint.S3SettingsPropertyIdentifies the sequence of the date format to use during folder partitioning.The default value is
YYYYMMDD. Use this parameter whenDatePartitionedEnabledis set totrue.- Specified by:
getDatePartitionSequencein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getDatePartitionTimezone
Description copied from interface:CfnEndpoint.S3SettingsPropertyWhen creating an S3 target endpoint, setDatePartitionTimezoneto convert the current UTC time into a specified time zone.The conversion occurs when a date partition folder is created and a change data capture (CDC) file name is generated. The time zone format is Area/Location. Use this parameter when
DatePartitionedEnabledis set totrue, as shown in the following example.s3-settings='{"DatePartitionEnabled": true, "DatePartitionSequence": "YYYYMMDDHH", "DatePartitionDelimiter": "SLASH", "DatePartitionTimezone":" *Asia/Seoul* ", "BucketName": "dms-nattarat-test"}'- Specified by:
getDatePartitionTimezonein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getDictPageSizeLimit
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe maximum size of an encoded dictionary page of a column.If the dictionary page exceeds this, this column is stored using an encoding type of
PLAIN. This parameter defaults to 1024 * 1024 bytes (1 MiB), the maximum size of a dictionary page before it reverts toPLAINencoding. This size is used for .parquet file format only.- Specified by:
getDictPageSizeLimitin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getEnableStatistics
Description copied from interface:CfnEndpoint.S3SettingsPropertyA value that enables statistics for Parquet pages and row groups.Choose
trueto enable statistics,falseto disable. Statistics includeNULL,DISTINCT,MAX, andMINvalues. This parameter defaults totrue. This value is used for .parquet file format only.Returns union: either
BooleanorIResolvable- Specified by:
getEnableStatisticsin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getEncodingType
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe type of encoding that you're using:.RLE_DICTIONARYuses a combination of bit-packing and run-length encoding to store repeated values more efficiently. This is the default.PLAINdoesn't use encoding at all. Values are stored as they are.PLAIN_DICTIONARYbuilds a dictionary of the values encountered in a given column. The dictionary is stored in a dictionary page for each column chunk.
- Specified by:
getEncodingTypein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getEncryptionMode
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe type of server-side encryption that you want to use for your data.This encryption type is part of the endpoint settings or the extra connections attributes for Amazon S3. You can choose either
SSE_S3(the default) orSSE_KMS.For the
ModifyEndpointoperation, you can change the existing value of theEncryptionModeparameter fromSSE_KMStoSSE_S3. But you can’t change the existing value fromSSE_S3toSSE_KMS.To use
SSE_S3, you need an IAM role with permission to allow"arn:aws:s3:::dms-*"to use the following actions:s3:CreateBuckets3:ListBuckets3:DeleteBuckets3:GetBucketLocations3:GetObjects3:PutObjects3:DeleteObjects3:GetObjectVersions3:GetBucketPolicys3:PutBucketPolicys3:DeleteBucketPolicy
- Specified by:
getEncryptionModein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getExpectedBucketOwner
Description copied from interface:CfnEndpoint.S3SettingsPropertyTo specify a bucket owner and prevent sniping, you can use theExpectedBucketOwnerendpoint setting.Example:
--s3-settings='{"ExpectedBucketOwner": " *AWS_Account_ID* "}'When you make a request to test a connection or perform a migration, S3 checks the account ID of the bucket owner against the specified parameter.
- Specified by:
getExpectedBucketOwnerin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getExternalTableDefinition
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe external table definition.Conditional: If
S3is used as a source thenExternalTableDefinitionis required.- Specified by:
getExternalTableDefinitionin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getGlueCatalogGeneration
Description copied from interface:CfnEndpoint.S3SettingsPropertyWhen true, allows AWS Glue to catalog your S3 bucket.Creating an AWS Glue catalog lets you use Athena to query your data.
Returns union: either
BooleanorIResolvable- Specified by:
getGlueCatalogGenerationin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getIgnoreHeaderRows
Description copied from interface:CfnEndpoint.S3SettingsPropertyWhen this value is set to 1, AWS DMS ignores the first row header in a .csv file. A value of 1 turns on the feature; a value of 0 turns off the feature.The default is 0.
- Specified by:
getIgnoreHeaderRowsin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getIncludeOpForFullLoad
Description copied from interface:CfnEndpoint.S3SettingsPropertyA value that enables a full load to write INSERT operations to the comma-separated value (.csv) output files only to indicate how the rows were added to the source database.AWS DMS supports the
IncludeOpForFullLoadparameter in versions 3.1.4 and later.For full load, records can only be inserted. By default (the
falsesetting), no information is recorded in these output files for a full load to indicate that the rows were inserted at the source database. IfIncludeOpForFullLoadis set totrueory, the INSERT is recorded as an I annotation in the first field of the .csv file. This allows the format of your target records from a full load to be consistent with the target records from a CDC load.This setting works together with the
CdcInsertsOnlyand theCdcInsertsAndUpdatesparameters for output to .csv files only. For more information about how these settings work together, see Indicating Source DB Operations in Migrated S3 Data in the AWS Database Migration Service User Guide .Returns union: either
BooleanorIResolvable- Specified by:
getIncludeOpForFullLoadin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getMaxFileSize
Description copied from interface:CfnEndpoint.S3SettingsPropertyA value that specifies the maximum size (in KB) of any .csv file to be created while migrating to an S3 target during full load.The default value is 1,048,576 KB (1 GB). Valid values include 1 to 1,048,576.
- Specified by:
getMaxFileSizein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getParquetTimestampInMillisecond
Description copied from interface:CfnEndpoint.S3SettingsPropertyA value that specifies the precision of anyTIMESTAMPcolumn values that are written to an Amazon S3 object file in .parquet format.AWS DMS supports the
ParquetTimestampInMillisecondparameter in versions 3.1.4 and later.When
ParquetTimestampInMillisecondis set totrueory, AWS DMS writes allTIMESTAMPcolumns in a .parquet formatted file with millisecond precision. Otherwise, DMS writes them with microsecond precision.Currently, Amazon Athena and AWS Glue can handle only millisecond precision for
TIMESTAMPvalues. Set this parameter totruefor S3 endpoint object files that are .parquet formatted only if you plan to query or process the data with Athena or AWS Glue .AWS DMS writes any
TIMESTAMPcolumn values written to an S3 file in .csv format with microsecond precision.Setting
ParquetTimestampInMillisecondhas no effect on the string format of the timestamp column value that is inserted by setting theTimestampColumnNameparameter.Returns union: either
BooleanorIResolvable- Specified by:
getParquetTimestampInMillisecondin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getParquetVersion
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe version of the Apache Parquet format that you want to use:parquet_1_0(the default) orparquet_2_0.- Specified by:
getParquetVersionin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getPreserveTransactions
Description copied from interface:CfnEndpoint.S3SettingsPropertyIf this setting is set totrue, AWS DMS saves the transaction order for a change data capture (CDC) load on the Amazon S3 target specified byCdcPath. For more information, see Capturing data changes (CDC) including transaction order on the S3 target .This setting is supported in AWS DMS versions 3.4.2 and later.
Returns union: either
BooleanorIResolvable- Specified by:
getPreserveTransactionsin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getRfc4180
Description copied from interface:CfnEndpoint.S3SettingsPropertyFor an S3 source, when this value is set totrueory, each leading double quotation mark has to be followed by an ending double quotation mark.This formatting complies with RFC 4180. When this value is set to
falseorn, string literals are copied to the target as is. In this case, a delimiter (row or column) signals the end of the field. Thus, you can't use a delimiter as part of the string, because it signals the end of the value.For an S3 target, an optional parameter used to set behavior to comply with RFC 4180 for data migrated to Amazon S3 using .csv file format only. When this value is set to
trueoryusing Amazon S3 as a target, if the data has quotation marks or newline characters in it, AWS DMS encloses the entire column with an additional pair of double quotation marks ("). Every quotation mark within the data is repeated twice.The default value is
true. Valid values includetrue,false,y, andn.Returns union: either
BooleanorIResolvable- Specified by:
getRfc4180in interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getRowGroupLength
Description copied from interface:CfnEndpoint.S3SettingsPropertyThe number of rows in a row group.A smaller row group size provides faster reads. But as the number of row groups grows, the slower writes become. This parameter defaults to 10,000 rows. This number is used for .parquet file format only.
If you choose a value larger than the maximum,
RowGroupLengthis set to the max row group length in bytes (64 * 1024 * 1024).- Specified by:
getRowGroupLengthin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getServerSideEncryptionKmsKeyId
Description copied from interface:CfnEndpoint.S3SettingsPropertyIf you are usingSSE_KMSfor theEncryptionMode, provide the AWS KMS key ID.The key that you use needs an attached policy that enables IAM user permissions and allows use of the key.
Here is a CLI example:
aws dms create-endpoint --endpoint-identifier *value* --endpoint-type target --engine-name s3 --s3-settings ServiceAccessRoleArn= *value* ,BucketFolder= *value* ,BucketName= *value* ,EncryptionMode=SSE_KMS,ServerSideEncryptionKmsKeyId= *value*- Specified by:
getServerSideEncryptionKmsKeyIdin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getServiceAccessRoleArn
Description copied from interface:CfnEndpoint.S3SettingsPropertyA required parameter that specifies the Amazon Resource Name (ARN) used by the service to access the IAM role.The role must allow the
iam:PassRoleaction. It enables AWS DMS to read and write objects from an S3 bucket.- Specified by:
getServiceAccessRoleArnin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getTimestampColumnName
Description copied from interface:CfnEndpoint.S3SettingsPropertyA value that when nonblank causes AWS DMS to add a column with timestamp information to the endpoint data for an Amazon S3 target.AWS DMS supports the
TimestampColumnNameparameter in versions 3.1.4 and later.AWS DMS includes an additional
STRINGcolumn in the .csv or .parquet object files of your migrated data when you setTimestampColumnNameto a nonblank value.For a full load, each row of this timestamp column contains a timestamp for when the data was transferred from the source to the target by DMS.
For a change data capture (CDC) load, each row of the timestamp column contains the timestamp for the commit of that row in the source database.
The string format for this timestamp column value is
yyyy-MM-dd HH:mm:ss.SSSSSS. By default, the precision of this value is in microseconds. For a CDC load, the rounding of the precision depends on the commit timestamp supported by DMS for the source database.When the
AddColumnNameparameter is set totrue, DMS also includes a name for the timestamp column that you set withTimestampColumnName.- Specified by:
getTimestampColumnNamein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getUseCsvNoSupValue
Description copied from interface:CfnEndpoint.S3SettingsPropertyThis setting applies if the S3 output files during a change data capture (CDC) load are written in .csv format. If this setting is set totruefor columns not included in the supplemental log, AWS DMS uses the value specified byCsvNoSupValue. If this setting isn't set or is set tofalse, AWS DMS uses the null value for these columns.This setting is supported in AWS DMS versions 3.4.1 and later.
Returns union: either
BooleanorIResolvable- Specified by:
getUseCsvNoSupValuein interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
getUseTaskStartTimeForFullLoadTimestamp
Description copied from interface:CfnEndpoint.S3SettingsPropertyWhen set to true, this parameter uses the task start time as the timestamp column value instead of the time data is written to target.For full load, when
useTaskStartTimeForFullLoadTimestampis set totrue, each row of the timestamp column contains the task start time. For CDC loads, each row of the timestamp column contains the transaction commit time.When
useTaskStartTimeForFullLoadTimestampis set tofalse, the full load timestamp in the timestamp column increments with the time data arrives at the target.Returns union: either
BooleanorIResolvable- Specified by:
getUseTaskStartTimeForFullLoadTimestampin interfaceCfnEndpoint.S3SettingsProperty- See Also:
-
$jsii$toJson
@Internal public com.fasterxml.jackson.databind.JsonNode $jsii$toJson()- Specified by:
$jsii$toJsonin interfacesoftware.amazon.jsii.JsiiSerializable
-
equals
-
hashCode
public final int hashCode()
-