S3IcebergDirectTarget

Specifies the compression codec used for Iceberg table files in S3.

Type: String

Valid Values: gzip | lzo | uncompressed | snappy

Required: Yes

Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).

Type: String

Valid Values: json | csv | avro | orc | parquet | hudi | delta | iceberg | hyper | xml

Required: Yes

Defines the single input source that provides data to this Iceberg target.

Type: Array of strings

Array Members: Fixed number of 1 item.

Pattern: [A-Za-z0-9_-]*

Required: Yes

Specifies the unique identifier for the Iceberg target node in your data pipeline.

Type: String

Pattern: ([^\r\n])*

Required: Yes

Defines the S3 location where the Iceberg table data will be stored.

Type: String

Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: Yes

Provides additional configuration options for customizing the Iceberg table behavior.

Type: String to string map

Key Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Value Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: No

Specifies configuration options for automatic data quality evaluation in AWS Glue jobs. This structure enables automated data quality checks and monitoring during ETL operations, helping to ensure data integrity and reliability without manual intervention.

Type: AutoDataQuality object

Required: No

Sets the number of target partitions for distributing Iceberg table files across S3.

Type: String

Required: No

Specifies the data schema for the S3 Iceberg direct target.

Type: Array of GlueSchema objects

Required: No

Specifies the columns used to partition the Iceberg table data in S3.

Type: Array of arrays of strings

Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: No

Defines how schema changes are handled when writing data to the Iceberg table.

Type: DirectSchemaChangePolicy object

Required: No