S3HudiDirectTarget

Specifies additional connection options for the connector.

Type: String to string map

Key Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Value Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: Yes

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

Type: String

Valid Values: gzip | lzo | uncompressed | snappy

Required: Yes

Specifies the data output format for the target.

Type: String

Valid Values: json | csv | avro | orc | parquet | hudi | delta | iceberg | hyper | xml

Required: Yes

The nodes that are inputs to the data target.

Type: Array of strings

Array Members: Fixed number of 1 item.

Pattern: [A-Za-z0-9_-]*

Required: Yes

The name of the data target.

Type: String

Pattern: ([^\r\n])*

Required: Yes

The Amazon S3 path of your Hudi data source to write to.

Type: String

Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: Yes

Specifies whether to automatically enable data quality evaluation for the S3 Hudi direct target. When set to true, data quality checks are performed automatically during the write operation.

Type: AutoDataQuality object

Required: No

Specifies the number of target partitions for distributing Hudi dataset files across Amazon S3.

Type: String

Required: No

Specifies native partitioning using a sequence of keys.

Type: Array of arrays of strings

Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: No

A policy that specifies update behavior for the crawler.

Type: DirectSchemaChangePolicy object

Required: No