S3GlueParquetTarget - AWS Glue

S3GlueParquetTarget

Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

Contents

Inputs

The nodes that are inputs to the data target.

Type: Array of strings

Array Members: Fixed number of 1 item.

Pattern: [A-Za-z0-9_-]*

Required: Yes

Name

The name of the data target.

Type: String

Pattern: ([^\r\n])*

Required: Yes

Path

A single Amazon S3 path to write to.

Type: String

Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: Yes

AutoDataQuality

Specifies whether to automatically enable data quality evaluation for the S3 AWS Glue Parquet target. When set to true, data quality checks are performed automatically during the write operation.

Type: AutoDataQuality object

Required: No

Compression

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

Type: String

Valid Values: snappy | lzo | gzip | brotli | lz4 | uncompressed | none

Required: No

NumberTargetPartitions

Specifies the number of target partitions for Parquet files when writing to Amazon S3 using AWS Glue.

Type: String

Required: No

PartitionKeys

Specifies native partitioning using a sequence of keys.

Type: Array of arrays of strings

Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: No

SchemaChangePolicy

A policy that specifies update behavior for the crawler.

Type: DirectSchemaChangePolicy object

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: