/AWS1/CL_GLUS3GLUEPARQUETTGT¶
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
CONSTRUCTOR¶
IMPORTING¶
Required arguments:¶
iv_name TYPE /AWS1/GLUNODENAME /AWS1/GLUNODENAME¶
The name of the data target.
it_inputs TYPE /AWS1/CL_GLUONEINPUT_W=>TT_ONEINPUT TT_ONEINPUT¶
The nodes that are inputs to the data target.
iv_path TYPE /AWS1/GLUENCLOSEDINSTRINGPRP /AWS1/GLUENCLOSEDINSTRINGPRP¶
A single Amazon S3 path to write to.
Optional arguments:¶
it_partitionkeys TYPE /AWS1/CL_GLUENCLOSEDINSTRPRP00=>TT_GLUESTUDIOPATHLIST TT_GLUESTUDIOPATHLIST¶
Specifies native partitioning using a sequence of keys.
iv_compression TYPE /AWS1/GLUPARQUETCOMPRESSIONT00 /AWS1/GLUPARQUETCOMPRESSIONT00¶
Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are
"gzip"and"bzip").
iv_numbertargetpartitions TYPE /AWS1/GLUNUMTARGETPARTSSTRING /AWS1/GLUNUMTARGETPARTSSTRING¶
Specifies the number of target partitions for Parquet files when writing to Amazon S3 using Glue.
io_schemachangepolicy TYPE REF TO /AWS1/CL_GLUDIRECTSCHCHANGEPLY /AWS1/CL_GLUDIRECTSCHCHANGEPLY¶
A policy that specifies update behavior for the crawler.
io_autodataquality TYPE REF TO /AWS1/CL_GLUAUTODATAQUALITY /AWS1/CL_GLUAUTODATAQUALITY¶
Specifies whether to automatically enable data quality evaluation for the S3 Glue Parquet target. When set to
true, data quality checks are performed automatically during the write operation.
Queryable Attributes¶
Name¶
The name of the data target.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_NAME() |
Getter for NAME, with configurable default |
ASK_NAME() |
Getter for NAME w/ exceptions if field has no value |
HAS_NAME() |
Determine if NAME has a value |
Inputs¶
The nodes that are inputs to the data target.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_INPUTS() |
Getter for INPUTS, with configurable default |
ASK_INPUTS() |
Getter for INPUTS w/ exceptions if field has no value |
HAS_INPUTS() |
Determine if INPUTS has a value |
PartitionKeys¶
Specifies native partitioning using a sequence of keys.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_PARTITIONKEYS() |
Getter for PARTITIONKEYS, with configurable default |
ASK_PARTITIONKEYS() |
Getter for PARTITIONKEYS w/ exceptions if field has no value |
HAS_PARTITIONKEYS() |
Determine if PARTITIONKEYS has a value |
Path¶
A single Amazon S3 path to write to.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_PATH() |
Getter for PATH, with configurable default |
ASK_PATH() |
Getter for PATH w/ exceptions if field has no value |
HAS_PATH() |
Determine if PATH has a value |
Compression¶
Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are
"gzip"and"bzip").
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_COMPRESSION() |
Getter for COMPRESSION, with configurable default |
ASK_COMPRESSION() |
Getter for COMPRESSION w/ exceptions if field has no value |
HAS_COMPRESSION() |
Determine if COMPRESSION has a value |
NumberTargetPartitions¶
Specifies the number of target partitions for Parquet files when writing to Amazon S3 using Glue.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_NUMBERTARGETPARTITIONS() |
Getter for NUMBERTARGETPARTITIONS, with configurable default |
ASK_NUMBERTARGETPARTITIONS() |
Getter for NUMBERTARGETPARTITIONS w/ exceptions if field has |
HAS_NUMBERTARGETPARTITIONS() |
Determine if NUMBERTARGETPARTITIONS has a value |
SchemaChangePolicy¶
A policy that specifies update behavior for the crawler.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_SCHEMACHANGEPOLICY() |
Getter for SCHEMACHANGEPOLICY |
AutoDataQuality¶
Specifies whether to automatically enable data quality evaluation for the S3 Glue Parquet target. When set to
true, data quality checks are performed automatically during the write operation.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_AUTODATAQUALITY() |
Getter for AUTODATAQUALITY |