/AWS1/CL_GLUS3HUDIDIRECTTARGET¶
Specifies a target that writes to a Hudi data source in Amazon S3.
CONSTRUCTOR¶
IMPORTING¶
Required arguments:¶
iv_name TYPE /AWS1/GLUNODENAME /AWS1/GLUNODENAME¶
The name of the data target.
it_inputs TYPE /AWS1/CL_GLUONEINPUT_W=>TT_ONEINPUT TT_ONEINPUT¶
The nodes that are inputs to the data target.
iv_path TYPE /AWS1/GLUENCLOSEDINSTRINGPRP /AWS1/GLUENCLOSEDINSTRINGPRP¶
The Amazon S3 path of your Hudi data source to write to.
iv_compression TYPE /AWS1/GLUHUDITGTCOMPRESSIONT00 /AWS1/GLUHUDITGTCOMPRESSIONT00¶
Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are
"gzip"and"bzip").
iv_format TYPE /AWS1/GLUTARGETFORMAT /AWS1/GLUTARGETFORMAT¶
Specifies the data output format for the target.
it_additionaloptions TYPE /AWS1/CL_GLUADDLOPTIONS_W=>TT_ADDITIONALOPTIONS TT_ADDITIONALOPTIONS¶
Specifies additional connection options for the connector.
Optional arguments:¶
iv_numbertargetpartitions TYPE /AWS1/GLUNUMTARGETPARTSSTRING /AWS1/GLUNUMTARGETPARTSSTRING¶
Specifies the number of target partitions for distributing Hudi dataset files across Amazon S3.
it_partitionkeys TYPE /AWS1/CL_GLUENCLOSEDINSTRPRP00=>TT_GLUESTUDIOPATHLIST TT_GLUESTUDIOPATHLIST¶
Specifies native partitioning using a sequence of keys.
io_schemachangepolicy TYPE REF TO /AWS1/CL_GLUDIRECTSCHCHANGEPLY /AWS1/CL_GLUDIRECTSCHCHANGEPLY¶
A policy that specifies update behavior for the crawler.
io_autodataquality TYPE REF TO /AWS1/CL_GLUAUTODATAQUALITY /AWS1/CL_GLUAUTODATAQUALITY¶
Specifies whether to automatically enable data quality evaluation for the S3 Hudi direct target. When set to
true, data quality checks are performed automatically during the write operation.
Queryable Attributes¶
Name¶
The name of the data target.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_NAME() |
Getter for NAME, with configurable default |
ASK_NAME() |
Getter for NAME w/ exceptions if field has no value |
HAS_NAME() |
Determine if NAME has a value |
Inputs¶
The nodes that are inputs to the data target.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_INPUTS() |
Getter for INPUTS, with configurable default |
ASK_INPUTS() |
Getter for INPUTS w/ exceptions if field has no value |
HAS_INPUTS() |
Determine if INPUTS has a value |
Path¶
The Amazon S3 path of your Hudi data source to write to.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_PATH() |
Getter for PATH, with configurable default |
ASK_PATH() |
Getter for PATH w/ exceptions if field has no value |
HAS_PATH() |
Determine if PATH has a value |
Compression¶
Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are
"gzip"and"bzip").
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_COMPRESSION() |
Getter for COMPRESSION, with configurable default |
ASK_COMPRESSION() |
Getter for COMPRESSION w/ exceptions if field has no value |
HAS_COMPRESSION() |
Determine if COMPRESSION has a value |
NumberTargetPartitions¶
Specifies the number of target partitions for distributing Hudi dataset files across Amazon S3.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_NUMBERTARGETPARTITIONS() |
Getter for NUMBERTARGETPARTITIONS, with configurable default |
ASK_NUMBERTARGETPARTITIONS() |
Getter for NUMBERTARGETPARTITIONS w/ exceptions if field has |
HAS_NUMBERTARGETPARTITIONS() |
Determine if NUMBERTARGETPARTITIONS has a value |
PartitionKeys¶
Specifies native partitioning using a sequence of keys.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_PARTITIONKEYS() |
Getter for PARTITIONKEYS, with configurable default |
ASK_PARTITIONKEYS() |
Getter for PARTITIONKEYS w/ exceptions if field has no value |
HAS_PARTITIONKEYS() |
Determine if PARTITIONKEYS has a value |
Format¶
Specifies the data output format for the target.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_FORMAT() |
Getter for FORMAT, with configurable default |
ASK_FORMAT() |
Getter for FORMAT w/ exceptions if field has no value |
HAS_FORMAT() |
Determine if FORMAT has a value |
AdditionalOptions¶
Specifies additional connection options for the connector.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_ADDITIONALOPTIONS() |
Getter for ADDITIONALOPTIONS, with configurable default |
ASK_ADDITIONALOPTIONS() |
Getter for ADDITIONALOPTIONS w/ exceptions if field has no v |
HAS_ADDITIONALOPTIONS() |
Determine if ADDITIONALOPTIONS has a value |
SchemaChangePolicy¶
A policy that specifies update behavior for the crawler.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_SCHEMACHANGEPOLICY() |
Getter for SCHEMACHANGEPOLICY |
AutoDataQuality¶
Specifies whether to automatically enable data quality evaluation for the S3 Hudi direct target. When set to
true, data quality checks are performed automatically during the write operation.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_AUTODATAQUALITY() |
Getter for AUTODATAQUALITY |