/AWS1/CL_KFKICEBERGDSTCONF¶
Configuration of an Apache Iceberg destination for a channel.
CONSTRUCTOR¶
IMPORTING¶
Required arguments:¶
iv_appendonly TYPE /AWS1/KFK__BOOLEAN /AWS1/KFK__BOOLEAN¶
Whether the destination is append-only. Must be true; updates and deletes are not supported.
io_deadletterqueues3 TYPE REF TO /AWS1/CL_KFKDEADLETTERQUEUES3 /AWS1/CL_KFKDEADLETTERQUEUES3¶
The Amazon S3 bucket and prefix where MSK writes records that fail to deliver.
it_destinationtablelist TYPE /AWS1/CL_KFKDESTINATIONTABLE=>TT___LISTOFDESTINATIONTABLE TT___LISTOFDESTINATIONTABLE¶
The destination Iceberg tables. Currently exactly one table must be specified.
io_schemaevolution TYPE REF TO /AWS1/CL_KFKSCHEMAEVOLUTION /AWS1/CL_KFKSCHEMAEVOLUTION¶
Configuration controlling whether the destination table's schema is evolved to match incoming records.
iv_serviceexecutionrolearn TYPE /AWS1/KFK__STRING /AWS1/KFK__STRING¶
The Amazon Resource Name (ARN) of the IAM role that MSK assumes to access the destination table, the AWS Glue Data Catalog, and the dead-letter Amazon S3 bucket.
io_tablecreation TYPE REF TO /AWS1/CL_KFKTABLECREATION /AWS1/CL_KFKTABLECREATION¶
Configuration controlling whether MSK creates the destination table if it does not already exist.
Optional arguments:¶
io_catalog TYPE REF TO /AWS1/CL_KFKCATALOG /AWS1/CL_KFKCATALOG¶
The AWS Glue Data Catalog and S3 Tables warehouse used by the destination.
iv_datafreshnessinseconds TYPE /AWS1/KFK__INTEGER /AWS1/KFK__INTEGER¶
The maximum time, in seconds, that records buffer in MSK before being flushed to the destination. Allowed range: 300 to 900. Default: 600.
iv_compressiontype TYPE /AWS1/KFKICEBERGCOMPRSSNTYPE /AWS1/KFKICEBERGCOMPRSSNTYPE¶
The compression codec for Iceberg table data files. Defaults to ZSTD.
Queryable Attributes¶
AppendOnly¶
Whether the destination is append-only. Must be true; updates and deletes are not supported.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_APPENDONLY() |
Getter for APPENDONLY, with configurable default |
ASK_APPENDONLY() |
Getter for APPENDONLY w/ exceptions if field has no value |
HAS_APPENDONLY() |
Determine if APPENDONLY has a value |
Catalog¶
The AWS Glue Data Catalog and S3 Tables warehouse used by the destination.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_CATALOG() |
Getter for CATALOG |
DataFreshnessInSeconds¶
The maximum time, in seconds, that records buffer in MSK before being flushed to the destination. Allowed range: 300 to 900. Default: 600.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_DATAFRESHNESSINSECONDS() |
Getter for DATAFRESHNESSINSECONDS, with configurable default |
ASK_DATAFRESHNESSINSECONDS() |
Getter for DATAFRESHNESSINSECONDS w/ exceptions if field has |
HAS_DATAFRESHNESSINSECONDS() |
Determine if DATAFRESHNESSINSECONDS has a value |
DeadLetterQueueS3¶
The Amazon S3 bucket and prefix where MSK writes records that fail to deliver.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_DEADLETTERQUEUES3() |
Getter for DEADLETTERQUEUES3 |
DestinationTableList¶
The destination Iceberg tables. Currently exactly one table must be specified.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_DESTINATIONTABLELIST() |
Getter for DESTINATIONTABLELIST, with configurable default |
ASK_DESTINATIONTABLELIST() |
Getter for DESTINATIONTABLELIST w/ exceptions if field has n |
HAS_DESTINATIONTABLELIST() |
Determine if DESTINATIONTABLELIST has a value |
SchemaEvolution¶
Configuration controlling whether the destination table's schema is evolved to match incoming records.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_SCHEMAEVOLUTION() |
Getter for SCHEMAEVOLUTION |
ServiceExecutionRoleArn¶
The Amazon Resource Name (ARN) of the IAM role that MSK assumes to access the destination table, the AWS Glue Data Catalog, and the dead-letter Amazon S3 bucket.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_SERVICEEXECUTIONROLEARN() |
Getter for SERVICEEXECUTIONROLEARN, with configurable defaul |
ASK_SERVICEEXECUTIONROLEARN() |
Getter for SERVICEEXECUTIONROLEARN w/ exceptions if field ha |
HAS_SERVICEEXECUTIONROLEARN() |
Determine if SERVICEEXECUTIONROLEARN has a value |
TableCreation¶
Configuration controlling whether MSK creates the destination table if it does not already exist.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_TABLECREATION() |
Getter for TABLECREATION |
CompressionType¶
The compression codec for Iceberg table data files. Defaults to ZSTD.
Accessible with the following methods¶
| Method | Description |
|---|---|
GET_COMPRESSIONTYPE() |
Getter for COMPRESSIONTYPE, with configurable default |
ASK_COMPRESSIONTYPE() |
Getter for COMPRESSIONTYPE w/ exceptions if field has no val |
HAS_COMPRESSIONTYPE() |
Determine if COMPRESSIONTYPE has a value |