/AWS1/CL_GLUSNOWFLAKENODEDATA

Specifies configuration for Snowflake nodes in Glue Studio.

CONSTRUCTOR

IMPORTING

Optional arguments:

iv_sourcetype TYPE /AWS1/GLUGENERICLIMITEDSTRING /AWS1/GLUGENERICLIMITEDSTRING

Specifies how retrieved data is specified. Valid values: "table", "query".

io_connection TYPE REF TO /AWS1/CL_GLUOPTION /AWS1/CL_GLUOPTION

Specifies a Glue Data Catalog Connection to a Snowflake endpoint.

iv_schema TYPE /AWS1/GLUGENERICSTRING /AWS1/GLUGENERICSTRING

Specifies a Snowflake database schema for your node to use.

iv_table TYPE /AWS1/GLUGENERICSTRING /AWS1/GLUGENERICSTRING

Specifies a Snowflake table for your node to use.

iv_database TYPE /AWS1/GLUGENERICSTRING /AWS1/GLUGENERICSTRING

Specifies a Snowflake database for your node to use.

iv_tempdir TYPE /AWS1/GLUENCLOSEDINSTRINGPRP /AWS1/GLUENCLOSEDINSTRINGPRP

Not currently used.

io_iamrole TYPE REF TO /AWS1/CL_GLUOPTION /AWS1/CL_GLUOPTION

Not currently used.

it_additionaloptions TYPE /AWS1/CL_GLUADDLOPTIONS_W=>TT_ADDITIONALOPTIONS TT_ADDITIONALOPTIONS

Specifies additional options passed to the Snowflake connector. If options are specified elsewhere in this node, this will take precedence.

iv_samplequery TYPE /AWS1/GLUGENERICSTRING /AWS1/GLUGENERICSTRING

A SQL string used to retrieve data with the query sourcetype.

iv_preaction TYPE /AWS1/GLUGENERICSTRING /AWS1/GLUGENERICSTRING

A SQL string run before the Snowflake connector performs its standard actions.

iv_postaction TYPE /AWS1/GLUGENERICSTRING /AWS1/GLUGENERICSTRING

A SQL string run after the Snowflake connector performs its standard actions.

iv_action TYPE /AWS1/GLUGENERICSTRING /AWS1/GLUGENERICSTRING

Specifies what action to take when writing to a table with preexisting data. Valid values: append, merge, truncate, drop.

iv_upsert TYPE /AWS1/GLUBOOLEANVALUE /AWS1/GLUBOOLEANVALUE

Used when Action is append. Specifies the resolution behavior when a row already exists. If true, preexisting rows will be updated. If false, those rows will be inserted.

iv_mergeaction TYPE /AWS1/GLUGENERICLIMITEDSTRING /AWS1/GLUGENERICLIMITEDSTRING

Specifies a merge action. Valid values: simple, custom. If simple, merge behavior is defined by MergeWhenMatched and MergeWhenNotMatched. If custom, defined by MergeClause.

iv_mergewhenmatched TYPE /AWS1/GLUGENERICLIMITEDSTRING /AWS1/GLUGENERICLIMITEDSTRING

Specifies how to resolve records that match preexisting data when merging. Valid values: update, delete.

iv_mergewhennotmatched TYPE /AWS1/GLUGENERICLIMITEDSTRING /AWS1/GLUGENERICLIMITEDSTRING

Specifies how to process records that do not match preexisting data when merging. Valid values: insert, none.

iv_mergeclause TYPE /AWS1/GLUGENERICSTRING /AWS1/GLUGENERICSTRING

A SQL statement that specifies a custom merge behavior.

iv_stagingtable TYPE /AWS1/GLUGENERICSTRING /AWS1/GLUGENERICSTRING

The name of a staging table used when performing merge or upsert append actions. Data is written to this table, then moved to table by a generated postaction.

it_selectedcolumns TYPE /AWS1/CL_GLUOPTION=>TT_OPTIONLIST TT_OPTIONLIST

Specifies the columns combined to identify a record when detecting matches for merges and upserts. A list of structures with value, label and description keys. Each structure describes a column.

iv_autopushdown TYPE /AWS1/GLUBOOLEANVALUE /AWS1/GLUBOOLEANVALUE

Specifies whether automatic query pushdown is enabled. If pushdown is enabled, then when a query is run on Spark, if part of the query can be "pushed down" to the Snowflake server, it is pushed down. This improves performance of some queries.

it_tableschema TYPE /AWS1/CL_GLUOPTION=>TT_OPTIONLIST TT_OPTIONLIST

Manually defines the target schema for the node. A list of structures with value , label and description keys. Each structure defines a column.

---

Queryable Attributes

SourceType

Specifies how retrieved data is specified. Valid values: "table", "query".

Accessible with the following methods

Method	Description
GET_SOURCETYPE()	Getter for SOURCETYPE, with configurable default
ASK_SOURCETYPE()	Getter for SOURCETYPE w/ exceptions if field has no value
HAS_SOURCETYPE()	Determine if SOURCETYPE has a value

Connection

Specifies a Glue Data Catalog Connection to a Snowflake endpoint.

Accessible with the following methods

Method	Description
GET_CONNECTION()	Getter for CONNECTION

Schema

Specifies a Snowflake database schema for your node to use.

Accessible with the following methods

Method	Description
GET_SCHEMA()	Getter for SCHEMA, with configurable default
ASK_SCHEMA()	Getter for SCHEMA w/ exceptions if field has no value
HAS_SCHEMA()	Determine if SCHEMA has a value

Table

Specifies a Snowflake table for your node to use.

Accessible with the following methods

Method	Description
GET_TABLE()	Getter for TABLE, with configurable default
ASK_TABLE()	Getter for TABLE w/ exceptions if field has no value
HAS_TABLE()	Determine if TABLE has a value

Database

Specifies a Snowflake database for your node to use.

Accessible with the following methods

Method	Description
GET_DATABASE()	Getter for DATABASE, with configurable default
ASK_DATABASE()	Getter for DATABASE w/ exceptions if field has no value
HAS_DATABASE()	Determine if DATABASE has a value

TempDir

Not currently used.

Accessible with the following methods

Method	Description
GET_TEMPDIR()	Getter for TEMPDIR, with configurable default
ASK_TEMPDIR()	Getter for TEMPDIR w/ exceptions if field has no value
HAS_TEMPDIR()	Determine if TEMPDIR has a value

IamRole

Not currently used.

Accessible with the following methods

Method	Description
GET_IAMROLE()	Getter for IAMROLE

AdditionalOptions

Specifies additional options passed to the Snowflake connector. If options are specified elsewhere in this node, this will take precedence.

Accessible with the following methods

Method	Description
GET_ADDITIONALOPTIONS()	Getter for ADDITIONALOPTIONS, with configurable default
ASK_ADDITIONALOPTIONS()	Getter for ADDITIONALOPTIONS w/ exceptions if field has no v
HAS_ADDITIONALOPTIONS()	Determine if ADDITIONALOPTIONS has a value

SampleQuery

A SQL string used to retrieve data with the query sourcetype.

Accessible with the following methods

Method	Description
GET_SAMPLEQUERY()	Getter for SAMPLEQUERY, with configurable default
ASK_SAMPLEQUERY()	Getter for SAMPLEQUERY w/ exceptions if field has no value
HAS_SAMPLEQUERY()	Determine if SAMPLEQUERY has a value

PreAction

A SQL string run before the Snowflake connector performs its standard actions.

Accessible with the following methods

Method	Description
GET_PREACTION()	Getter for PREACTION, with configurable default
ASK_PREACTION()	Getter for PREACTION w/ exceptions if field has no value
HAS_PREACTION()	Determine if PREACTION has a value

PostAction

A SQL string run after the Snowflake connector performs its standard actions.

Accessible with the following methods

Method	Description
GET_POSTACTION()	Getter for POSTACTION, with configurable default
ASK_POSTACTION()	Getter for POSTACTION w/ exceptions if field has no value
HAS_POSTACTION()	Determine if POSTACTION has a value

Action

Specifies what action to take when writing to a table with preexisting data. Valid values: append, merge, truncate, drop.

Accessible with the following methods

Method	Description
GET_ACTION()	Getter for ACTION, with configurable default
ASK_ACTION()	Getter for ACTION w/ exceptions if field has no value
HAS_ACTION()	Determine if ACTION has a value

Upsert

Used when Action is append. Specifies the resolution behavior when a row already exists. If true, preexisting rows will be updated. If false, those rows will be inserted.

Accessible with the following methods

Method	Description
GET_UPSERT()	Getter for UPSERT

MergeAction

Specifies a merge action. Valid values: simple, custom. If simple, merge behavior is defined by MergeWhenMatched and MergeWhenNotMatched. If custom, defined by MergeClause.

Accessible with the following methods

Method	Description
GET_MERGEACTION()	Getter for MERGEACTION, with configurable default
ASK_MERGEACTION()	Getter for MERGEACTION w/ exceptions if field has no value
HAS_MERGEACTION()	Determine if MERGEACTION has a value

MergeWhenMatched

Specifies how to resolve records that match preexisting data when merging. Valid values: update, delete.

Accessible with the following methods

Method	Description
GET_MERGEWHENMATCHED()	Getter for MERGEWHENMATCHED, with configurable default
ASK_MERGEWHENMATCHED()	Getter for MERGEWHENMATCHED w/ exceptions if field has no va
HAS_MERGEWHENMATCHED()	Determine if MERGEWHENMATCHED has a value

MergeWhenNotMatched

Specifies how to process records that do not match preexisting data when merging. Valid values: insert, none.

Accessible with the following methods

Method	Description
GET_MERGEWHENNOTMATCHED()	Getter for MERGEWHENNOTMATCHED, with configurable default
ASK_MERGEWHENNOTMATCHED()	Getter for MERGEWHENNOTMATCHED w/ exceptions if field has no
HAS_MERGEWHENNOTMATCHED()	Determine if MERGEWHENNOTMATCHED has a value

MergeClause

A SQL statement that specifies a custom merge behavior.

Accessible with the following methods

Method	Description
GET_MERGECLAUSE()	Getter for MERGECLAUSE, with configurable default
ASK_MERGECLAUSE()	Getter for MERGECLAUSE w/ exceptions if field has no value
HAS_MERGECLAUSE()	Determine if MERGECLAUSE has a value

StagingTable

The name of a staging table used when performing merge or upsert append actions. Data is written to this table, then moved to table by a generated postaction.

Accessible with the following methods

Method	Description
GET_STAGINGTABLE()	Getter for STAGINGTABLE, with configurable default
ASK_STAGINGTABLE()	Getter for STAGINGTABLE w/ exceptions if field has no value
HAS_STAGINGTABLE()	Determine if STAGINGTABLE has a value

SelectedColumns

Specifies the columns combined to identify a record when detecting matches for merges and upserts. A list of structures with value, label and description keys. Each structure describes a column.

Accessible with the following methods

Method	Description
GET_SELECTEDCOLUMNS()	Getter for SELECTEDCOLUMNS, with configurable default
ASK_SELECTEDCOLUMNS()	Getter for SELECTEDCOLUMNS w/ exceptions if field has no val
HAS_SELECTEDCOLUMNS()	Determine if SELECTEDCOLUMNS has a value

AutoPushdown

Specifies whether automatic query pushdown is enabled. If pushdown is enabled, then when a query is run on Spark, if part of the query can be "pushed down" to the Snowflake server, it is pushed down. This improves performance of some queries.

Accessible with the following methods

Method	Description
GET_AUTOPUSHDOWN()	Getter for AUTOPUSHDOWN

TableSchema

Manually defines the target schema for the node. A list of structures with value , label and description keys. Each structure defines a column.

Accessible with the following methods

Method	Description
GET_TABLESCHEMA()	Getter for TABLESCHEMA, with configurable default
ASK_TABLESCHEMA()	Getter for TABLESCHEMA w/ exceptions if field has no value
HAS_TABLESCHEMA()	Determine if TABLESCHEMA has a value