Skip to content

/AWS1/CL_TSIINFLUXDBV3ENTPARMS

All the customer-modifiable InfluxDB v3 Enterprise parameters in Timestream for InfluxDB.

CONSTRUCTOR

IMPORTING

Required arguments:

iv_ingestqueryinstances TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Specifies number of instances in the DbCluster which can both ingest and query.

iv_queryonlyinstances TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Specifies number of instances in the DbCluster which can only query.

iv_dedicatedcompactor TYPE /AWS1/TSIBOOLEAN /AWS1/TSIBOOLEAN

Specifies if the compactor instance should be a standalone instance or not.

Optional arguments:

iv_queryfilelimit TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Limits the number of Parquet files a query can access. If a query attempts to read more than this limit, InfluxDB 3 returns an error.

Default: 432

iv_querylogsize TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Defines the size of the query log. Up to this many queries remain in the log before older queries are evicted to make room for new ones.

Default: 1000

iv_logfilter TYPE /AWS1/TSISTRING /AWS1/TSISTRING

Sets the filter directive for logs.

iv_logformat TYPE /AWS1/TSILOGFORMATS /AWS1/TSILOGFORMATS

Defines the message format for logs.

Default: full

iv_datafusionnumthreads TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Sets the maximum number of DataFusion runtime threads to use.

iv_datafusionruntimetype TYPE /AWS1/TSIDATAFUSIONRUNTIMETYPE /AWS1/TSIDATAFUSIONRUNTIMETYPE

Specifies the DataFusion tokio runtime type.

Default: multi-thread

iv_datafusionrundislifoslot TYPE /AWS1/TSIBOOLEAN /AWS1/TSIBOOLEAN

Disables the LIFO slot of the DataFusion runtime.

iv_datafusionrtimeevtinter00 TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Sets the number of scheduler ticks after which the scheduler of the DataFusion tokio runtime polls for external events–for example: timers, I/O.

iv_datafusionrunglbqueuein00 TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Sets the number of scheduler ticks after which the scheduler of the DataFusion runtime polls the global task queue.

iv_datafusionrunmaxblkingt00 TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Specifies the limit for additional threads spawned by the DataFusion runtime.

iv_datafusionrunmaxioevtsp00 TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Configures the maximum number of events processed per tick by the tokio DataFusion runtime.

io_datafusionrunthreadkeep00 TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Sets a custom timeout for a thread in the blocking pool of the tokio DataFusion runtime.

iv_datafusionrunthreadprio00 TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Sets the thread priority for tokio DataFusion runtime workers.

Default: 10

iv_datafusionmaxparquetfan00 TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

When multiple parquet files are required in a sorted way (deduplication for example), specifies the maximum fanout.

Default: 1000

iv_datafusionusecachedparq00 TYPE /AWS1/TSIBOOLEAN /AWS1/TSIBOOLEAN

Uses a cached parquet loader when reading parquet files from the object store.

iv_datafusionconfig TYPE /AWS1/TSISTRING /AWS1/TSISTRING

Provides custom configuration to DataFusion as a comma-separated list of key:value pairs.

iv_maxhttprequestsize TYPE /AWS1/TSILONG /AWS1/TSILONG

Specifies the maximum size of HTTP requests.

Default: 10485760

io_forcesnapshotmemthreshold TYPE REF TO /AWS1/CL_TSIPERCORABSOLUTELONG /AWS1/CL_TSIPERCORABSOLUTELONG

Specifies the threshold for the internal memory buffer. Supports either a percentage (portion of available memory) or absolute value in MB–for example: 70% or 100

Default: 70%

iv_walsnapshotsize TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Defines the number of WAL files to attempt to remove in a snapshot. This, multiplied by the interval, determines how often snapshots are taken.

Default: 600

iv_walmaxwritebuffersize TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Specifies the maximum number of write requests that can be buffered before a flush must be executed and succeed.

Default: 100000

iv_snapshottedwalfilestokeep TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Specifies the number of snapshotted WAL files to retain in the object store. Flushing the WAL files does not clear the WAL files immediately; they are deleted when the number of snapshotted WAL files exceeds this number.

Default: 300

io_preemptivecacheage TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies the interval to prefetch into the Parquet cache during compaction.

Default: 3d

iv_parquetmemcachepruneper00 TYPE /AWS1/RT_FLOAT_AS_STRING /AWS1/RT_FLOAT_AS_STRING

Specifies the percentage of entries to prune during a prune operation on the in-memory Parquet cache.

Default: 0.1

io_parquetmemcachepruneint00 TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Sets the interval to check if the in-memory Parquet cache needs to be pruned.

Default: 1s

iv_disableparquetmemcache TYPE /AWS1/TSIBOOLEAN /AWS1/TSIBOOLEAN

Disables the in-memory Parquet cache. By default, the cache is enabled.

io_parquetmemcachequerypat00 TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies the time window for caching recent Parquet files in memory.

Default: 5h

io_lastcacheevictioninterval TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies the interval to evict expired entries from the Last-N-Value cache, expressed as a human-readable duration–for example: 20s, 1m, 1h.

Default: 10s

io_distinctcacheevictionin00 TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies the interval to evict expired entries from the distinct value cache, expressed as a human-readable duration–for example: 20s, 1m, 1h.

Default: 10s

io_gen1duration TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies the duration that Parquet files are arranged into. Data timestamps land each row into a file of this duration. Supported durations are 1m, 5m, and 10m. These files are known as “generation 1” files, which the compactor can merge into larger generations.

Default: 10m

io_execmempoolbytes TYPE REF TO /AWS1/CL_TSIPERCORABSOLUTELONG /AWS1/CL_TSIPERCORABSOLUTELONG

Specifies the size of memory pool used during query execution. Can be given as absolute value in bytes or as a percentage of the total available memory–for example: 8000000000 or 10%.

Default: 20%

io_parquetmemcachesize TYPE REF TO /AWS1/CL_TSIPERCORABSOLUTELONG /AWS1/CL_TSIPERCORABSOLUTELONG

Specifies the size of the in-memory Parquet cache in megabytes or percentage of total available memory.

Default: 20%

iv_walreplayfailonerror TYPE /AWS1/TSIBOOLEAN /AWS1/TSIBOOLEAN

Determines whether WAL replay should fail when encountering errors.

Default: false

iv_walreplayconcurrencylimit TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Concurrency limit during WAL replay. Setting this number too high can lead to OOM. The default is dynamically determined.

Default: max(num_cpus, 10)

iv_tableindexcachemaxentries TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Specifies the maximum number of entries in the table index cache.

Default: 1000

iv_tblidxcacheconcurrencylmt TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Limits the concurrency level for table index cache operations.

Default: 8

io_gen1lookbackduration TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies how far back to look when creating generation 1 Parquet files.

Default: 24h

io_retentioncheckinterval TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

The interval at which retention policies are checked and enforced. Enter as a human-readable time–for example: 30m or 1h.

Default: 30m

io_deletegraceperiod TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies the grace period before permanently deleting data.

Default: 24h

io_harddeletedefaultduration TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Sets the default duration for hard deletion of data.

Default: 90d

iv_compactionrowlimit TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Specifies the soft limit for the number of rows per file that the compactor writes. The compactor may write more rows than this limit.

Default: 1000000

iv_compactmaxnumfilesperplan TYPE /AWS1/TSIINTEGER /AWS1/TSIINTEGER

Sets the maximum number of files included in any compaction plan.

Default: 500

io_compactiongen2duration TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies the duration of the first level of compaction (gen2). Later levels of compaction are multiples of this duration. This value should be equal to or greater than the gen1 duration.

Default: 20m

iv_compactionmultipliers TYPE /AWS1/TSISTRING /AWS1/TSISTRING

Specifies a comma-separated list of multiples defining the duration of each level of compaction. The number of elements in the list determines the number of compaction levels. The first element specifies the duration of the first level (gen3); subsequent levels are multiples of the previous level.

Default: 3,4,6,5

io_compactioncleanupwait TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies the amount of time that the compactor waits after finishing a compaction run to delete files marked as needing deletion during that compaction run.

Default: 10m

io_compactioncheckinterval TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies how often the compactor checks for new compaction work to perform.

Default: 10s

iv_lastvalcachedisfrmhistory TYPE /AWS1/TSIBOOLEAN /AWS1/TSIBOOLEAN

Disables populating the last-N-value cache from historical data. If disabled, the cache is still populated with data from the write-ahead log (WAL).

iv_distinctvalcachedisfrmh00 TYPE /AWS1/TSIBOOLEAN /AWS1/TSIBOOLEAN

Disables populating the distinct value cache from historical data. If disabled, the cache is still populated with data from the write-ahead log (WAL).

io_replicationinterval TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Specifies the interval at which data replication occurs between cluster nodes.

Default: 250ms

io_catalogsyncinterval TYPE REF TO /AWS1/CL_TSIDURATION /AWS1/CL_TSIDURATION

Defines how often the catalog synchronizes across cluster nodes.

Default: 10s


Queryable Attributes

queryFileLimit

Limits the number of Parquet files a query can access. If a query attempts to read more than this limit, InfluxDB 3 returns an error.

Default: 432

Accessible with the following methods

Method Description
GET_QUERYFILELIMIT() Getter for QUERYFILELIMIT, with configurable default
ASK_QUERYFILELIMIT() Getter for QUERYFILELIMIT w/ exceptions if field has no valu
HAS_QUERYFILELIMIT() Determine if QUERYFILELIMIT has a value

queryLogSize

Defines the size of the query log. Up to this many queries remain in the log before older queries are evicted to make room for new ones.

Default: 1000

Accessible with the following methods

Method Description
GET_QUERYLOGSIZE() Getter for QUERYLOGSIZE, with configurable default
ASK_QUERYLOGSIZE() Getter for QUERYLOGSIZE w/ exceptions if field has no value
HAS_QUERYLOGSIZE() Determine if QUERYLOGSIZE has a value

logFilter

Sets the filter directive for logs.

Accessible with the following methods

Method Description
GET_LOGFILTER() Getter for LOGFILTER, with configurable default
ASK_LOGFILTER() Getter for LOGFILTER w/ exceptions if field has no value
HAS_LOGFILTER() Determine if LOGFILTER has a value

logFormat

Defines the message format for logs.

Default: full

Accessible with the following methods

Method Description
GET_LOGFORMAT() Getter for LOGFORMAT, with configurable default
ASK_LOGFORMAT() Getter for LOGFORMAT w/ exceptions if field has no value
HAS_LOGFORMAT() Determine if LOGFORMAT has a value

dataFusionNumThreads

Sets the maximum number of DataFusion runtime threads to use.

Accessible with the following methods

Method Description
GET_DATAFUSIONNUMTHREADS() Getter for DATAFUSIONNUMTHREADS, with configurable default
ASK_DATAFUSIONNUMTHREADS() Getter for DATAFUSIONNUMTHREADS w/ exceptions if field has n
HAS_DATAFUSIONNUMTHREADS() Determine if DATAFUSIONNUMTHREADS has a value

dataFusionRuntimeType

Specifies the DataFusion tokio runtime type.

Default: multi-thread

Accessible with the following methods

Method Description
GET_DATAFUSIONRUNTIMETYPE() Getter for DATAFUSIONRUNTIMETYPE, with configurable default
ASK_DATAFUSIONRUNTIMETYPE() Getter for DATAFUSIONRUNTIMETYPE w/ exceptions if field has
HAS_DATAFUSIONRUNTIMETYPE() Determine if DATAFUSIONRUNTIMETYPE has a value

dataFusionRuntimeDisableLifoSlot

Disables the LIFO slot of the DataFusion runtime.

Accessible with the following methods

Method Description
GET_DATAFUSIONRUNDISLIFOSLOT() Getter for DATAFUSIONRUNTIMEDISLIFOSLOT, with configurable d
ASK_DATAFUSIONRUNDISLIFOSLOT() Getter for DATAFUSIONRUNTIMEDISLIFOSLOT w/ exceptions if fie
HAS_DATAFUSIONRUNDISLIFOSLOT() Determine if DATAFUSIONRUNTIMEDISLIFOSLOT has a value

dataFusionRuntimeEventInterval

Sets the number of scheduler ticks after which the scheduler of the DataFusion tokio runtime polls for external events–for example: timers, I/O.

Accessible with the following methods

Method Description
GET_DATAFUSIONRTIMEEVTINTE00() Getter for DATAFUSIONRTIMEEVENTINTERVAL, with configurable d
ASK_DATAFUSIONRTIMEEVTINTE00() Getter for DATAFUSIONRTIMEEVENTINTERVAL w/ exceptions if fie
HAS_DATAFUSIONRTIMEEVTINTE00() Determine if DATAFUSIONRTIMEEVENTINTERVAL has a value

dataFusionRuntimeGlobalQueueInterval

Sets the number of scheduler ticks after which the scheduler of the DataFusion runtime polls the global task queue.

Accessible with the following methods

Method Description
GET_DATAFUSIONRUNGLBQUEUEI00() Getter for DATAFUSIONRUNGLBQUEUEINTER00, with configurable d
ASK_DATAFUSIONRUNGLBQUEUEI00() Getter for DATAFUSIONRUNGLBQUEUEINTER00 w/ exceptions if fie
HAS_DATAFUSIONRUNGLBQUEUEI00() Determine if DATAFUSIONRUNGLBQUEUEINTER00 has a value

dataFusionRuntimeMaxBlockingThreads

Specifies the limit for additional threads spawned by the DataFusion runtime.

Accessible with the following methods

Method Description
GET_DATAFUSIONRUNMAXBLKING00() Getter for DATAFUSIONRUNMAXBLKINGTHRE00, with configurable d
ASK_DATAFUSIONRUNMAXBLKING00() Getter for DATAFUSIONRUNMAXBLKINGTHRE00 w/ exceptions if fie
HAS_DATAFUSIONRUNMAXBLKING00() Determine if DATAFUSIONRUNMAXBLKINGTHRE00 has a value

dataFusionRuntimeMaxIoEventsPerTick

Configures the maximum number of events processed per tick by the tokio DataFusion runtime.

Accessible with the following methods

Method Description
GET_DATAFUSIONRUNMAXIOEVTS00() Getter for DATAFUSIONRUNMAXIOEVTSPERT00, with configurable d
ASK_DATAFUSIONRUNMAXIOEVTS00() Getter for DATAFUSIONRUNMAXIOEVTSPERT00 w/ exceptions if fie
HAS_DATAFUSIONRUNMAXIOEVTS00() Determine if DATAFUSIONRUNMAXIOEVTSPERT00 has a value

dataFusionRuntimeThreadKeepAlive

Sets a custom timeout for a thread in the blocking pool of the tokio DataFusion runtime.

Accessible with the following methods

Method Description
GET_DATAFUSIONRUNTHREADKEE00() Getter for DATAFUSIONRUNTHREADKEEPALIVE

dataFusionRuntimeThreadPriority

Sets the thread priority for tokio DataFusion runtime workers.

Default: 10

Accessible with the following methods

Method Description
GET_DATAFUSIONRUNTHREADPRI00() Getter for DATAFUSIONRUNTHREADPRIORITY, with configurable de
ASK_DATAFUSIONRUNTHREADPRI00() Getter for DATAFUSIONRUNTHREADPRIORITY w/ exceptions if fiel
HAS_DATAFUSIONRUNTHREADPRI00() Determine if DATAFUSIONRUNTHREADPRIORITY has a value

dataFusionMaxParquetFanout

When multiple parquet files are required in a sorted way (deduplication for example), specifies the maximum fanout.

Default: 1000

Accessible with the following methods

Method Description
GET_DATAFUSIONMAXPARQUETFA00() Getter for DATAFUSIONMAXPARQUETFANOUT, with configurable def
ASK_DATAFUSIONMAXPARQUETFA00() Getter for DATAFUSIONMAXPARQUETFANOUT w/ exceptions if field
HAS_DATAFUSIONMAXPARQUETFA00() Determine if DATAFUSIONMAXPARQUETFANOUT has a value

dataFusionUseCachedParquetLoader

Uses a cached parquet loader when reading parquet files from the object store.

Accessible with the following methods

Method Description
GET_DATAFUSIONUSECACHEDPAR00() Getter for DATAFUSIONUSECACHEDPARQUET00, with configurable d
ASK_DATAFUSIONUSECACHEDPAR00() Getter for DATAFUSIONUSECACHEDPARQUET00 w/ exceptions if fie
HAS_DATAFUSIONUSECACHEDPAR00() Determine if DATAFUSIONUSECACHEDPARQUET00 has a value

dataFusionConfig

Provides custom configuration to DataFusion as a comma-separated list of key:value pairs.

Accessible with the following methods

Method Description
GET_DATAFUSIONCONFIG() Getter for DATAFUSIONCONFIG, with configurable default
ASK_DATAFUSIONCONFIG() Getter for DATAFUSIONCONFIG w/ exceptions if field has no va
HAS_DATAFUSIONCONFIG() Determine if DATAFUSIONCONFIG has a value

maxHttpRequestSize

Specifies the maximum size of HTTP requests.

Default: 10485760

Accessible with the following methods

Method Description
GET_MAXHTTPREQUESTSIZE() Getter for MAXHTTPREQUESTSIZE, with configurable default
ASK_MAXHTTPREQUESTSIZE() Getter for MAXHTTPREQUESTSIZE w/ exceptions if field has no
HAS_MAXHTTPREQUESTSIZE() Determine if MAXHTTPREQUESTSIZE has a value

forceSnapshotMemThreshold

Specifies the threshold for the internal memory buffer. Supports either a percentage (portion of available memory) or absolute value in MB–for example: 70% or 100

Default: 70%

Accessible with the following methods

Method Description
GET_FORCESNAPSHOTMEMTHRESH() Getter for FORCESNAPSHOTMEMTHRESHOLD

walSnapshotSize

Defines the number of WAL files to attempt to remove in a snapshot. This, multiplied by the interval, determines how often snapshots are taken.

Default: 600

Accessible with the following methods

Method Description
GET_WALSNAPSHOTSIZE() Getter for WALSNAPSHOTSIZE, with configurable default
ASK_WALSNAPSHOTSIZE() Getter for WALSNAPSHOTSIZE w/ exceptions if field has no val
HAS_WALSNAPSHOTSIZE() Determine if WALSNAPSHOTSIZE has a value

walMaxWriteBufferSize

Specifies the maximum number of write requests that can be buffered before a flush must be executed and succeed.

Default: 100000

Accessible with the following methods

Method Description
GET_WALMAXWRITEBUFFERSIZE() Getter for WALMAXWRITEBUFFERSIZE, with configurable default
ASK_WALMAXWRITEBUFFERSIZE() Getter for WALMAXWRITEBUFFERSIZE w/ exceptions if field has
HAS_WALMAXWRITEBUFFERSIZE() Determine if WALMAXWRITEBUFFERSIZE has a value

snapshottedWalFilesToKeep

Specifies the number of snapshotted WAL files to retain in the object store. Flushing the WAL files does not clear the WAL files immediately; they are deleted when the number of snapshotted WAL files exceeds this number.

Default: 300

Accessible with the following methods

Method Description
GET_SNAPTEDWALFILESTOKEEP() Getter for SNAPSHOTTEDWALFILESTOKEEP, with configurable defa
ASK_SNAPTEDWALFILESTOKEEP() Getter for SNAPSHOTTEDWALFILESTOKEEP w/ exceptions if field
HAS_SNAPTEDWALFILESTOKEEP() Determine if SNAPSHOTTEDWALFILESTOKEEP has a value

preemptiveCacheAge

Specifies the interval to prefetch into the Parquet cache during compaction.

Default: 3d

Accessible with the following methods

Method Description
GET_PREEMPTIVECACHEAGE() Getter for PREEMPTIVECACHEAGE

parquetMemCachePrunePercentage

Specifies the percentage of entries to prune during a prune operation on the in-memory Parquet cache.

Default: 0.1

Accessible with the following methods

Method Description
GET_PARQUETMEMCACHEPRUNEPE00() Getter for PARQUETMEMCACHEPRUNEPERCAGE, with configurable de
ASK_PARQUETMEMCACHEPRUNEPE00() Getter for PARQUETMEMCACHEPRUNEPERCAGE w/ exceptions if fiel
STR_PARQUETMEMCACHEPRUNEPE00() String format for PARQUETMEMCACHEPRUNEPERCAGE, with configur
HAS_PARQUETMEMCACHEPRUNEPE00() Determine if PARQUETMEMCACHEPRUNEPERCAGE has a value

parquetMemCachePruneInterval

Sets the interval to check if the in-memory Parquet cache needs to be pruned.

Default: 1s

Accessible with the following methods

Method Description
GET_PARQUETMEMCACHEPRUNEIN00() Getter for PARQUETMEMCACHEPRUNEINTERVAL

disableParquetMemCache

Disables the in-memory Parquet cache. By default, the cache is enabled.

Accessible with the following methods

Method Description
GET_DISABLEPARQUETMEMCACHE() Getter for DISABLEPARQUETMEMCACHE, with configurable default
ASK_DISABLEPARQUETMEMCACHE() Getter for DISABLEPARQUETMEMCACHE w/ exceptions if field has
HAS_DISABLEPARQUETMEMCACHE() Determine if DISABLEPARQUETMEMCACHE has a value

parquetMemCacheQueryPathDuration

Specifies the time window for caching recent Parquet files in memory.

Default: 5h

Accessible with the following methods

Method Description
GET_PARQUETMEMCACHEQUERYPA00() Getter for PARQUETMEMCACHEQUERYPATHDUR

lastCacheEvictionInterval

Specifies the interval to evict expired entries from the Last-N-Value cache, expressed as a human-readable duration–for example: 20s, 1m, 1h.

Default: 10s

Accessible with the following methods

Method Description
GET_LASTCACHEEVICTIONINTER00() Getter for LASTCACHEEVICTIONINTERVAL

distinctCacheEvictionInterval

Specifies the interval to evict expired entries from the distinct value cache, expressed as a human-readable duration–for example: 20s, 1m, 1h.

Default: 10s

Accessible with the following methods

Method Description
GET_DISTINCTCACHEEVICTIONI00() Getter for DISTINCTCACHEEVICTIONINTER00

gen1Duration

Specifies the duration that Parquet files are arranged into. Data timestamps land each row into a file of this duration. Supported durations are 1m, 5m, and 10m. These files are known as “generation 1” files, which the compactor can merge into larger generations.

Default: 10m

Accessible with the following methods

Method Description
GET_GEN1DURATION() Getter for GEN1DURATION

execMemPoolBytes

Specifies the size of memory pool used during query execution. Can be given as absolute value in bytes or as a percentage of the total available memory–for example: 8000000000 or 10%.

Default: 20%

Accessible with the following methods

Method Description
GET_EXECMEMPOOLBYTES() Getter for EXECMEMPOOLBYTES

parquetMemCacheSize

Specifies the size of the in-memory Parquet cache in megabytes or percentage of total available memory.

Default: 20%

Accessible with the following methods

Method Description
GET_PARQUETMEMCACHESIZE() Getter for PARQUETMEMCACHESIZE

walReplayFailOnError

Determines whether WAL replay should fail when encountering errors.

Default: false

Accessible with the following methods

Method Description
GET_WALREPLAYFAILONERROR() Getter for WALREPLAYFAILONERROR, with configurable default
ASK_WALREPLAYFAILONERROR() Getter for WALREPLAYFAILONERROR w/ exceptions if field has n
HAS_WALREPLAYFAILONERROR() Determine if WALREPLAYFAILONERROR has a value

walReplayConcurrencyLimit

Concurrency limit during WAL replay. Setting this number too high can lead to OOM. The default is dynamically determined.

Default: max(num_cpus, 10)

Accessible with the following methods

Method Description
GET_WALREPLAYCONCURRENCYLMT() Getter for WALREPLAYCONCURRENCYLIMIT, with configurable defa
ASK_WALREPLAYCONCURRENCYLMT() Getter for WALREPLAYCONCURRENCYLIMIT w/ exceptions if field
HAS_WALREPLAYCONCURRENCYLMT() Determine if WALREPLAYCONCURRENCYLIMIT has a value

tableIndexCacheMaxEntries

Specifies the maximum number of entries in the table index cache.

Default: 1000

Accessible with the following methods

Method Description
GET_TABLEIDXCACHEMAXENTRIES() Getter for TABLEINDEXCACHEMAXENTRIES, with configurable defa
ASK_TABLEIDXCACHEMAXENTRIES() Getter for TABLEINDEXCACHEMAXENTRIES w/ exceptions if field
HAS_TABLEIDXCACHEMAXENTRIES() Determine if TABLEINDEXCACHEMAXENTRIES has a value

tableIndexCacheConcurrencyLimit

Limits the concurrency level for table index cache operations.

Default: 8

Accessible with the following methods

Method Description
GET_TBLIDXCACHECONCURRENCY00() Getter for TBLIDXCACHECONCURRENCYLIMIT, with configurable de
ASK_TBLIDXCACHECONCURRENCY00() Getter for TBLIDXCACHECONCURRENCYLIMIT w/ exceptions if fiel
HAS_TBLIDXCACHECONCURRENCY00() Determine if TBLIDXCACHECONCURRENCYLIMIT has a value

gen1LookbackDuration

Specifies how far back to look when creating generation 1 Parquet files.

Default: 24h

Accessible with the following methods

Method Description
GET_GEN1LOOKBACKDURATION() Getter for GEN1LOOKBACKDURATION

retentionCheckInterval

The interval at which retention policies are checked and enforced. Enter as a human-readable time–for example: 30m or 1h.

Default: 30m

Accessible with the following methods

Method Description
GET_RETENTIONCHECKINTERVAL() Getter for RETENTIONCHECKINTERVAL

deleteGracePeriod

Specifies the grace period before permanently deleting data.

Default: 24h

Accessible with the following methods

Method Description
GET_DELETEGRACEPERIOD() Getter for DELETEGRACEPERIOD

hardDeleteDefaultDuration

Sets the default duration for hard deletion of data.

Default: 90d

Accessible with the following methods

Method Description
GET_HARDDELETEDEFAULTDUR() Getter for HARDDELETEDEFAULTDURATION

ingestQueryInstances

Specifies number of instances in the DbCluster which can both ingest and query.

Accessible with the following methods

Method Description
GET_INGESTQUERYINSTANCES() Getter for INGESTQUERYINSTANCES, with configurable default
ASK_INGESTQUERYINSTANCES() Getter for INGESTQUERYINSTANCES w/ exceptions if field has n
HAS_INGESTQUERYINSTANCES() Determine if INGESTQUERYINSTANCES has a value

queryOnlyInstances

Specifies number of instances in the DbCluster which can only query.

Accessible with the following methods

Method Description
GET_QUERYONLYINSTANCES() Getter for QUERYONLYINSTANCES, with configurable default
ASK_QUERYONLYINSTANCES() Getter for QUERYONLYINSTANCES w/ exceptions if field has no
HAS_QUERYONLYINSTANCES() Determine if QUERYONLYINSTANCES has a value

dedicatedCompactor

Specifies if the compactor instance should be a standalone instance or not.

Accessible with the following methods

Method Description
GET_DEDICATEDCOMPACTOR() Getter for DEDICATEDCOMPACTOR, with configurable default
ASK_DEDICATEDCOMPACTOR() Getter for DEDICATEDCOMPACTOR w/ exceptions if field has no
HAS_DEDICATEDCOMPACTOR() Determine if DEDICATEDCOMPACTOR has a value

compactionRowLimit

Specifies the soft limit for the number of rows per file that the compactor writes. The compactor may write more rows than this limit.

Default: 1000000

Accessible with the following methods

Method Description
GET_COMPACTIONROWLIMIT() Getter for COMPACTIONROWLIMIT, with configurable default
ASK_COMPACTIONROWLIMIT() Getter for COMPACTIONROWLIMIT w/ exceptions if field has no
HAS_COMPACTIONROWLIMIT() Determine if COMPACTIONROWLIMIT has a value

compactionMaxNumFilesPerPlan

Sets the maximum number of files included in any compaction plan.

Default: 500

Accessible with the following methods

Method Description
GET_COMPACTMAXNUMFILESPERP00() Getter for COMPACTIONMAXNUMFILESPERPLAN, with configurable d
ASK_COMPACTMAXNUMFILESPERP00() Getter for COMPACTIONMAXNUMFILESPERPLAN w/ exceptions if fie
HAS_COMPACTMAXNUMFILESPERP00() Determine if COMPACTIONMAXNUMFILESPERPLAN has a value

compactionGen2Duration

Specifies the duration of the first level of compaction (gen2). Later levels of compaction are multiples of this duration. This value should be equal to or greater than the gen1 duration.

Default: 20m

Accessible with the following methods

Method Description
GET_COMPACTIONGEN2DURATION() Getter for COMPACTIONGEN2DURATION

compactionMultipliers

Specifies a comma-separated list of multiples defining the duration of each level of compaction. The number of elements in the list determines the number of compaction levels. The first element specifies the duration of the first level (gen3); subsequent levels are multiples of the previous level.

Default: 3,4,6,5

Accessible with the following methods

Method Description
GET_COMPACTIONMULTIPLIERS() Getter for COMPACTIONMULTIPLIERS, with configurable default
ASK_COMPACTIONMULTIPLIERS() Getter for COMPACTIONMULTIPLIERS w/ exceptions if field has
HAS_COMPACTIONMULTIPLIERS() Determine if COMPACTIONMULTIPLIERS has a value

compactionCleanupWait

Specifies the amount of time that the compactor waits after finishing a compaction run to delete files marked as needing deletion during that compaction run.

Default: 10m

Accessible with the following methods

Method Description
GET_COMPACTIONCLEANUPWAIT() Getter for COMPACTIONCLEANUPWAIT

compactionCheckInterval

Specifies how often the compactor checks for new compaction work to perform.

Default: 10s

Accessible with the following methods

Method Description
GET_COMPACTIONCHECKINTERVAL() Getter for COMPACTIONCHECKINTERVAL

lastValueCacheDisableFromHistory

Disables populating the last-N-value cache from historical data. If disabled, the cache is still populated with data from the write-ahead log (WAL).

Accessible with the following methods

Method Description
GET_LASTVALCACHEDISFRMHIST00() Getter for LASTVALUECACHEDISFROMHISTORY, with configurable d
ASK_LASTVALCACHEDISFRMHIST00() Getter for LASTVALUECACHEDISFROMHISTORY w/ exceptions if fie
HAS_LASTVALCACHEDISFRMHIST00() Determine if LASTVALUECACHEDISFROMHISTORY has a value

distinctValueCacheDisableFromHistory

Disables populating the distinct value cache from historical data. If disabled, the cache is still populated with data from the write-ahead log (WAL).

Accessible with the following methods

Method Description
GET_DISTINCTVALCACHEDISFRM00() Getter for DISTINCTVALCACHEDISFRMHIST00, with configurable d
ASK_DISTINCTVALCACHEDISFRM00() Getter for DISTINCTVALCACHEDISFRMHIST00 w/ exceptions if fie
HAS_DISTINCTVALCACHEDISFRM00() Determine if DISTINCTVALCACHEDISFRMHIST00 has a value

replicationInterval

Specifies the interval at which data replication occurs between cluster nodes.

Default: 250ms

Accessible with the following methods

Method Description
GET_REPLICATIONINTERVAL() Getter for REPLICATIONINTERVAL

catalogSyncInterval

Defines how often the catalog synchronizes across cluster nodes.

Default: 10s

Accessible with the following methods

Method Description
GET_CATALOGSYNCINTERVAL() Getter for CATALOGSYNCINTERVAL