Class WorkerTypeV2

The type of predefined worker that is allocated when a job runs.

Inheritance

WorkerTypeV2

Namespace: Amazon.CDK.AWS.StepFunctions.Tasks

Assembly: Amazon.CDK.Lib.dll

Syntax (csharp)

public class WorkerTypeV2 : DeputyBase

Syntax (vb)

Public Class WorkerTypeV2 Inherits DeputyBase

Remarks

If you need to use a WorkerTypeV2 that doesn't exist as a static member, you can instantiate a WorkerTypeV2 object, e.g: WorkerTypeV2.of('other type').

ExampleMetadata: infused

Examples

new GlueStartJobRun(this, "Task", new GlueStartJobRunProps {
                 GlueJobName = "my-glue-job",
                 WorkerConfiguration = new WorkerConfigurationProperty {
                     WorkerTypeV2 = WorkerTypeV2.G_1X,  // Worker type
                     NumberOfWorkers = 2
                 }
             });

Synopsis

Properties

G_025X	Each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. Suitable for low volume streaming jobs.
G_1X	Each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker.
G_2X	Each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker.
G_4X	Each worker maps to 4 DPU (16 vCPU, 64 GB of memory, 256 GB disk), and provides 1 executor per worker.
G_8X	Each worker maps to 8 DPU (32 vCPU, 128 GB of memory, 512 GB disk), and provides 1 executor per worker.
Name	The name of this WorkerType, as expected by Job resource.
STANDARD	Each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
Z_2X	Each worker maps to 2 high-memory DPU [M-DPU] (8 vCPU, 64 GB of memory, 128 GB disk).

Methods

Of(string)

Custom worker type.

Properties

G_025X

Each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. Suitable for low volume streaming jobs.

public static WorkerTypeV2 G_025X { get; }

Property Value

WorkerTypeV2

Remarks

If you need to use a WorkerTypeV2 that doesn't exist as a static member, you can instantiate a WorkerTypeV2 object, e.g: WorkerTypeV2.of('other type').

ExampleMetadata: infused

G_1X

Each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker.

public static WorkerTypeV2 G_1X { get; }

Property Value

WorkerTypeV2

Remarks

Suitable for memory-intensive jobs.

G_2X

Each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker.

public static WorkerTypeV2 G_2X { get; }

Property Value

WorkerTypeV2

Remarks

Suitable for memory-intensive jobs.

G_4X

Each worker maps to 4 DPU (16 vCPU, 64 GB of memory, 256 GB disk), and provides 1 executor per worker.

public static WorkerTypeV2 G_4X { get; }

Property Value

WorkerTypeV2

Remarks

We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later jobs.

G_8X

Each worker maps to 8 DPU (32 vCPU, 128 GB of memory, 512 GB disk), and provides 1 executor per worker.

public static WorkerTypeV2 G_8X { get; }

Property Value

WorkerTypeV2

Remarks

Name

The name of this WorkerType, as expected by Job resource.

public virtual string Name { get; }

Property Value

string

Remarks

If you need to use a WorkerTypeV2 that doesn't exist as a static member, you can instantiate a WorkerTypeV2 object, e.g: WorkerTypeV2.of('other type').

ExampleMetadata: infused

STANDARD

Each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.

public static WorkerTypeV2 STANDARD { get; }

Property Value

WorkerTypeV2

Remarks

If you need to use a WorkerTypeV2 that doesn't exist as a static member, you can instantiate a WorkerTypeV2 object, e.g: WorkerTypeV2.of('other type').

ExampleMetadata: infused

Z_2X

Each worker maps to 2 high-memory DPU [M-DPU] (8 vCPU, 64 GB of memory, 128 GB disk).

public static WorkerTypeV2 Z_2X { get; }

Property Value

WorkerTypeV2

Remarks

Supported in Ray jobs.

Methods

Of(string)

Custom worker type.

public static WorkerTypeV2 Of(string workerType)

Parameters

workerType string: custom worker type.

Returns

WorkerTypeV2

Remarks

If you need to use a WorkerTypeV2 that doesn't exist as a static member, you can instantiate a WorkerTypeV2 object, e.g: WorkerTypeV2.of('other type').

ExampleMetadata: infused