Package software.amazon.awscdk.services.s3tables.alpha

@Stability(Experimental) package software.amazon.awscdk.services.s3tables.alpha

Amazon S3 Tables Construct Library

---

cdk-constructs: Experimental

The APIs of higher level constructs in this module are experimental and under active development. They are subject to non-backward compatible changes or removal in any future version. These are not subject to the Semantic Versioning model and breaking changes will be announced in the release notes. This means that while you may use them, you may need to update your source code when upgrading to a newer version of this package.

Amazon S3 Tables

Amazon S3 Tables deliver the first cloud object store with built-in Apache Iceberg support and streamline storing tabular data at scale.

Product Page | User Guide

Usage

Define an S3 Table Bucket

 // Build a Table bucket
 TableBucket sampleTableBucket = TableBucket.Builder.create(scope, "ExampleTableBucket")
         .tableBucketName("example-bucket-1")
         // optional fields:
         .unreferencedFileRemoval(UnreferencedFileRemoval.builder()
                 .status(UnreferencedFileRemovalStatus.ENABLED)
                 .noncurrentDays(20)
                 .unreferencedDays(20)
                 .build())
         .build();

Define an S3 Tables Namespace

 // Build a namespace
 Namespace sampleNamespace = Namespace.Builder.create(scope, "ExampleNamespace")
         .namespaceName("example-namespace-1")
         .tableBucket(tableBucket)
         .build();

Define an S3 Table

 // Build a table
 Table sampleTable = Table.Builder.create(scope, "ExampleTable")
         .tableName("example_table")
         .namespace(namespace)
         .openTableFormat(OpenTableFormat.ICEBERG)
         .withoutMetadata(true)
         .build();
 
 // Build a table with an Iceberg Schema
 Table sampleTableWithSchema = Table.Builder.create(scope, "ExampleSchemaTable")
         .tableName("example_table_with_schema")
         .namespace(namespace)
         .openTableFormat(OpenTableFormat.ICEBERG)
         .icebergMetadata(IcebergMetadataProperty.builder()
                 .icebergSchema(IcebergSchemaProperty.builder()
                         .schemaFieldList(List.of(SchemaFieldProperty.builder()
                                 .name("id")
                                 .type("int")
                                 .required(true)
                                 .build(), SchemaFieldProperty.builder()
                                 .name("name")
                                 .type("string")
                                 .build()))
                         .build())
                 .build())
         .compaction(CompactionProperty.builder()
                 .status(Status.ENABLED)
                 .targetFileSizeMb(128)
                 .build())
         .snapshotManagement(SnapshotManagementProperty.builder()
                 .status(Status.ENABLED)
                 .maxSnapshotAgeHours(48)
                 .minSnapshotsToKeep(5)
                 .build())
         .build();

Learn more about table buckets maintenance operations and default behavior from the S3 Tables User Guide

Controlling Table Bucket Permissions

 // Grant the principal read permissions to the bucket and all tables within
 String accountId = "123456789012";
 tableBucket.grantRead(new AccountPrincipal(accountId), "*");
 
 // Grant the role write permissions to the bucket and all tables within
 Role role = Role.Builder.create(stack, "MyRole").assumedBy(new ServicePrincipal("sample")).build();
 tableBucket.grantWrite(role, "*");
 
 // Grant the user read and write permissions to the bucket and all tables within
 tableBucket.grantReadWrite(new User(stack, "MyUser"), "*");
 
 // Grant permissions to the bucket and a particular table within it
 String tableId = "6ba046b2-26de-44cf-9144-0c7862593a7b";
 tableBucket.grantReadWrite(new AccountPrincipal(accountId), tableId);
 
 // Add custom resource policy statements
 PolicyStatement permissions = PolicyStatement.Builder.create()
         .effect(Effect.ALLOW)
         .actions(List.of("s3tables:*"))
         .principals(List.of(new ServicePrincipal("example.aws.internal")))
         .resources(List.of("*"))
         .build();
 
 tableBucket.addToResourcePolicy(permissions);

Controlling Table Bucket Encryption Settings

S3 TableBuckets have SSE (server-side encryption with AES-256) enabled by default with S3 managed keys. You can also bring your own KMS key for KMS-SSE or have S3 create a KMS key for you.

If a bucket is encrypted with KMS, grant functions on the bucket will also grant access to the TableBucket's associated KMS key. 

 // Provide a user defined KMS Key:
 Key key = Key.Builder.create(scope, "UserKey").build();
 TableBucket encryptedBucket = TableBucket.Builder.create(scope, "EncryptedTableBucket")
         .tableBucketName("table-bucket-1")
         .encryption(TableBucketEncryption.KMS)
         .encryptionKey(key)
         .build();
 // This account principal will also receive kms:Decrypt access to the KMS key
 encryptedBucket.grantRead(new AccountPrincipal("123456789012"), "*");
 
 // Use S3 managed server side encryption (default)
 TableBucket encryptedBucketDefault = TableBucket.Builder.create(scope, "EncryptedTableBucketDefault")
         .tableBucketName("table-bucket-3")
         .encryption(TableBucketEncryption.S3_MANAGED)
         .build();

When using KMS encryption (TableBucketEncryption.KMS), if no encryption key is provided, CDK will automatically create a new KMS key for the table bucket with necessary permissions. 

 // If no key is provided, one will be created automatically
 TableBucket encryptedBucketAuto = TableBucket.Builder.create(scope, "EncryptedTableBucketAuto")
         .tableBucketName("table-bucket-2")
         .encryption(TableBucketEncryption.KMS)
         .build();

Controlling Table Permissions

 // Grant the principal read permissions to the table
 String accountId = "123456789012";
 table.grantRead(new AccountPrincipal(accountId));
 
 // Grant the role write permissions to the table
 Role role = Role.Builder.create(stack, "MyRole").assumedBy(new ServicePrincipal("sample")).build();
 table.grantWrite(role);
 
 // Grant the user read and write permissions to the table
 table.grantReadWrite(new User(stack, "MyUser"));
 
 // Grant an account permissions to the table
 table.grantReadWrite(new AccountPrincipal(accountId));
 
 // Add custom resource policy statements
 PolicyStatement permissions = PolicyStatement.Builder.create()
         .effect(Effect.ALLOW)
         .actions(List.of("s3tables:*"))
         .principals(List.of(new ServicePrincipal("example.aws.internal")))
         .resources(List.of("*"))
         .build();
 
 table.addToResourcePolicy(permissions);

Coming Soon

L2 Construct support for:

  • KMS encryption support for Tables