Working with Amazon S3 Tables in the lakehouse architecture of Amazon SageMaker

Enable S3 integration

1. Navigate to the Amazon S3 console. In the left navigation pane, choose Table buckets.

2. Choose Create table bucket.

3. On the Create table bucket page, enter a Table bucket name and select Enable integration.

4. Choose Create table bucket.

5. Amazon S3 displays confirmation when integration of your table buckets with the lakehouse architecture completes.

Grant Lake Formation permissions

1. Navigate to the Lake Formation console.

2. In the left navigation pane, choose Catalogs and choose S3tablescatalog.

3. From S3tablescatalog, under Objects, choose your newly created table bucket.

4. From the Actions menu, select Grant.

5. In Grant permissions, under IAM users and roles, select your Amazon SageMaker Unified Studio Project role.

6. To grant full access, under Catalog Permissions > Grant, select Super user.

1. Register the S3 Tables catalog as a Lake Formation data location.

   aws lakeformation register-resource \
     --resource-arn 'arn:aws:s3tables:us-east-1:123456789012:bucket/*' \
     --role-arn 'arn:aws:iam::123456789012:role/LakeFormationDataAccessRole' \
     --with-federation
     --with-privileged-access                        

2. Create a catalog.

   aws glue create-catalog --cli-input-json file://input.json
   
   '{
      "Name": "s3tablescatalog",
      "CatalogInput" : {
         "FederatedCatalog": {
            "Identifier": "arn:aws:s3tables:us-east-1:123456789012:bucket/*",
            "ConnectionName": "aws:s3tables"
         },
         "CreateDatabaseDefaultPermissions": [],
         "CreateTableDefaultPermissions": []
      }
   }'            
                          

Create S3 Tables catalog

1. Open the Amazon SageMaker console at https://console.aws.amazon.com/sagemaker/ and use the Region selector in the top navigation bar to choose the appropriate AWS Region.

2. Select your Amazon SageMaker domain.

3. Select the project you want to create a table bucket in.

4. In the navigation menu select Data, then select + to add a new data source.

5. Select Create Lakehouse catalog.

6. In the add catalog menu, choose Amazon S3 Tables as the source.

7. Enter a name for the catalog, and a database name.

8. Choose Create catalog.

   This creates the following resources in your account:

   • A new S3 Table bucket and the corresponding AWS Glue child catalog under the parent catalog s3tablescatalog.

   • A new database within that AWS Glue Data Catalog child catalog. The database name matches the database name you provided. In S3 tables, this is the table namespace.

9. Begin creating tables in your database and querying them using query editor or Jupyter notebook.

Create S3 Table and add data in the lakehouse architecture

1. Navigate to Amazon SageMaker Unified Studio, and select the project.

2. From the Build menu, select Query Editor, and ensure you have Amazon Athena selected in Connections.

3. Create a database using SQL.

   CREATE DATABASE "s3tablescatalog/amzn-s3-demo-bucket".YourDBName;

4. Create an Amazon S3 table using SQL.

   CREATE TABLE "s3tablescatalog/amzn-s3-demo-bucket".YourDBName.YourTableName; 
   ( c_salutation string, 
     c_login string, 
     c_first_name string, 
     c_last_name string, 
     c_email_address string)
     TBLPROPERTIES ( 
     'table_type'='ICEBERG'  );

5. Add data using SQL.

   INSERT INTO "s3tablescatalog/amzn-s3-demo-bucket".YourDBName.YourTableName
   VALUES('Dr.','1381546','Joyce','Deaton','Joyce.Deaton@example.edu');