Modern Data Platform Using AWS and Teradata
Publication date: November 18, 2022 (Diagram history)
Teradata VantageCloud Enterprise is part of the Teradata VantageCloud offering, the complete cloud analytics and data platform that includes Teradata ClearScape Analytics and integration with SageMaker AI.
Modern Data Platform Using AWS and Teradata
The following steps describe the architecture:
-
Collect data from multiple sources across the enterprise and SaaS applications. Ingest data using AWS Data Exchange, AWS Database Migration Service (AWS DMS), AWS IoT Core, and Amazon Kinesis. AWS Data Exchange, AWS DMS, and Amazon AppFlow use Amazon S3 as a transitional or permanent datastore accessed through Teradata Native Object Store (NOS).
-
The AWS data lake manages data lifecycle and governance. Amazon S3 provides highly available storage for permanent and transitional data in the data lake.
-
Process the data using AWS Glue and Amazon EMR, and store it to Amazon S3 or directly into Teradata using AWS Glue streaming.
-
Teradata Vantage on AWS serves as a highly scalable data warehouse and analytics platform. With Teradata QueryGrid, the analytics platform can query other datastores such as SQL databases and Amazon EMR. Teradata NOS allows Teradata Vantage to access and configure data on Amazon S3 as an external table.
-
SageMaker AI retrieves training data from both Teradata and Amazon S3 using the Teradata SQL kernel or Python library. Deploy trained models to a SageMaker AI endpoint or import them as a bring your own model (BYOM) into Teradata for in-database analytics.
-
External functions within Teradata SQL interface get inference from AWS inference endpoints and third-party AI platform providers.
Further reading
For additional information, refer to the following resources:
Diagram history
To be notified about updates to this reference architecture diagram, subscribe to the RSS feed.
| Change | Description | Date |
|---|---|---|
Initial publication | Reference architecture diagram first published. | November 18, 2022 |
Note
To subscribe to RSS updates, you must have an RSS plugin enabled for the browser you are using.
