View a markdown version of this page

Industrial DataOps on AWS using Cognite Data Fusion - Industrial DataOps on AWS using Cognite Data Fusion

Industrial DataOps on AWS using Cognite Data Fusion

Publication date: November 2024 (Diagram history)

With this architecture, you can use AWS Cloud and Cognite Data Fusion (CDF) to build an industrial DataOps platform. CDF contextualizes diverse industrial data sources and builds knowledge graphs for your operations. You can collect operational technology (OT), information technology (IT), and engineering technology (ET) data. This architecture uses AWS IoT Greengrass, AWS IoT SiteWise, Amazon S3, AWS Lambda, and Amazon SageMaker AI.

Industrial DataOps architecture diagram

Reference architecture for industrial DataOps on AWS using Cognite Data Fusion.

The following steps describe the architecture:

  1. Purpose-built extractors ingest industrial data sources such as IT, OT, and engineering data. You can also use AWS IoT Greengrass (an open source IoT edge runtime) to bring data from edge gateways or programmable logic controllers (PLCs) to AWS Cloud.

  2. Data from industrial historians and other devices flows through AWS IoT Greengrass into AWS IoT SiteWise. Cognite Native Extractors ingest pre-aggregated industrial data from a customer data lake in Amazon S3, Amazon Redshift, and Amazon DynamoDB.

  3. Use Lambda and Amazon API Gateway together to ingest data from CDF. Transform data by using AWS Glue and write data back into CDF through the Cognite SDK. Amazon Managed Service for Apache Flink and Amazon SageMaker AI provide additional analytics and machine learning (ML) capabilities.

  4. End users create custom applications depending on data type by using AWS IoT TwinMaker and Amazon Managed Grafana.

Further reading

For additional information, see the following resources:

Diagram history

To be notified about updates to this reference architecture diagram, subscribe to the RSS feed.

ChangeDescriptionDate

Initial publication

Reference architecture diagram first published.

November 1, 2024

RSS subscription

To subscribe to RSS updates, you must have an RSS plugin enabled for the browser that you are using.