LSOPS13-BP01 Store data in an AI/ML-ready formats
Expectations of what can be done with data are rapidly expanding. Life sciences projects produce rich data. Work to maximize data storage to allow for new technologies such as AI/ML.
Desired outcome: Be able to pivot and adapt as there are new technological demands on existing systems and data.
Level of risk exposed if this best practice is not established: Low
Implementation guidance
Use data processing that stores data in adaptable, open standard formats. This will allow for the greatest flexibility as technologies progress.
Implementation steps
-
Store data in document formats ingestible by Amazon Sagemaker and Amazon Bedrock.
-
Use AWS Glue to transform data into Iceberg and place in an Amazon S3 data lake.
Resources
Related documents:
Related examples:
Related tools:
