AWS Deep Learning ARM64 AMI OSS GPU PyTorch 2.7 (Ubuntu 22.04) - AWS Deep Learning AMIs
AMI name formatSupported EC2 instancesAMI contentsNoticesRelease Date: 2025-05-22

AWS Deep Learning ARM64 AMI OSS GPU PyTorch 2.7 (Ubuntu 22.04)

For help getting started, see Getting started with DLAMI.

AMI name format

  • Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.7 (Ubuntu 22.04) ${YYYY-MM-DD}

Supported EC2 instances

  • G5g

The AMI includes the following:

  • Supported AWS Service: Amazon EC2

  • Operating System: Ubuntu 22.04

  • Compute Architecture: ARM64

  • Linux Kernel: 6.8

  • NVIDIA Driver: 570.133.20

  • NVIDIA CUDA 12.8 stack:

    • CUDA, NCCL and cuDDN installation directories: /usr/local/cuda-12.8/

    • Default CUDA: 12.8

      • PATH /usr/local/cuda points to CUDA 12.8

      • Updated below env vars:

        • LD_LIBRARY_PATH to have /usr/local/cuda/lib:/usr/local/cuda/lib64:/usr/local/cuda:/usr/local/cuda/targets/sbsa-

        • PATH to have /usr/local/cuda/bin/:/usr/local/cuda/include/

  • AWS CLI v2 at /usr/local/bin/aws

  • EBS volume type: gp3

  • Nvidia container toolkit: 1.17.7

    • Version command: nvidia-container-cli -V

  • Docker: 28.2.2

  • Python: /opt/pytorch/bin/python

  • Query AMI-ID with SSM Parameter (example region is us-east-1):

    aws ssm get-parameter --region us-east-1 \
    --name /aws/service/deeplearning/ami/arm64/oss-nvidia-driver-gpu-pytorch-2.7-ubuntu-22.04/latest/ami-id \
    --query "Parameter.Value" \
    --output text

  • Query AMI-ID with AWSCLI (example region is us-east-1):

    aws ec2 describe-images --region us-east-1 --owners amazon --filters 'Name=name,Values=Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.7 (Ubuntu 22.04) ????????' 'Name=state,Values=available' --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' --output text

Notices

PyTorch Deprecation of Anaconda Channel

Starting with PyTorch 2.6, PyTorch has deprecated support for Conda (see official announcement). As a result, PyTorch 2.6 and above will move to using Python Virtual Environments. To activate the PyTorch venv, please use source /opt/pytorch/bin/activate

Release Date: 2025-05-22

AMI name: Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.7 (Ubuntu 22.04) 20250521

Added

  • Initial release of Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.7 (Ubuntu 22.04) series. Including a Python virtual environment pytorch (source /opt/pytorch/bin/activate) complimented with NVIDIA Driver R570, CUDA=12.8, cuDNN=9.10, and PyTorch NCCL=2.26.2