Last modified: September 01 2021.
Contact: hpchelp [at] iitd.ac.in

PYTORCH


Note : conda installation of pytorch(gpu) version above 1.1.0 will work on V100 cards i.e vsky nodes (cuda compute capability 70) but will not work on K40 cards i.e on khas nodes (cuda compute capability 35)

To work on K40 cards version above 1.1.0 requires installation from source, refer

While installing from source set the environment variable TORCH_CUDA_ARCH_LIST in the following way

export TORCH_CUDA_ARCH_LIST="3.5;7.0"


Available pytorch versions on HPC which will work on both K40 & V100 cards are :


Pytorch 1.1.0, Torchvision 0.3.0 with cuda 10.0 : module load apps/anaconda/3

Pytorch 1.5.0, Torchvision 0.6.0 with cuda 10.0 : module load apps/pytorch/1.5.0/gpu/anaconda3

Pytorch 1.6.0, Torchvision 0.7.0 with cuda 10.0 : module load apps/pytorch/1.6.0/gpu/anaconda3

Pytorch 1.9.0, Torchvision 0.10.0 with cuda 10.2 : module load apps/pytorch/1.9.0/gpu/intelpython3.7

Pytorch 1.10.0, Torchvision 0.11.1, Torchaudio 0.10.0 with cuda 11.0 : module load apps/pytorch/1.10.0/gpu/intelpython3.7