Accessing the cluster
The cluster consists of linux machines. The access to the cluster is through a few designated nodes, which allow users to log in. You may reach the cluster from any computer on the IITD network with the help of an up to date ssh client.
- You may access login nodes through ssh to hpc.iitd.ac.in. GPU and MIC based login nodes are also available. You can ssh into gpu.hpc.iitd.ac.in and mic.hpc.iitd.ac.in, respectively, to reach them.
- The login nodes are primarily gateways to the rest of the cluster, which is accessed through a job queueing system (called PBS). You submit jobs to the queue and they run when the required resources are available. You may choose to receive email when your jobs complete.
- Please do not run programs directly on login nodes. They should be used mainly to submit jobs, transfer data, inspect your files and data, and to compile source code. (If your compilation takes more than a few minutes, you should submit the compilation job into the queue to be run on the cluster.)
- By default, you have two directories available to you. One in /scratch and one in /home. (These directories are available on login nodes as well as the other cluster nodes.) /scratch is for temporary data designed for use by running jobs. and may be deleted after your job completes. /home is permanent space (and slower than /scratch). quota is enabled.
Using SSH in WindowsWindows systems do not have any built-in support for using SSH, so you will have to download a software package to use SSH. PuTTY is the most popular open source (ie free) SSH client for Windows. To install it, visit the download site, and download the Installer package. Once installed, find the PuTTy application shortcut in your Start Menu, desktop. On clicking the PuTTy icon The PuTTy Configuration dialog should appear: Locate the Host Name input box in the PuTTy Configuration screen. Enter the server name you wish to connect to (e.g. [username]@hpc.iitd.ac.in), and click Open. Enter your password when prompted, and press Enter. You are now connected!
Using SSH in Mac or LinuxBoth Mac and Linux systems provide a built-in SSH client, so there is no need to install an additional package. Simply locate and run the Terminal app. Once in the terminal, you can connect to an SSH server by typing the following command:
ssh [username]@[hostname]For example, to connect to the HPC Login Node, with the username user1: ssh firstname.lastname@example.org You will be prompted for a password, and then will be connected to the server:
ssh email@example.com Last login: Wed Nov 6 08:41:31 2013 from 220.127.116.11 [user1@submit ~]$Please generate an ssh key pair in your .ssh directory.
Copying Directory/File from local machine to HPC cluster:To copy a local directory from your linux system (say InputFiles-2.0) to your home directory in your IITD cluster account, the procedure is:
- from the terminal goto the parent directory using cd command.
user1@mylaptop3230:~$ cd ~/MyData/
- under parent directory type ls <& press return key>, & notice InputFiles-2.0 is there.
user1@mylaptop3230:~$ls MyFiles TempFiles-1.0 InputFiles-2.0
- begin copy by typing:
user1@mylaptop3230:~$ scp -r InputFiles-2.0 (your username)@hpc.iitd.ac.in:~ < you will be asked for password ; enter the same & press return key >you should see :
scp -r InputFiles-2.0 firstname.lastname@example.org:~ cover0.txt 100% 18KB 18.5KB/s 00:00 CPU.f 100% 41 0.0KB/s 00:00 param0.txt 100% 33KB 33.0KB/s 00:00 Final.exe 100% 281KB 280.5KB/s 00:00 etc...required files have been copied !
- now login to your iitd hpc account as:
user1@mylaptop3230:~$ ssh (your username)@hpc.iitd.ac.in < you will be asked for password ; enter the same & press return key > Last login: Thu Nov 26 16:13:31 2015 from 10.193.42.5 [user1@login03 ~]$
- execute ls command, you should see InputFiles-2.0 directory.
$ cd InputFiles-2.0
- you can compile your fortran code using :
$ gfortran CPU.f
Enabling X11 Tunneling (graphical programs over SSH)SSH, by default, allows you to run remote commands on a server in text mode. You can also use SSH to run graphical programs remotely, such as Matlab. On Linux and Mac clients, simply include the -X parameter when connecting via SSH:
ssh -X email@example.comThis option will enable remote graphical programs, such as Scilab, Matlab or Paraview to run over SSH. For example, on the HPC system, after connecting with the -X parameter, you should be able to execute the xeyes command and see the xeyes graphical user interface. Windows does not include built-in support for SSH . Free software package called Xming can be used, also, a commercial alternative to Xming is MobaXTerm. Notice the < username >@login03 section of the last line. That indicates that you are now connected to the 'submit' server. To disconnect from the remote server, simply type exit or close the terminal window.