Difference between revisions of "Getting Started"

From NEClusterWiki
Jump to navigation Jump to search
 
(40 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 +
== General Rules ==
 +
 +
Many people are using this resource for their research, be considerate. Maintain your long term disk usage in your home directory is below 10 GB. Before you run a large calculation, contact the cluster admin to optimize the job. The use of this system is regulated by [https://universitytennessee.policytech.com/dotNet/documents/?docid=157&public=true Acceptable Use of Information Technology Resources Policy]. Sharing your credentials with others, if you have access to export controlled codes, is punishable by up to 10 years in federal prison.
 +
 +
== Request Account ==
 +
 +
NE Cluster maintains its own accounts, independently of the UTK account registry.
 +
If you wish to request an account, please use this form: <b>https://necluster.ne.utk.edu/cgi-bin/account.py</b>
 +
 +
<!-- If you want to use the cluster, please email Ondrej Chvala <ochvala@utk.edu> the following information: a) what projects do you want the cluster for, b) which professor do you work with or which class this is for, c) your status withing UTK NE, d) forward your **RSICC request history email** (available from the [https://rsicc.ornl.gov/CustomerService.aspx RSICC website] [https://rsicc.ornl.gov/OrderHistory.aspx HERE]) to ochvala@utk.edu to get access to export-controlled codes available from RSICC. Do NOT send me your code license email or any other communication between you and RSICC. I need the actual request history email, not a screenshot. -->
 +
 
== Getting Started on NECluster - Windows ==
 
== Getting Started on NECluster - Windows ==
  
Line 5: Line 16:
 
To connect to the cluster you will need an SSH client.  The easiest one to use, in my opinion is [http://www.chiark.greenend.org.uk/~sgtatham/putty/ PuTTY].  You can either download a standalone executable, or use the installer to install everything.
 
To connect to the cluster you will need an SSH client.  The easiest one to use, in my opinion is [http://www.chiark.greenend.org.uk/~sgtatham/putty/ PuTTY].  You can either download a standalone executable, or use the installer to install everything.
  
−
Once you've installed PuTTY you can just run it.  A dialog window will pop up asking for some information.  In the ''Host Name'' box you enter <code>necluster.engr.utk.edu</code>.  Make sure the port is <code>22</code> and that <code>SSH</code> is checked. If you have a X Window Server (discussed next) and wish to use it, you also have to go to the X11 Category and put a check mark in the box next to <code>Enable X11 forwarding</code>.  Note that on the first screen you can save your settings so that you don't have to type this in every time.  Once done, click <code>Open</code> and enter your user name and password when prompted.
+
Once you've installed PuTTY you can just run it.  A dialog window will pop up asking for some information.  In the ''Host Name'' box you enter <code>necluster.ne.utk.edu</code>.  Make sure the port is <code>22</code> and that <code>SSH</code> is checked. If you have a X Window Server (discussed next) and wish to use it, you also have to go to the X11 Category and put a check mark in the box next to <code>Enable X11 forwarding</code>.  Note that on the first screen you can save your settings so that you don't have to type this in every time.  Once done, click <code>Open</code> and enter your user name and password when prompted.
  
 
<center><gallery caption="PuTTY">
 
<center><gallery caption="PuTTY">
−
File:PuTTY01.png | Basic Options
+
File:Putty1.png | Basic Options
−
File:PuTTY02.png | X11 Forwarding
+
File:Putty2.png | X11 Forwarding
−
File:PuTTY03.png | Entering User/Pass
+
File:Putty3.png | Entering User/Pass
 
</gallery></center>
 
</gallery></center>
  
−
=== X Server ===
+
=== X Server - remote GUI ===
 +
 
 +
If you want to use some of the GUI programs on the cluster, you will need to install an X Server on your machine.  A nice '''freeware X Server for Windows''' is [http://www.straightrunning.com/XmingNotes/ Xming].  When downloading Xming, first install the package <code>Xming</code> and then install the package <code>Xming-fonts</code>. Get the public domain release. If you desire you can install <code>Xming-mesa</code> ''instead of'' <code>Xming</code> for additional graphics capabilities that probably will not be used over a network connection anyways.
 +
 
 +
Once Xming is installed, you can run it from the start menu.  It may seem like nothing is running after you click it, but if you check the application area of your task bar, you should see the Xming icon. 
 +
[[File:Xming.png|thumb|Xming is running!]]
 +
 
 +
Note that you can start Xming before or after you start PuTTY.  As long as you forwarded your X connection it will work.
 +
 
  
−
If you want to use some of the GUI programs on the cluster, you will need to install an X Server on your machine.  A nice freeware X Server is [http://www.straightrunning.com/XmingNotes/ Xming].  When downloading Xming, first install the pacakge <code>Xming</code> and then install the package <code>Xming-fonts</code>.  If you desire you can install <code>Xming-mesa</code> ''instead of'' <code>Xming</code> for additional graphics capabilities that probably won't be used over a network connection anyways.
+
=== MobaXterm ===
  
−
Once Xming is installed, you can run it from the start menu.  It may seem like nothing is running after you click it, but if you check the application area of your task bar, you should see the Xming icon.  [[File:Xming01.png|thumb|Xming is running!]] Note that you can start Xming before or after you start PuTTY.  As long as you forwarded your X connection it will work.
+
[https://mobaxterm.mobatek.net/ MobaXterm] is an enhanced terminal for Windows with X server, tabbed SSH client, network tools, and more.
  
 
== Getting Started on NECluster - Mac/Linux ==
 
== Getting Started on NECluster - Mac/Linux ==
Line 23: Line 42:
 
If you're running Mac OS X or any version of Linux it's even easier to get on the cluster.  You generally already have a SSH Client and X Server installed!  To log on to the cluster open up a terminal window and type the command:
 
If you're running Mac OS X or any version of Linux it's even easier to get on the cluster.  You generally already have a SSH Client and X Server installed!  To log on to the cluster open up a terminal window and type the command:
  
−
<code>ssh -X -l ''user'' necluster.engr.utk.edu</code><br />  
+
<code>ssh -X -l ''user'' necluster.ne.utk.edu</code><br />  
 
OR <br />
 
OR <br />
−
<code>ssh -X ''user''@necluster.engr.utk.edu</code>
+
<code>ssh -X ''user''@necluster.ne.utk.edu</code>
  
 
The <code>-X</code> forwards the X connection.  You can omit it if you don't plan on using any programs that use it.  Like Windows, most terminal programs allow you to save sessions that you want to use regularly.
 
The <code>-X</code> forwards the X connection.  You can omit it if you don't plan on using any programs that use it.  Like Windows, most terminal programs allow you to save sessions that you want to use regularly.
Line 38: Line 57:
  
 
Host cluster
 
Host cluster
−
         HostName necluster.engr.utk.edu
+
         HostName necluster.ne.utk.edu
 
         User <your_username>
 
         User <your_username>
 
         IdentityFile ~/.ssh/id_rsa.UTKNEcluster
 
         IdentityFile ~/.ssh/id_rsa.UTKNEcluster
 
</pre>
 
</pre>
 +
 +
 +
For newer releases of '''MacOS''', you need to download X11 server separately, here: https://www.xquartz.org/ Make sure you switch on [https://dyhr.com/2009/09/05/how-to-enable-x11-forwarding-with-ssh-on-mac-os-x-leopard/ X11 forwarding] when you connect using the ssh client.
  
 
== First Time on the Cluster ==
 
== First Time on the Cluster ==
Line 47: Line 69:
 
=== Changing Password ===
 
=== Changing Password ===
  
−
The first time you're on the cluster the very first thing you will want to do is to change your password away from the temporary one that you were assigned.  This is done by using the <code>passwd</code> command on the file server:
+
The first time you're on the cluster the very first thing you will want to do is to change your password away from the temporary one that you were assigned.  This is done by using the <code>yppasswd</code> command:
  
−
First SSH onto the file server:<br />
+
'''user@necluster ~ $''' yppasswd
−
<code>'''user@necluster:~$''' ssh nefiles</code>
+
Changing NIS account information for user on nefiles.
 +
Please enter old password:
 +
Changing NIS password for user on nefiles.
 +
Please enter new password:
 +
Please retype new password:
  
−
'''Note:''' The first time you log on to any node, you will have to add that node to your ''known_hosts'' file.  This is done by saying answering in the affirmative at the following prompt:
+
  The NIS password has been changed on nefiles.
−
 
 
−
  The authenticity of host 'nefiles (192.168.100.50)' can't be established.
 
−
ECDSA key fingerprint is a0:7c:55:f8:da:24:80:0b:b9:62:bc:8c:25:cf:cd:34.
 
−
Are you sure you want to continue connecting (yes/no)? yes
 
−
Warning: Permanently added 'nefiles,192.168.100.50' (ECDSA) to the list of known hosts.
 
−
 
 
−
Now you can change your password:
 
−
 
 
−
'''user@nefiles:~$''' passwd
 
−
Changing password for '''user'''.
 
−
(current) UNIX password:
 
−
Enter new UNIX password:
 
−
Retype new UNIX password:
 
−
passwd: password updated successfully
 
−
 
 
−
Now, log off the file server by typing:
 
−
 
 
−
'''user@nefiles:~$''' exit
 
−
logout
 
−
Connection to nefiles closed.
 
  
 
Your password has been changed!
 
Your password has been changed!
  
−
=== Getting on Other Nodes ===
+
=== Pre-requisites for Computing on the Cluster ===
  
 
When you first log on your prompt will be:
 
When you first log on your prompt will be:
Line 82: Line 88:
 
<code>'''user@necluster:~$'''</code>
 
<code>'''user@necluster:~$'''</code>
  
−
This shows that you are on the head node. When you run cases you'll want to run them on one of the many compute nodes that you can find on [http://necluster.engr.utk.edu/ganliga/ Ganglia].  They are named ''node#'' where ''#'' is the node number.  The very first thing to do is create a public key file so you don't have to enter your password every time you want to connect to a compute node. To do this, follow the following steps:
+
This shows that you are on the head node. Jobs can only be submitted from the head node. When you [[TORQUE/Maui|submit jobs]] they execute on compute nodes, named ''node#'' where ''#'' is the node number. You can connect to compute nodes that run your jobs.  The very first thing to do is create a public key file so you don't have to enter your password every time you want to connect to a compute node. Also it allows the job scheduler to copy job related files between nodes. To do this, follow the following steps:
  
 
  '''user'''@necluster:~$ ssh-keygen -t rsa
 
  '''user'''@necluster:~$ ssh-keygen -t rsa
Line 95: Line 101:
 
  The key's randomart image is:
 
  The key's randomart image is:
 
  ''Funny boxed picture''
 
  ''Funny boxed picture''
−
  '''user'''@necluster:~$ cp ~/.ssh/id_rsa.pub ~/.ssh/authorized_keys
+
  '''user'''@necluster:~$ cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
 
  '''user'''@necluster:~$ ''<done>''
 
  '''user'''@necluster:~$ ''<done>''
  
−
To connect to one of these nodes you can just SSH to it:
+
To connect to one of these nodes you can just SSH to it.  Remember this only works if you have a job running that that node.
  
 
  '''user@necluster:~$''' ssh node15
 
  '''user@necluster:~$''' ssh node15
Line 104: Line 110:
 
  '''user@node15:~$'''
 
  '''user@node15:~$'''
  
−
If it is your first time on the node, you will have to verify the authenticity like you did when you connected to the file server to change your password.  If you have a few minutes you can run a script to connect to every node in a list so you can just type yes about 30 times and then not have to worry about it.
+
If you want to connect to a compute node which does not run your job, use an [[TORQUE/Maui#Example Interactive Job|interactive job]].
−
 
 
−
This is the current incarnation of the script:
 
−
<source lang="bash">
 
−
#!/bin/bash
 
−
for i in {1..30}
 
−
do
 
−
  ssh node$i hostname
 
−
done
 
−
</source>
 
−
 
 
−
I have the script in my home directory, so instead of copying the script out yourself, you can just run it from my directory as follows:
 
−
 
 
−
<code>'''user@necluster:~$''' ~shart6/test_nodes</code>
 
−
 
 
−
==== Checking how much are nodes loaded ====
 
−
 
 
−
Either use [http://necluster.engr.utk.edu/ganglia/ Ganglia web interface], or type in a terminal:
 
−
<source lang="bash">
 
−
/opt/ganglia/bin/gstat -p8649 -1a -i necluster
 
−
</source>
 
−
 
 
−
* You can sum the user+system load and sort on the load sum. The least loaded nodes are shows first:
 
−
<source lang="bash">
 
−
/opt/ganglia/bin/gstat -p8649 -1a -i necluster | grep node | awk '{print $11+$13"\t"$1;}' | sort -g
 
−
</source> <br>
 
−
 
 
−
Please never run your code on the head node ("necluster") or any of the fileservers. Only use the machines which have *node* in their hostname.
 
  
 
==== Common Problems ====
 
==== Common Problems ====
  
−
Every once in a while the fingerprint of a node will change.  When this happens you will get a long error message telling you this when you try to log into a node:
+
Sometimes, when messing with a cluster, something will break and I'll have to regenerate a compute node's SSH key.  When this happens you will get a long error message telling you this when you try to log into a node:
  
 
  '''user@necluster:~$''' ssh ''node#''
 
  '''user@necluster:~$''' ssh ''node#''

Latest revision as of 07:01, 12 November 2021

General Rules

Many people are using this resource for their research, be considerate. Maintain your long term disk usage in your home directory is below 10 GB. Before you run a large calculation, contact the cluster admin to optimize the job. The use of this system is regulated by Acceptable Use of Information Technology Resources Policy. Sharing your credentials with others, if you have access to export controlled codes, is punishable by up to 10 years in federal prison.

Request Account

NE Cluster maintains its own accounts, independently of the UTK account registry. If you wish to request an account, please use this form: https://necluster.ne.utk.edu/cgi-bin/account.py


Getting Started on NECluster - Windows

SSH Client

To connect to the cluster you will need an SSH client. The easiest one to use, in my opinion is PuTTY. You can either download a standalone executable, or use the installer to install everything.

Once you've installed PuTTY you can just run it. A dialog window will pop up asking for some information. In the Host Name box you enter necluster.ne.utk.edu. Make sure the port is 22 and that SSH is checked. If you have a X Window Server (discussed next) and wish to use it, you also have to go to the X11 Category and put a check mark in the box next to Enable X11 forwarding. Note that on the first screen you can save your settings so that you don't have to type this in every time. Once done, click Open and enter your user name and password when prompted.

  • PuTTY

  • Basic Options

  • X11 Forwarding

  • Entering User/Pass

X Server - remote GUI

If you want to use some of the GUI programs on the cluster, you will need to install an X Server on your machine. A nice freeware X Server for Windows is Xming. When downloading Xming, first install the package Xming and then install the package Xming-fonts. Get the public domain release. If you desire you can install Xming-mesa instead of Xming for additional graphics capabilities that probably will not be used over a network connection anyways.

Once Xming is installed, you can run it from the start menu. It may seem like nothing is running after you click it, but if you check the application area of your task bar, you should see the Xming icon.

Xming is running!

Note that you can start Xming before or after you start PuTTY. As long as you forwarded your X connection it will work.


MobaXterm

MobaXterm is an enhanced terminal for Windows with X server, tabbed SSH client, network tools, and more.

Getting Started on NECluster - Mac/Linux

If you're running Mac OS X or any version of Linux it's even easier to get on the cluster. You generally already have a SSH Client and X Server installed! To log on to the cluster open up a terminal window and type the command:

ssh -X -l user necluster.ne.utk.edu
OR
ssh -X user@necluster.ne.utk.edu

The -X forwards the X connection. You can omit it if you don't plan on using any programs that use it. Like Windows, most terminal programs allow you to save sessions that you want to use regularly.

It is advisable to learn a bit about the powerful ssh command, here are some links to start: http://tychoish.com/rhizome/9-awesome-ssh-tricks/ http://www.mynitor.com/2010/08/07/the-ultimate-ssh-tricks-manual/

Also you can create file ~/.ssh/config to tell how you want ssh to behave: 

ForwardX11 yes
ForwardAgent yes
ForwardX11Trusted yes

Host cluster
        HostName necluster.ne.utk.edu
        User <your_username>
        IdentityFile ~/.ssh/id_rsa.UTKNEcluster


For newer releases of MacOS, you need to download X11 server separately, here: https://www.xquartz.org/ Make sure you switch on X11 forwarding when you connect using the ssh client.

First Time on the Cluster

Changing Password

The first time you're on the cluster the very first thing you will want to do is to change your password away from the temporary one that you were assigned. This is done by using the yppasswd command: 

user@necluster ~ $ yppasswd
Changing NIS account information for user on nefiles.
Please enter old password:
Changing NIS password for user on nefiles.
Please enter new password:
Please retype new password:

The NIS password has been changed on nefiles.

Your password has been changed!

Pre-requisites for Computing on the Cluster

When you first log on your prompt will be:

user@necluster:~$

This shows that you are on the head node. Jobs can only be submitted from the head node. When you submit jobs they execute on compute nodes, named node# where # is the node number. You can connect to compute nodes that run your jobs. The very first thing to do is create a public key file so you don't have to enter your password every time you want to connect to a compute node. Also it allows the job scheduler to copy job related files between nodes. To do this, follow the following steps: 

user@necluster:~$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/home/user/.ssh/id_rsa): Press <Enter>
Enter passphrase (empty for no passphrase): Press <Enter>
Enter same passphrase again: Press <Enter>
Your identification has been saved in /home/user/.ssh/id_rsa.
Your public key has been saved in /home/user/.ssh/id_rsa.pub.
The key fingerprint is:
Stuff
The key's randomart image is:
Funny boxed picture
user@necluster:~$ cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
user@necluster:~$ <done>

To connect to one of these nodes you can just SSH to it. Remember this only works if you have a job running that that node. 

user@necluster:~$ ssh node15
Cluster MOTD Information
user@node15:~$

If you want to connect to a compute node which does not run your job, use an interactive job.

Common Problems

Sometimes, when messing with a cluster, something will break and I'll have to regenerate a compute node's SSH key. When this happens you will get a long error message telling you this when you try to log into a node: 

user@necluster:~$ ssh node#
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY! Someone could be eavesdropping on you right now (man-in-the-middle attack)! 
It is also possible that the RSA host key has just been changed. The fingerprint for the RSA key sent by the remote host is 93:a2:1b:1c:5f:3e:68:47:bf:79:56:52:f0:ec:03:6b. 
Please contact your system administrator. Add correct host key in /home/user/.ssh/known_hosts to get rid of this message. 
Offending key in /home/user/.ssh/known_hosts:377

RSA host key for node# has changed and you have requested strict checking. Host key verification failed.

The easiest way to fix this error message is to remove the relevant key so that when you connect to the node again you can add the new key to the file: 

user@necluster:~$ ssh-keygen -R node#
/home/user/.ssh/known_hosts updated.
Original contents retained as /home/user/.ssh/known_hosts.old
Retrieved from "https://necluster.ne.utk.edu/wiki/index.php?title=Getting_Started&oldid=449"