Difference between revisions of "Nodes"

From NEClusterWiki
Jump to navigation Jump to search
 
(7 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
== Information on Installed Nodes ==
 
== Information on Installed Nodes ==
  
−
There are 4 "generations" of nodes installed on the cluster.  The oldest nodes are AMD dual core, the medium-old nodes are Intel Core 2 quad cores, and the latest nodes are Intel Xeon quad cores and Intel Core i7 quad cores with HyperThreading. Our last acquisition is the AMD Opteron Supernode. The specifications of each node are given in detail below.
+
There are 5 "generations" of nodes installed on the cluster.  The oldest nodes are AMD dual core, the medium-old nodes are Intel Core 2 quad cores, and the latest nodes are Intel Xeon quad cores and Intel Core i7 quad cores with HyperThreading. Our last acquisition is the AMD Opteron Supernode. The specifications of each node are given in detail below. The overall distribution of nodes in queues is shown in [[Node-Queue_Matrix]].
  
−
All nodes use Fedora 18 as their operating system.
+
All nodes use Fedora as their operating system.
  
 
=== AMD Opteron supernode ===
 
=== AMD Opteron supernode ===
Line 22: Line 22:
 
Core i7s nodes are quad cores with HyperThreading.  This means that they have 4 cores, but present 8 cores to the operating system.  Therefore you will see these nodes having 8 CPUs when looking at them in [http://necluster.engr.utk.edu/ganglia/ Ganglia].  Since they actually only have 4 cores, you will not get a linear increase in speed once the CPU is running more than 4 threads.  However, since there still is a perceptible increase in speed, it is beneficial to use all 8 threads rather than just limiting yourself to 4.
 
Core i7s nodes are quad cores with HyperThreading.  This means that they have 4 cores, but present 8 cores to the operating system.  Therefore you will see these nodes having 8 CPUs when looking at them in [http://necluster.engr.utk.edu/ganglia/ Ganglia].  Since they actually only have 4 cores, you will not get a linear increase in speed once the CPU is running more than 4 threads.  However, since there still is a perceptible increase in speed, it is beneficial to use all 8 threads rather than just limiting yourself to 4.
  
−
We currently have 15 of these nodes in the cluster.
+
We currently have 31 of these nodes in the cluster.  They spread three generations of corei7:  The gen3 queue is Nehalem (11 nodes), gen4 queue is Sandy Bridge (3 nodes), and gen5 is Haswell (17 nodes).
  
 
{| border="1"
 
{| border="1"
 
! Node Name !! Node CPU !! RAM !! Swap
 
! Node Name !! Node CPU !! RAM !! Swap
 
|-
 
|-
−
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node3 node3] || Core i7 860 @ 2.80 GHz || 12 GB || 90 GB
+
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node2 node2] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node3 node3] || Core i7 860 @ 2.80 GHz || 16 GB || 90 GB
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node4 node4] || Core i7 860 @ 2.80 GHz || 12 GB || 230 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node4 node4] || Core i7 860 @ 2.80 GHz || 12 GB || 230 GB
Line 45: Line 47:
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node11 node11] || Core i7 860 @ 2.80 GHz || 8 GB || 230 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node11 node11] || Core i7 860 @ 2.80 GHz || 8 GB || 230 GB
 
|-
 
|-
−
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node11 node12] || Core i7 860 @ 2.80 GHz || 12 GB || 230 GB
+
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node12 node12] || Core i7 4770 @ 3.40 GHz || 16 GB || 230 GB
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node13 node13] || Core i7 860 @ 2.80 GHz || 8 GB || 230 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node13 node13] || Core i7 860 @ 2.80 GHz || 8 GB || 230 GB
Line 52: Line 54:
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node15 node15] || Core i7 860 @ 2.80 GHz || 8 GB || 80 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node15 node15] || Core i7 860 @ 2.80 GHz || 8 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node19 node19] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node21 node21] || Core i7 2600 @ 3.40 GHz || 32 GB || 184 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node21 node21] || Core i7 2600 @ 3.40 GHz || 32 GB || 184 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node26 node26] || Core i7 4770 @ 3.40 GHz || 16 GB || 650 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node30 node30] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node31 node31] || Core i7 2600 @ 3.40 GHz || 32 GB || 184 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node31 node31] || Core i7 2600 @ 3.40 GHz || 32 GB || 184 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node35 node35] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node36 node36] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node37 node37] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node38 node38] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node39 node39] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node40 node40] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node41 node41] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node42 node42] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node43 node43] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node44 node44] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node45 node45] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 +
|-
 +
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node46 node46] || Core i7 4770 @ 3.40 GHz || 32 GB || 80 GB
 
|}
 
|}
  
Line 67: Line 99:
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node32 node32] || 2x Xeon X5680 @ 3.33GHz || 48 GB || 50 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node32 node32] || 2x Xeon X5680 @ 3.33GHz || 48 GB || 50 GB
 
|-
 
|-
−
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node32 node33] || 2x Xeon X5660 @ 2.80GHz || 48GB || 50 GB
+
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node32 node33] || 2x Xeon X5660 @ 2.80GHz || 48 GB || 50 GB
 
|}
 
|}
  
Line 95: Line 127:
 
These are slightly older machines.  They have 4 physical cores and no HyperThreading, so when you look at them in [http://necluster.engr.utk.edu/ganglia/ Ganglia] you will see that they have 4 CPUs.  They are still reasonably fast.
 
These are slightly older machines.  They have 4 physical cores and no HyperThreading, so when you look at them in [http://necluster.engr.utk.edu/ganglia/ Ganglia] you will see that they have 4 CPUs.  They are still reasonably fast.
  
−
We currently have 9 of these nodes in the cluster. In addition, node18 has a similar architecture, but has 2 CPUs (8 cores total).  
+
We currently have 5 of these nodes in the cluster. In addition, node18 has a similar architecture, but has 2 CPUs (8 cores total).  
  
 
{| border="1"
 
{| border="1"
 
! Node Name !! Node CPU !! RAM !! Swap
 
! Node Name !! Node CPU !! RAM !! Swap
−
|-
 
−
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node2 node2] || Core 2 Quad Q8200 @ 2.33 GHz || 8 GB || 90 GB
 
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node18 node18] || 2x 4-core Xeon L5420 @ 2.50 GHz || 8 GB || 80 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node18 node18] || 2x 4-core Xeon L5420 @ 2.50 GHz || 8 GB || 80 GB
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node25 node25] || Core 2 Quad Q8200 @ 2.33 GHz || 8 GB || 649 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node25 node25] || Core 2 Quad Q8200 @ 2.33 GHz || 8 GB || 649 GB
−
|-
 
−
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node26 node26] || Core 2 Quad Q8200 @ 2.33 GHz || 8 GB || 649 GB
 
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node27 node27] || Core 2 Quad Q8200 @ 2.33 GHz || 8 GB || 649 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node27 node27] || Core 2 Quad Q8200 @ 2.33 GHz || 8 GB || 649 GB
Line 113: Line 141:
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node29 node29] || Core 2 Quad Q8200 @ 2.33 GHz || 8 GB || 90 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node29 node29] || Core 2 Quad Q8200 @ 2.33 GHz || 8 GB || 90 GB
−
|-
 
−
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node30 node30] || Core 2 Quad Q8200 @ 2.33 GHz || 8 GB || 649 GB
 
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node34 node34] || Core 2 Quad Q6600 @ 2.40 GHz || 8 GB || 50 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node34 node34] || Core 2 Quad Q6600 @ 2.40 GHz || 8 GB || 50 GB
Line 123: Line 149:
 
These are the "ancient" machines.  They have two physical cores, and also no HyperThreading.  If speed isn't that important you should use these nodes.  They're also good at adding some speed to your MPI [[MCNP]] runs when using the ''balance'' flag.  Compiling and other disk I/O tasks are also suited well to these nodes, since all nodes have the same delay when writing to the [[Filesystems Available|file servers]].
 
These are the "ancient" machines.  They have two physical cores, and also no HyperThreading.  If speed isn't that important you should use these nodes.  They're also good at adding some speed to your MPI [[MCNP]] runs when using the ''balance'' flag.  Compiling and other disk I/O tasks are also suited well to these nodes, since all nodes have the same delay when writing to the [[Filesystems Available|file servers]].
  
−
We currently have 7 of these nodes in the cluster.
+
We currently have 6 of these nodes in the cluster.
  
 
{| border="1"
 
{| border="1"
Line 131: Line 157:
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node17 node17] || Athlon 64 X2 5200+ || 8 GB || 184 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node17 node17] || Athlon 64 X2 5200+ || 8 GB || 184 GB
−
|-
 
−
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node19 node19] || Athlon 64 X2 5200+ || 8 GB || 10 GB
 
 
|-
 
|-
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node20 node20] || Athlon 64 X2 5200+ || 8 GB || 184 GB
 
| [http://necluster.engr.utk.edu/ganglia/?c=NE%20Cluster&h=node20 node20] || Athlon 64 X2 5200+ || 8 GB || 184 GB

Latest revision as of 19:15, 14 July 2017

Information on Installed Nodes

There are 5 "generations" of nodes installed on the cluster. The oldest nodes are AMD dual core, the medium-old nodes are Intel Core 2 quad cores, and the latest nodes are Intel Xeon quad cores and Intel Core i7 quad cores with HyperThreading. Our last acquisition is the AMD Opteron Supernode. The specifications of each node are given in detail below. The overall distribution of nodes in queues is shown in Node-Queue_Matrix.

All nodes use Fedora as their operating system.

AMD Opteron supernode

Opteron supernodes have 4 CPUs, 12 real cores each, that is 48 physical cores in total. The machines are to be used for highly parallel computations with huge MPI traffic. THey are connected with Infiniband interconnect. Please ask the admins if you would like to use it. Each supernode has a small disk array mounted in /data. If the user of the supernode uses only one node, the user should use that filesystem for I/O.

Node Name Node CPU RAM Swap
node0 4x AMD Opteron 6234 @ 2.4 GHz 128 GB 100 GB
node1 4x AMD Opteron 6234 @ 2.4 GHz 128 GB 100 GB

Intel Core i7 Nodes

Core i7s nodes are quad cores with HyperThreading. This means that they have 4 cores, but present 8 cores to the operating system. Therefore you will see these nodes having 8 CPUs when looking at them in Ganglia. Since they actually only have 4 cores, you will not get a linear increase in speed once the CPU is running more than 4 threads. However, since there still is a perceptible increase in speed, it is beneficial to use all 8 threads rather than just limiting yourself to 4.

We currently have 31 of these nodes in the cluster. They spread three generations of corei7: The gen3 queue is Nehalem (11 nodes), gen4 queue is Sandy Bridge (3 nodes), and gen5 is Haswell (17 nodes).

Node Name Node CPU RAM Swap
node2 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node3 Core i7 860 @ 2.80 GHz 16 GB 90 GB
node4 Core i7 860 @ 2.80 GHz 12 GB 230 GB
node5 Core i7 860 @ 2.80 GHz 8 GB 230 GB
node6 Core i7 860 @ 2.80 GHz 8 GB 230 GB
node7 Core i7 860 @ 2.80 GHz 8 GB 90 GB
node8 Core i7 860 @ 2.80 GHz 12 GB 90 GB
node9 Core i7 2600 @ 3.40 GHz 32 GB 184 GB
node10 Core i7 860 @ 2.80 GHz 8 GB 230 GB
node11 Core i7 860 @ 2.80 GHz 8 GB 230 GB
node12 Core i7 4770 @ 3.40 GHz 16 GB 230 GB
node13 Core i7 860 @ 2.80 GHz 8 GB 230 GB
node14 Core i7 860 @ 2.80 GHz 8 GB 230 GB
node15 Core i7 860 @ 2.80 GHz 8 GB 80 GB
node19 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node21 Core i7 2600 @ 3.40 GHz 32 GB 184 GB
node26 Core i7 4770 @ 3.40 GHz 16 GB 650 GB
node30 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node31 Core i7 2600 @ 3.40 GHz 32 GB 184 GB
node35 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node36 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node37 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node38 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node39 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node40 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node41 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node42 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node43 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node44 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node45 Core i7 4770 @ 3.40 GHz 32 GB 80 GB
node46 Core i7 4770 @ 3.40 GHz 32 GB 80 GB

Intel Xeon Nodes

There are workstations re-purposed as compute nodes. They are comparable to the Core i7s, but with more cores.

Node Name Node CPU RAM Swap
node32 2x Xeon X5680 @ 3.33GHz 48 GB 50 GB
node33 2x Xeon X5660 @ 2.80GHz 48 GB 50 GB

Intel Xeon Virtual Nodes

There are five virtual nodes running inside Windows workstations. Each of them has a quad core Intel Xeon of SandyBridge architecture, identical to the Core i7s, but without HyperThreading. This machines are connected to the rest of the cluster nodes by a virtual private network (VPN), which is ~1.5 order of magnitude slower than the Gigabit interconnect used by non-virtual nodes. Therefore these machines should not be used for MPI jobs. Virtual nodes are best suited for sequential programs, OpenMP jobs, and code development.

Node Name Node CPU RAM Swap
vnode1 Xeon E31220 @ 3.10 GHz 8 GB 50 GB
vnode2 Xeon E31220 @ 3.10 GHz 8 GB 50 GB
vnode3 Xeon E31220 @ 3.10 GHz 8 GB 50 GB
vnode4 Xeon E31220 @ 3.10 GHz 8 GB 50 GB
vnode5 Xeon E31220 @ 3.10 GHz 8 GB 50 GB

Intel Core 2 Quad Nodes

These are slightly older machines. They have 4 physical cores and no HyperThreading, so when you look at them in Ganglia you will see that they have 4 CPUs. They are still reasonably fast.

We currently have 5 of these nodes in the cluster. In addition, node18 has a similar architecture, but has 2 CPUs (8 cores total).

Node Name Node CPU RAM Swap
node18 2x 4-core Xeon L5420 @ 2.50 GHz 8 GB 80 GB
node25 Core 2 Quad Q8200 @ 2.33 GHz 8 GB 649 GB
node27 Core 2 Quad Q8200 @ 2.33 GHz 8 GB 649 GB
node28 Core 2 Quad Q8200 @ 2.33 GHz 8 GB 10 GB
node29 Core 2 Quad Q8200 @ 2.33 GHz 8 GB 90 GB
node34 Core 2 Quad Q6600 @ 2.40 GHz 8 GB 50 GB

AMD Dual Core Nodes

These are the "ancient" machines. They have two physical cores, and also no HyperThreading. If speed isn't that important you should use these nodes. They're also good at adding some speed to your MPI MCNP runs when using the balance flag. Compiling and other disk I/O tasks are also suited well to these nodes, since all nodes have the same delay when writing to the file servers.

We currently have 6 of these nodes in the cluster.

Node Name Node CPU RAM Swap
node16 Athlon 64 X2 5200+ 8 GB 184 GB
node17 Athlon 64 X2 5200+ 8 GB 184 GB
node20 Athlon 64 X2 5200+ 8 GB 184 GB
node22 Athlon 64 X2 5200+ 8 GB 10 GB
node23 Athlon 64 X2 5200+ 8 GB 10 GB
node24 Athlon 64 X2 5200+ 8 GB 10 GB
Retrieved from "https://necluster.ne.utk.edu/wiki/index.php?title=Nodes&oldid=347"