Difference between revisions of "Labs:HPC switch"

From Define Wiki
Jump to navigation Jump to search
 
(24 intermediate revisions by 2 users not shown)
Line 2: Line 2:
  
 
The HPC switches can be managed at the following addresses:
 
The HPC switches can be managed at the following addresses:
−
<br>switch1 = http://172.16.254.1
+
 
−
<br>switch2 = http://172.16.254.2
+
<br>http://switch04.bostonlabs.co.uk
−
<br>switch3 = http://172.16.254.3
+
<br>http://switch05.bostonlabs.co.uk
 +
<br>http://switch06.bostonlabs.co.uk
 +
 
  
 
<br>Password for all 3 switches is: <b>BostonHPC2012</B>
 
<br>Password for all 3 switches is: <b>BostonHPC2012</B>
Line 10: Line 12:
 
== HPC Switch Ports ==
 
== HPC Switch Ports ==
  
−
<center><b>*** The following information is all WRONG!!!***</b></center>
+
=== Switch 04 - Centre Cab ===
−
 
 
−
=== Switch 01 - Centre Cab ===
 
  
 
<center>
 
<center>
Line 33: Line 33:
 
! style="background: yellow"| Port 39 <br/> Head Node (Lab)
 
! style="background: yellow"| Port 39 <br/> Head Node (Lab)
 
! style="background: white"| Port 41 <br/>   
 
! style="background: white"| Port 41 <br/>   
 +
! style="background: white"| Port 43 <br/> 
 +
! style="background: white"| Port 45 <br/>
 +
! style="background: light grey"| Port 47 <br/> Tagged Switch02
 
|- valign="top"
 
|- valign="top"
 
! style="background: cyan"| Port 2 <br/> Compute 001
 
! style="background: cyan"| Port 2 <br/> Compute 001
Line 45: Line 48:
 
! style="background: white"| Port 20 <br/>
 
! style="background: white"| Port 20 <br/>
 
! style="background: white"| ... <br/>  
 
! style="background: white"| ... <br/>  
−
! style="background: white"| Port 34<br/>  
+
! style="background: burlywood"| Port 34<br/> Blades
 
! style="background: white"| Port 36 <br/>
 
! style="background: white"| Port 36 <br/>
−
! style="background: white"| Port 38 <br/> PXE -> Lab
+
! style="background: burlywood"| Port 38 <br/> PXE -> Lab
 
! style="background: white"| Port 40 <br/>  
 
! style="background: white"| Port 40 <br/>  
 
! style="background: white"| Port 42 <br/>  
 
! style="background: white"| Port 42 <br/>  
−
! style="background: white"| Port 44 <br/> LAB -> HPC
+
! style="background: burlywood"| Port 44 <br/> LAB -> HPC
 +
! style="background: white"| Port 46 <br/>
 +
! style="background: silver"| Port 48 <br/>  Tagged Switch03
 
|}
 
|}
 
</center>
 
</center>
  
−
=== Switch 02 - Right Cab ===
+
=== Switch 05 - Right Cab ===
  
 
<center>
 
<center>
 
{| class="wikitable"
 
{| class="wikitable"
 
|- valign="top"
 
|- valign="top"
−
! style="background: white"| Port 1 <br/>  
+
! style="background: burlywood"| Port 1 <br/> CLI1
−
! style="background: white"| Port 3 <br/>   
+
! style="background: burlywood"| Port 3 <br/>  MDS1
−
! style="background: white"| Port 5 <br/>  
+
! style="background: burlywood"| Port 5 <br/> OSS1
−
! style="background: white"| Port 7 <br/>  
+
! style="background: burlywood"| Port 7 <br/> OSS3
 
! style="background: white"| Port 9 <br/>  
 
! style="background: white"| Port 9 <br/>  
 
! style="background: white"| Port 11 <br/>  
 
! style="background: white"| Port 11 <br/>  
 
! style="background: white"| Port 13 <br/>  
 
! style="background: white"| Port 13 <br/>  
 
! style="background: white"| Port 15 <br/>  
 
! style="background: white"| Port 15 <br/>  
 +
! style="background: burlywood"| Port 17 <br/> Cloud Viridis
 +
! style="background: white"| ... <br/>
 +
! style="background: limegreen"| Port 25 <br/>  CLI1
 +
! style="background: limegreen"| Port 27 <br/>  MDS1
 +
! style="background: limegreen"| Port 29 <br/>  OSS1
 +
! style="background: limegreen"| Port 31 <br/>  OSS3
 
! style="background: white"| ... <br/>  
 
! style="background: white"| ... <br/>  
 
! style="background: white"| Port 39<br/>  
 
! style="background: white"| Port 39<br/>  
Line 74: Line 85:
 
! style="background: white"| Port 47 <br/>  
 
! style="background: white"| Port 47 <br/>  
 
|- valign="top"
 
|- valign="top"
−
! style="background: white"| Port 2 <br/>  
+
! style="background: burlywood"| Port 2 <br/> IML1
−
! style="background: white"| Port 4 <br/>  
+
! style="background: burlywood"| Port 4 <br/> MDS2
−
! style="background: white"| Port 6 <br/>  
+
! style="background: burlywood"| Port 6 <br/> OSS2
−
! style="background: white"| Port 8 <br/>  
+
! style="background: burlywood"| Port 8 <br/> OSS4
 
! style="background: white"| Port 10 <br/>  
 
! style="background: white"| Port 10 <br/>  
 
! style="background: white"| Port 12 <br/>  
 
! style="background: white"| Port 12 <br/>  
 
! style="background: white"| Port 14 <br/>  
 
! style="background: white"| Port 14 <br/>  
 
! style="background: white"| Port 16 <br/>
 
! style="background: white"| Port 16 <br/>
 +
! style="background: burlywood"| Port 18 <br/>  Midway Viridis
 
! style="background: white"| ... <br/>  
 
! style="background: white"| ... <br/>  
 +
! style="background: limegreen"| Port 26 <br/>  IML1
 +
! style="background: yellow"| Port 28 <br/>  MDS2
 +
! style="background: yellow"| Port 30 <br/> OSS2
 +
! style="background: yellow"| Port 32 <br/> OSS4
 +
! style="background: white"| ... <br/>
 
! style="background: white"| Port 40<br/>  
 
! style="background: white"| Port 40<br/>  
 
! style="background: white"| Port 42 <br/>
 
! style="background: white"| Port 42 <br/>
 
! style="background: white"| Port 44 <br/>  
 
! style="background: white"| Port 44 <br/>  
 
! style="background: white"| Port 46 <br/>  
 
! style="background: white"| Port 46 <br/>  
−
! style="background: white"| Port 48 <br/>  
+
! style="background: light grey"| Port 48 <br/> Tagged Switch01
 
|}
 
|}
 
</center>
 
</center>
  
−
=== Switch 03 - Left Cab ===
+
=== Switch 06 - Left Cab ===
 +
 
  
 
<center>
 
<center>
 
{| class="wikitable"
 
{| class="wikitable"
 
|- valign="top"
 
|- valign="top"
−
! style="background: silver"| Port 1 <br/> HPC -> Lab
+
! style="background: white"| Port 1 <br/>  
−
! style="background: cyan"| Port 3 <br/> Compute000
+
! style="background: white"| Port 3 <br/>
−
! style="background: cyan"| Port 5 <br/> Compute002
+
! style="background: white"| Port 5 <br/>  
−
! style="background: cyan"| Port 7 <br/> Compute008
+
! style="background: white"| Port 7 <br/>  
−
! style="background: cyan"| Port 9 <br/> Compute010
+
! style="background: white"| Port 9 <br/>  
−
! style="background: cyan"| Port 11 <br/> Compute020
+
! style="background: white"| Port 11 <br/>  
−
! style="background: cyan"| Port 13 <br/> Compute022
+
! style="background: white"| Port 13 <br/>  
 
! style="background: white"| Port 15 <br/>  
 
! style="background: white"| Port 15 <br/>  
 
! style="background: white"| ... <br/>  
 
! style="background: white"| ... <br/>  
−
! style="background: silver"| Port 39<br/> PXE -> Lab
+
! style="background: green"| Port 31 <br/> EPCC windows System
−
! style="background: palegreen"| Port 41 <br/> Head Node Eth2
+
! style="background: white"| ... <br/>
 +
! style="background: white"| Port 39<br/>  
 +
! style="background: white"| Port 41 <br/>  
 
! style="background: white"| Port 43 <br/>  
 
! style="background: white"| Port 43 <br/>  
−
! style="background: silver"| Port 45 <br/> Lab -> Switch
+
! style="background: white"| Port 45 <br/>  
−
! style="background: red"| Port 47 <br/> Head Node
+
! style="background: white"| Port 47 <br/>  
 
|- valign="top"
 
|- valign="top"
−
! style="background: cyan"| Port 2 <br/> Head Node Eth0
+
! style="background: white"| Port 2 <br/>  
−
! style="background: cyan"| Port 4 <br/> Compute001
+
! style="background: white"| Port 4 <br/>  
−
! style="background: cyan"| Port 6 <br/> Compute003
+
! style="background: white"| Port 6 <br/>  
−
! style="background: cyan"| Port 8 <br/> Compute009
+
! style="background: white"| Port 8 <br/>  
−
! style="background: cyan"| Port 10 <br/> Compute011
+
! style="background: white"| Port 10 <br/>  
−
! style="background: cyan"| Port 12 <br/> Compute021
+
! style="background: white"| Port 12 <br/>  
−
! style="background: cyan"| Port 14 <br/> Compute023
+
! style="background: white"| Port 14 <br/>  
 
! style="background: white"| Port 16 <br/>
 
! style="background: white"| Port 16 <br/>
 
! style="background: white"| ... <br/>  
 
! style="background: white"| ... <br/>  
−
! style="background: silver"| Port 40<br/> Jons Virids
+
! style="background: white"| Port 32 <br/>
−
! style="background: white"| Port 42 <br/>
+
! style="background: white"| ... <br/>
 +
! style="background: burlywood"| Port 40<br/> EPCC1
 +
! style="background: burlywood"| Port 42 <br/> EPCC2
 
! style="background: white"| Port 44 <br/>  
 
! style="background: white"| Port 44 <br/>  
 
! style="background: white"| Port 46 <br/>  
 
! style="background: white"| Port 46 <br/>  
−
! style="background: red"| Port 48 <br/> Head Node
+
! style="background: white"| Port 48 <br/> Tagged Switch01
 
|}
 
|}
 
</center>
 
</center>
  
 
== HPC Infiniband Switch ==
 
== HPC Infiniband Switch ==
 +
 +
=== Qlogic - Right Cab (lustre) ===
  
 
<center>
 
<center>
 
{| class="wikitable"
 
{| class="wikitable"
 
|- valign="top"
 
|- valign="top"
−
! style="background: white"| Port 1 <br/> Compute000
+
! style="background: white"| Port 1 <br/> CLI1
−
! style="background: white"| Port 3 <br/> Compute002
+
! style="background: white"| Port 3 <br/> MDS1
−
! style="background: white"| Port 5 <br/>  
+
! style="background: white"| Port 5 <br/> OSS1
−
! style="background: white"| Port 7 <br/>  
+
! style="background: white"| Port 7 <br/> OSS3
 
! style="background: white"| Port 9 <br/>  
 
! style="background: white"| Port 9 <br/>  
  
 
|- valign="top"
 
|- valign="top"
−
! style="background: white"| Port 2 <br/> Compute001
+
! style="background: white"| Port 2 <br/> IML1
−
! style="background: white"| Port 4 <br/> Compute003
+
! style="background: white"| Port 4 <br/> MDS2
−
! style="background: white"| Port 6 <br/>  
+
! style="background: white"| Port 6 <br/> OSS2
−
! style="background: white"| Port 8 <br/>  
+
! style="background: white"| Port 8 <br/> OSS4
 
! style="background: white"| Port 10 <br/>  
 
! style="background: white"| Port 10 <br/>  
  
Line 151: Line 175:
 
==Vlan==
 
==Vlan==
  
−
<center><b>*** The following information is all WRONG!!!***</b></center>
+
=== Switch 01 - Centre Cab ===
 +
 
 +
* Ports 1 - 32 -> HPC
 +
* Ports 33 - 38 -> PXE
 +
* Ports 39 - 44 -> LAB
 +
* Ports 45 - 48 -> TAGGED
 +
 
 +
=== Switch 02 - Right Cab ===
 +
 
 +
* Ports 1 - 24 -> PXE
 +
* Ports 23 - 32 -> LUSTRE PRIV
 +
* Ports 33 - 38 -> HPC
 +
* Ports 39 - 44 -> LAB
 +
* Ports 45 - 48 -> TAGGED
 +
 
 +
=== Switch 03 - Left Cab ===
  
−
# HPC Ports 1-38
+
* Ports 1 - 32 -> LAB
−
# Pxe Ports 39-44
+
* Ports 33 - 38 -> HPC
−
# Lab Ports 44-48
+
* Ports 39 - 44 -> PXE
 +
* Ports 45 - 48 -> TAGGED
  
 
== Move a system between networks ==
 
== Move a system between networks ==

Latest revision as of 09:11, 28 August 2018

Accessing the switchs

The HPC switches can be managed at the following addresses:


http://switch04.bostonlabs.co.uk
http://switch05.bostonlabs.co.uk
http://switch06.bostonlabs.co.uk



Password for all 3 switches is: BostonHPC2012

HPC Switch Ports

Switch 04 - Centre Cab

Port 1
Head Node (HPC) 		Port 3
Compute 002 		Port 5
Compute 004 		Port 7
Compute 006 		Port 9
Compute 008 		Port 11
Compute 010 		Port 13
Compute 012 		Port 15
GPU1 		Port 17
GPU3 		Port 19
GPU5 		...
Port 33
Head Node (PXE) 		Port 35
Port 37
Port 39
Head Node (Lab) 		Port 41
Port 43
Port 45
Port 47
Tagged Switch02
Port 2
Compute 001 		Port 4
Compute 003 		Port 6
Compute 005 		Port 8
Compute 007 		Port 10
Compute 009 		Port 12
Compute 011 		Port 14
X10 		Port 16
GPU2 		Port 18
GPU4 		Port 20
...
Port 34
Blades 		Port 36
Port 38
PXE -> Lab 		Port 40
Port 42
Port 44
LAB -> HPC 		Port 46
Port 48
Tagged Switch03

Switch 05 - Right Cab

Port 1
CLI1 		Port 3
MDS1 		Port 5
OSS1 		Port 7
OSS3 		Port 9
Port 11
Port 13
Port 15
Port 17
Cloud Viridis 		...
Port 25
CLI1 		Port 27
MDS1 		Port 29
OSS1 		Port 31
OSS3 		...
Port 39
 Port 41
Port 43
Port 45
Port 47
Port 2
IML1 		Port 4
MDS2 		Port 6
OSS2 		Port 8
OSS4 		Port 10
Port 12
Port 14
Port 16
Port 18
Midway Viridis 		...
Port 26
IML1 		Port 28
MDS2 		Port 30
OSS2 		Port 32
OSS4 		...
Port 40
 Port 42
Port 44
Port 46
Port 48
Tagged Switch01

Switch 06 - Left Cab

Port 1
Port 3
Port 5
Port 7
Port 9
Port 11
Port 13
Port 15
...
Port 31
EPCC windows System 		...
Port 39
 Port 41
Port 43
Port 45
Port 47
Port 2
Port 4
Port 6
Port 8
Port 10
Port 12
Port 14
Port 16
...
Port 32
...
Port 40
EPCC1 		Port 42
EPCC2 		Port 44
Port 46
Port 48
Tagged Switch01

HPC Infiniband Switch

Qlogic - Right Cab (lustre)

Port 1
CLI1 		Port 3
MDS1 		Port 5
OSS1 		Port 7
OSS3 		Port 9
Port 2
IML1 		Port 4
MDS2 		Port 6
OSS2 		Port 8
OSS4 		Port 10

Vlan

Switch 01 - Centre Cab

  • Ports 1 - 32 -> HPC
  • Ports 33 - 38 -> PXE
  • Ports 39 - 44 -> LAB
  • Ports 45 - 48 -> TAGGED

Switch 02 - Right Cab

  • Ports 1 - 24 -> PXE
  • Ports 23 - 32 -> LUSTRE PRIV
  • Ports 33 - 38 -> HPC
  • Ports 39 - 44 -> LAB
  • Ports 45 - 48 -> TAGGED

Switch 03 - Left Cab

  • Ports 1 - 32 -> LAB
  • Ports 33 - 38 -> HPC
  • Ports 39 - 44 -> PXE
  • Ports 45 - 48 -> TAGGED

Move a system between networks

  1. Click on configuration -> vlan
  2. Select the vlan to ports are currently on and make them a non member
  3. Select the vlan they need to be added to and make them a member
Retrieved from "http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=Labs:HPC_switch&oldid=27484"