Mellanox:Ethernet Switch Configure VLANs

From Define Wiki
Jump to navigation Jump to search

This setup was used for Piston Coud, multiple VLANs routing between each other on the same switch.

Setup VLANs on SX1024

Default username and password: admin/admin 

HPC-10GB [standalone: master] > enable 
HPC-10GB [standalone: master] # configure terminal
HPC-10GB [standalone: master] (config) # ip routing 
HPC-10GB [standalone: master] (config) # vlan 13 
HPC-10GB [standalone: master] (config vlan 13) # name services
HPC-10GB [standalone: master] (config vlan 13) # exit
HPC-10GB [standalone: master] (config) # vlan 14
HPC-10GB [standalone: master] (config vlan 14) # name cloud
HPC-10GB [standalone: master] (config vlan 14) # exit
HPC-10GB [standalone: master] (config) # vlan 15
HPC-10GB [standalone: master] (config vlan 15) # name public
HPC-10GB [standalone: master] (config vlan 15) # exit
HPC-10GB [standalone: master] (config) # show vlan

VLAN    Name               	Ports
----    -----------        	--------------------------------------
1       default         	Eth1/1, Eth1/2, Eth1/3, Eth1/4, Eth1/5,
				Eth1/6, Eth1/7, Eth1/8, Eth1/9, Eth1/10,
				Eth1/11, Eth1/12, Eth1/13, Eth1/14, Eth1/15,
				Eth1/16, Eth1/17, Eth1/18, Eth1/19, Eth1/20,
				Eth1/21, Eth1/22, Eth1/23, Eth1/24, Eth1/25,
				Eth1/26, Eth1/27, Eth1/28, Eth1/29, Eth1/30,
				Eth1/31, Eth1/32, Eth1/33, Eth1/34, Eth1/35,
				Eth1/36, Eth1/37, Eth1/38, Eth1/39, Eth1/40,
				Eth1/41, Eth1/42, Eth1/43, Eth1/44, Eth1/45,
				Eth1/46, Eth1/47, Eth1/48, Eth1/49, Eth1/50,
				Eth1/51, Eth1/52, Eth1/53, Eth1/54, Eth1/55,
				Eth1/56, Eth1/57, Eth1/58, Eth1/59, Eth1/60
13      services        	
14      cloud           	
15      public          	
HPC-10GB [standalone: master] (config) # interface vlan 13 ip address 192.168.2.1 255.255.255.192
HPC-10GB [standalone: master] (config) # interface vlan 13 no shutdown
HPC-10GB [standalone: master] (config) # interface vlan 14 ip address 192.168.3.1 255.255.255.0
HPC-10GB [standalone: master] (config) # interface vlan 14 no shutdown
HPC-10GB [standalone: master] (config) # interface vlan 15 ip address 192.168.4.1 255.255.255.192
HPC-10GB [standalone: master] (config) # interface vlan 15 no shutdown
HPC-10GB [standalone: master] (config) # write memory

# VLANs are down at the moment
HPC-10GB [standalone: master] (config) # interface vlan 13
HPC-10GB [standalone: master] (config interface vlan 13) # show interface vlan 13

# Set ports up as hybrid and assign ports to VLANs, repeat for every port
HPC-10GB [standalone: master] (config) # interface ethernet 1/2
HPC-10GB [standalone: master] (config interface ethernet 1/2) # switchport mode hybrid 
HPC-10GB [standalone: master] (config interface ethernet 1/2) # switchport hybrid allowed-vlan all
HPC-10GB [standalone: master] (config interface ethernet 1/2) # exit

Vlan 13
  Admin state: Enabled
  Operational state: Down (no up member port)
  Mac Address: f4:52:14:2d:bb:d8   
  Internet Address: 192.168.2.1/26
  Broadcast address: 192.168.2.63
  MTU: 1500 bytes
  Arp timeout: 1500 seconds
  Description: N/A
  Counters: Disabled

Show all the VLAN Interfaces

HPC-10GB [standalone: master] (config) # show interfaces vlan 

Vlan 13
  Admin state: Enabled
  Operational state: Down (no up member port)
  Mac Address: f4:52:14:2d:bb:d8   
  Internet Address: 192.168.2.1/26
  Broadcast address: 192.168.2.63
  MTU: 1500 bytes
  Arp timeout: 1500 seconds
  Description: N/A
  Counters: Disabled

Vlan 14
  Admin state: Enabled
  Operational state: Down (no up member port)
  Mac Address: f4:52:14:2d:bb:d8   
  Internet Address: 192.168.3.1/24
  Broadcast address: 192.168.3.255
  MTU: 1500 bytes
  Arp timeout: 1500 seconds
  Description: N/A
  Counters: Disabled

Vlan 15
  Admin state: Enabled
  Operational state: Down (no up member port)
  Mac Address: f4:52:14:2d:bb:d8   
  Internet Address: 192.168.4.1/26
  Broadcast address: 192.168.4.63
  MTU: 1500 bytes
  Arp timeout: 1500 seconds
  Description: N/A
  Counters: Disabled

Show what MAC are plugged in to each port

HPC-10GB [standalone: master] (config) # show mac-address-table 

Switch ethernet-default 

Vlan    Mac Address         Type       Interface
----    -----------         ----       ------------
1       e4:1d:2d:00:cd:80   dynamic    Eth1/7
1       e4:1d:2d:00:d1:e0   dynamic   Eth1/28

Setting all the ports to hybrid and all VLANs

Not even sure if this is required 

interface ethernet 1/1
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/2
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/3
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/4
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/5
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/6
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/7
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/8
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/9
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/10
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/11
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/12
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/13
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/14
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/15
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/16
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/17
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/18
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/19
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/20
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/21
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/22
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/23
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/24
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/25
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/26
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/27
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/28
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/29
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/30
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/31
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/32
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/33
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/34
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/35
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/36
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/37
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/38
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/39
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/40
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/41
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/42
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/43
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/44
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/45
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/46
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/47
switchport mode hybrid
switchport hybrid allowed-vlan all
exit
interface ethernet 1/48
switchport mode hybrid
switchport hybrid allowed-vlan all
exit

After the above my VLANs are UP

HPC-10GB [standalone: master] (config) # show interfaces vlan

Vlan 13
  Admin state: Enabled
  Operational state: Up
  Mac Address: f4:52:14:2d:bb:d8   
  Internet Address: 192.168.2.1/26
  Broadcast address: 192.168.2.63
  MTU: 1500 bytes
  Arp timeout: 1500 seconds
  Description: N/A
  Counters: Disabled

Vlan 14
  Admin state: Enabled
  Operational state: Up
  Mac Address: f4:52:14:2d:bb:d8   
  Internet Address: 192.168.3.1/24
  Broadcast address: 192.168.3.255
  MTU: 1500 bytes
  Arp timeout: 1500 seconds
  Description: N/A
  Counters: Disabled

Vlan 15
  Admin state: Enabled
  Operational state: Up
  Mac Address: f4:52:14:2d:bb:d8   
  Internet Address: 192.168.4.1/26
  Broadcast address: 192.168.4.63
  MTU: 1500 bytes
  Arp timeout: 1500 seconds
  Description: N/A
  Counters: Disabled

Removing a VLAN

Incorrectly created 

HPC-10GB [standalone: master] (config) # no vlan 3
HPC-10GB [standalone: master] (config) # no vlan 4
HPC-10GB [standalone: master] (config) # no vlan 5

# or just remove the interface ip if configured and leave the vlan
HPC-10GB [standalone: master] (config) # interface vlan 5 no

Setting up OSFP for Piston 3.6

switch-d15c16 [standalone: master] (config) # no spanning-tree 
switch-d15c16 [standalone: master] (config) # protocol ospf 
switch-d15c16 [standalone: master] (config) # router ospf
switch-d15c16 [standalone: master] (config router ospf) # exit
switch-d15c16 [standalone: master] (config) # interface vlan 103 ip ospf area 1
switch-d15c16 [standalone: master] (config) # show ip ospf

Routing Process 1 with ID 172.16.3.1 vrf-default

Stateful High Availability is not supported
Graceful-restart is not supported
Supports only single TOS (TOS 0) route
Opaque LSA not supported
OSPF Admin State is enabled 
Redistributing External Routes: Disabled
Administrative distance 110 
Reference Bandwidth is 40 Gbps
Initial SPF schedule delay 1 msecs 
SPF Hold time 5000 msecs 
Maximum paths to destination 64
Router LSA with maximum metric is not supported
Condition: Always
Number of external LSAs 0, checksum sum 0 
Number of opaque AS LSAs 0, checksum sum 0
Number of areas is 1, 1 normal, 0 stub, 0 nssa
Number of active areas is 1, 1 normal, 0 stub, 0 nssa

Area (0.0.0.1) (Active)
Interfaces in this area: 1 Active Interfaces: 1
Passive Interfaces: 0
SPF Calculation has run 1 times
This area is Normal area
Number of LSAs: 1, checksum sum 37716

switch-d15c16 [standalone: master] (config) # show ip ospf interface 

Interface Vlan is 103 Enabled, line protocol is Up 
IP address 172.16.3.1, Mask 255.255.255.0
Process ID 1 VRF Default, Area 0.0.0.1
OSPF Interface Admin State is enabled
State DESIGNATED ROUTER, Network Type BROADCAST, Cost 10
Transmit delay 1 sec, Router Priority 1
No designated router on this network
No backup designated router on this network
Timer intervals (sec's): Hello 10, Dead 40, Wait 40, Retransmit 5
No authentication
Number of opaque link LSAs: 0, checksum sum 0
Retrieved from "http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=Mellanox:Ethernet_Switch_Configure_VLANs&oldid=5986"