Initial Setup of Cumulus on a Supermicro Switch

TBC setup the ONIE switch (note Supermicro switch defaulted to 192.168.10.3 which seems to contradict their docs!)

Setup the management IP

cumulus@switch:~$ net add interface eth0 ip address 192.0.2.42/24
cumulus@switch:~$ net add interface eth0 ip gateway 192.0.2.1
cumulus@switch:~$ net pending
cumulus@switch:~$ net commit

Set hostname and timezone

# setup hostname
cumulus@switch:~$ net add hostname <hostname>
cumulus@switch:~$ net pending
cumulus@switch:~$ net commit

# setup the TZ
sudo dpkg-reconfigure tzdata

Add a license key

# cut/paste into:
cumulus@switch:~$ sudo cl-license -i
<paste license key>
^+d

# verify the key afterwards
cumulus@cumulus:~$ cl-license 
davidi@mellanox.com|4CeKMCACDhKo67WOPmYetFEFZbnWAg4V4zqD1HFCegs+aBDrhQ

# restart the services
cumulus@switch:~$ sudo systemctl restart switchd.service

Enable Ports

By default, all data plane ports (every Ethernet port except the management interface, eth0) are disabled.

# ports down
cumulus@cumulus:~$  net show interface all
State  Name   Spd  MTU    Mode           LLDP                               Summary
-----  -----  ---  -----  -------------  ---------------------------------  --------------------------
UP     lo     N/A  65536  Loopback                                          IP: 127.0.0.1/8
       lo                                                                   IP: ::1/128
UP     eth0   1G   1500   Mgmt           ICC-NB-PROD03 (cc:d5:39:4d:e2:2c)  IP: 172.28.28.242/22(DHCP)
ADMDN  swp1   N/A  1500   NotConfigured
ADMDN  swp2   N/A  1500   NotConfigured
ADMDN  swp3   N/A  1500   NotConfigured
...

Lets set them up - all ports added below.

# add all ports
cumulus@switch:~$ net add interface swp1-52
cumulus@switch:~$ net pending
cumulus@switch:~$ net commit
<pre>


Add the ports to the bridge
<pre>
net add bridge bridge ports swp1-52

Check after the command above

cumulus@cumulus:~$ net show interface all 
State  Name   Spd  MTU    Mode      LLDP                               Summary
-----  -----  ---  -----  --------  ---------------------------------  --------------------------
UP     lo     N/A  65536  Loopback                                     IP: 127.0.0.1/8
       lo                                                              IP: ::1/128
UP     eth0   1G   1500   Mgmt      ICC-NB-PROD03 (cc:d5:39:4d:e2:2c)  IP: 172.28.28.242/22(DHCP)
DN     swp1   0M   1500   Default
DN     swp2   0M   1500   Default
DN     swp3   0M   1500   Default

Sample Setup on EC

net del all
net add routing route 0.0.0.0/0 192.168.101.1
net add bridge bridge ports swp1-16
net add bridge bridge vids 101-104
net add bridge bridge vlan-aware
net add interface swp1-2,7,10,13 bridge access 101
net add interface swp3-4,8,11,14 bridge access 102
net add interface swp5-6,9,12,15 bridge access 103
net add interface swp1-15 stp bpduguard
net add interface swp1-15 stp portadminedge
net add interface swp16
net add vlan 101 ip address 192.168.101.254/24
net add vlan 101 vlan-id 101
net add vlan 101 vlan-raw-device bridge
net add vlan 102 ip address 192.168.102.254/24
net add vlan 102 vlan-id 102
net add vlan 102 vlan-raw-device bridge
net add vlan 103 ip address 192.168.103.254/24
net add vlan 103 vlan-id 103
net add vlan 103 vlan-raw-device bridge
net add vlan 104 ip address 192.168.104.254/24
net add vlan 104 vlan-id 104
net add vlan 104 vlan-raw-device bridge
net commit