TerraNova: Update EnergyCard & Baseboard FRU

Overview

There are 2 types of FRUs (EEPROMs) we are going to update:

• Node FRU
  • X04 has 1 node FRU between all 4 nodes. One image for that one FRU.
  • Dual node uplink has a node FRU for each node. Each node FRU has a different image
• Slot FRU
  • One FRU per SystemBoard slot. Can only be programmed when a card is plugged into it – can use any node on that card but I have only tested with the first node on each card.
  • NOTE – there is a different image for EVERY slot!

Prerequisites

Hardware

• At least one TerraNova uplink card is required
• At least three X04 EnergyCards are required

Firmware

• All SOCs need to be running firmware package 2.2.10 or higher

Update Process

Update FW

• Refer to the firmware update guidelines on this wiki but the basic command is:

Jon@ubuntu1204-cobbler:~$ cxmanage -a fwupdate package ECX-1000_update-production-v2.2.10.tar.gz nova0-ipmi

• Power cycle the system and repeat above command to ensure both primary and backup FW images have been programmed.

Update X04 Card FRU

• Identify SOC0 for every X04 EnergyCard.

Jon@ubuntu1204-cobbler:~$ cxmanage ipinfo nova0-ipmi
Getting IP addresses...
1 successes  |  0 errors  |  0 nodes left  |  .

IP info from nova0-ipmi
Node 0: 172.28.129.0
Node 1: 172.28.129.1
Node 4: 172.28.129.4    <-- Slot 1, SOC0
Node 5: 172.28.129.5
Node 6: 172.28.129.6
Node 7: 172.28.129.7
Node 12: 172.28.129.12  <-- Slot 3, SOC0
Node 13: 172.28.129.13
Node 14: 172.28.129.14
Node 15: 172.28.129.15
Node 16: 172.28.129.16  <--Slot 4, SOC0
Node 17: 172.28.129.17
Node 18: 172.28.129.18
Node 19: 172.28.129.19
Node 20: 172.28.129.20  <-- Slot 5, SOC0
Node 21: 172.28.129.21
Node 22: 172.28.129.22
Node 23: 172.28.129.23
Node 24: 172.28.129.24  <-- Slot 6, SOC0
Node 25: 172.28.129.25
Node 26: 172.28.129.26
Node 27: 172.28.129.27

• Update FRU on SOC0 of first X04 EnergyCard (Node 4 in this example)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H nova4-ipmi fru write 81 x04.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63

• Repeat for all remaining X04 EnergyCards

Update Dual Uplink Card FRU

• Update FRU on SOC0 of the dual uplink EnergyCard (Node 0 in this example)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H nova0-ipmi fru write 81 dual_uplink_node_0.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63

• The update FRU on SOC1 of the dual uplink EnergyCard (Node 1 in this example)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H nova1-ipmi fru write 81 dual_uplink_node_1.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63

Update Slot FRUs

• Update Slot0 (First Uplink slot)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H nova0-ipmi fru write 82 tn_web.slot0.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63

• Update Slot1 (First X04 EnergyCard slot)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H nova4-ipmi fru write 82 tn_web.slot1.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63

• Update Slot3 (Second X04 EnergyCard slot)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H nova12-ipmi fru write 82 tn_web.slot3.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63

• Update Slot4 (Third X04 EnergyCard slot)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H nova16-ipmi fru write 82 tn_web.slot4.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63

• Update Slot5 (Fourth X04 EnergyCard slot)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H nova20-ipmi fru write 82 tn_web.slot5.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63

• Update Slot6 (Fifth X04 EnergyCard slot)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H nova24-ipmi fru write 82 tn_web.slot6.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63

• Power system off and move X04 card from Slot6 (fifth X04 EnergyCard) to Slot2 (second uplink slot)
• Power system back on
• Identify the IP address of SOC0 in Slot 2 (aka Node8):

Jon@ubuntu1204-cobbler:~/tn_fru$ cxmanage ipinfo nova0-ipmi
Getting IP addresses...
1 successes  |  0 errors  |  0 nodes left  |  .

IP info from nova0-ipmi
Node 0: 172.28.129.0
Node 1: 172.28.129.1
Node 4: 172.28.129.4
Node 5: 172.28.129.5
Node 6: 172.28.129.6
Node 7: 172.28.129.7
Node 8: 172.28.129.24    <-- Slot 2, SOC0
Node 9: 172.28.129.25
Node 10: 172.28.129.26
Node 11: 172.28.129.27
Node 12: 172.28.129.12
Node 13: 172.28.129.13
Node 14: 172.28.129.14
Node 15: 172.28.129.15
Node 16: 172.28.129.16
Node 17: 172.28.129.17
Node 19: 172.28.129.19
Node 20: 172.28.129.20
Node 21: 172.28.129.21
Node 22: 172.28.129.22
Node 23: 172.28.129.23

• Update Slot2 (Second Uplink slot)

Jon@ubuntu1204-cobbler:~/tn_fru$ ipmitool -U admin -P admin -H 172.28.129.24 fru write 82 tn_web.slot2.img
Fru Size			 : 8192 bytes
Size to Write	 : 8192 bytes
 Unknown FRU header version 0x63