Benchmarking: Powerbench

Install prerequisite packages

Install the following packages:

[Jon@TestNode powerbench]$ yum -y install compat-gcc-34-g77 lapack lapack-devel glibc-devel

Download Powerbench

The Powerbench files can be obtained from:
http://it-div-procurements.web.cern.ch/it-div-procurements/Download/powerbench.tar.gz.

NOTE: Doesnt work out of the box on Centos 7

# needed to force install the following on centos 7
http://mirror.centos.org/centos/6/os/x86_64/Packages/compat-gcc-34-g77-3.4.6-19.el6.x86_64.rpm
http://mirror.centos.org/centos/6/os/x86_64/Packages/compat-gcc-34-3.4.6-19.el6.x86_64.rpm
http://mirror.centos.org/centos/6/os/x86_64/Packages/compat-libf2c-34-3.4.6-19.el6.x86_64.rpm

rpm -ivh *rpm

Download and extract the Powerbench software on the test system:

[Jon@TestNode powerbench]$ wget http://it-div-procurements.web.cern.ch/it-div-procurements/Download/powerbench.tar.gz
[Jon@TestNode powerbench]$ tar zxvf powerbench.tar.gz

Take initial idle readings

• Let the system idle for 5~10 minutes to allow power and thermals to stabilise
• Measure the power consumption every 30 seconds for 5 minutes
  • Measure Real Power (measured in Watts or W)
  • Measure Apparent Power (measured in Volt-Amps or VA)
• Calculate Power Factor for each reading by dividing the Real Power by the Apparent Power. This will be a number between 0 and 1, hopefully above 0.8.
• Record an average for each of these figures

Start Powerbench

Start Powerbench running by executing the powerbench.sh script and wait 10 minutes before taking any readings:

[Jon@TestNode powerbench]$ sh powerbench.sh 
Detected Intel CPU.
32 cores detected.
Compiling benchmarks...
Running benchmarks...
Launching cpuburn
Launching lapack
Launching cpuburn
Launching lapack
.
.
.
Launching cpuburn
Launching lapack
Launching cpuburn
Launching lapack
Please wait 10 minutes for power consumption to stabilize...

Take loaded readings

Once the system has been running for 10 minutes, the script will prompt you to start taking readings:

.
.
.
Launching cpuburn
Launching lapack
Launching cpuburn
Launching lapack
Please wait 10 minutes for power consumption to stabilize...
Start reading the power consumption now

• Measure the power consumption every 30 seconds for 5 minutes
  • Measure Real Power (measured in Watts or W)
  • Measure Apparent Power (measured in Volt-Amps or VA)
• Calculate Power Factor for each reading by dividing the Real Power by the Apparent Power. This will be a number between 0 and 1, hopefully above 0.95 for a modern PSU running near its maximum rating.
• Record an average for each of these figures

Kill Powerbench processes once completed

• Press CONTROL + C to exit the script
• Kill remaining processes:

[Jon@TestNode powerbench]$ killall lapack
.
.
.
Lapack died
Lapack died
powerbench.sh: line 32:  4969 Terminated              ./cpuburn > /dev/null
powerbench.sh: line 32:  4953 Terminated              ./cpuburn > /dev/null
[Jon@TestNode powerbench]$

Problems

[root@cern1 powerbench]# g77 -llapack -o lapack 1000d_1894mb.f
/usr/lib/gcc/x86_64-redhat-linux/3.4.6/../../../crt1.o: could not read symbols: File in wrong format
collect2: ld returned 1 exit status

• Caused by glibc-devel not being installed. Install with yum:

yum -y install glibc-devel

Results

Server Model	# Nodes	# CPUs	CPU Type	Memory	HDDs	Add-ons	Idle (W)	Idle (PF)	Load (W)	Load (PF)	Notes
6027TR-D70RF	2	4		16 x 8GB	6 x MK2001TRKB	N/A	270.5	0.866	907.6	0.980
6027PR-HTR	4	8	E5-2650 V2	32 x 8GB	8 x WD4000F9YZ	N/A	374	0.9	1203	0.99	CERN IT-4035
6027PR-HTR	4	8	E5-2650 V2	32 x 8GB	8 x HUA723020ALA640	N/A	362	0.9	1165	0.99	CERN IT-4035