Difference between revisions of "Benchmarking: Coremark"

From Define Wiki
Jump to navigation Jump to search
Line 46: Line 46:
 
== Results ==
 
== Results ==
 
{| class="wikitable" style="text-align:center; width:100%; "
 
{| class="wikitable" style="text-align:center; width:100%; "
−
|+ Coremark V1.0 results
+
|+ Coremark V1.0 results with -O3 compile flags
 
|-
 
|-
 
! scope="col" | CPU !! scope="col" | Freq !! scope="col" | Cores !! scope="Cores" | Coremark !! scope="col" | Coremark/<br>MHz !! scope="col" | Coremark/<br>Core !! scope="col" | Coremark/<br>Core/MHz !! scope="col" | Parallel Execution !! scope="col" | Compile Flags
 
! scope="col" | CPU !! scope="col" | Freq !! scope="col" | Cores !! scope="Cores" | Coremark !! scope="col" | Coremark/<br>MHz !! scope="col" | Coremark/<br>Core !! scope="col" | Coremark/<br>Core/MHz !! scope="col" | Parallel Execution !! scope="col" | Compile Flags
 
|-
 
|-
 
| colspan="9"|''MIPS''
 
| colspan="9"|''MIPS''
−
|-
 
−
! scope="row" | Cavium Octeon II CN6645 || 2.50GHz || 10 || 25671 || 10.268 || 2567 || 1.0268 || 10 Threads ||
 
 
|-
 
|-
 
! scope="row" | Cavium Octeon II CN6645 || 2.50GHz || 10 || 31172 || 12.468 || 3117 || 1.2468 || 10 Threads || -O3 -funroll-all-loops --param max-inline-insns-auto=200
 
! scope="row" | Cavium Octeon II CN6645 || 2.50GHz || 10 || 31172 || 12.468 || 3117 || 1.2468 || 10 Threads || -O3 -funroll-all-loops --param max-inline-insns-auto=200
 
|-
 
|-
 
| colspan="9"|''ARM''
 
| colspan="9"|''ARM''
−
|-
 
−
! scope="row" | Calxeda Highbank (Cortex A9) || 1.40GHz || 4 || 11764|| 8.403 || 2941 || 2.1007 || 4 Threads ||
 
 
|-
 
|-
 
! scope="row" | Calxeda Highbank (Cortex A9) || 1.40GHz || 4 || 12074|| 8.624 || 3018 || 2.1557 || 4 Threads || -O3
 
! scope="row" | Calxeda Highbank (Cortex A9) || 1.40GHz || 4 || 12074|| 8.624 || 3018 || 2.1557 || 4 Threads || -O3
−
|-
 
−
! scope="row" | Calxeda Midway (Cortex A15) || 1.50GHz || 4 || 20284 || 13.523 || 5071 || 3.3807 || 4 Threads ||
 
 
|-
 
|-
 
! scope="row" | Calxeda Midway (Cortex A15) || 1.50GHz || 4 || 22013 || 14.675|| 5503 || 3.6687 || 4 Threads || -O3
 
! scope="row" | Calxeda Midway (Cortex A15) || 1.50GHz || 4 || 22013 || 14.675|| 5503 || 3.6687 || 4 Threads || -O3
−
|-
 
−
! scope="row" | APM XGene1 (Cortex A57) || 2.40GHz || 8 || 49304 || 20.543 || 6163 || 2.5679 || 8 Threads ||
 
 
|-
 
|-
 
! scope="row" | APM XGene1 (Cortex A57) || 2.40GHz || 8 || 54408|| 22.670 || 6801 || 2.8338 || 8 Threads || -O3
 
! scope="row" | APM XGene1 (Cortex A57) || 2.40GHz || 8 || 54408|| 22.670 || 6801 || 2.8338 || 8 Threads || -O3
 
|-
 
|-
 
| colspan="9"|''Intel''
 
| colspan="9"|''Intel''
−
|-
 
−
! scope="row" | Intel Atom C2550 || 2.4GHz || 4 || 26044 || 10.852 || 6511 || 2.7129 || 4 Threads ||
 
 
|-
 
|-
 
! scope="row" | Intel Atom C2550 || 2.4GHz || 4 || 29333 || 12.222|| 7333 || 3.0554 || 4 Threads || -O3
 
! scope="row" | Intel Atom C2550 || 2.4GHz || 4 || 29333 || 12.222|| 7333 || 3.0554 || 4 Threads || -O3
−
|-
 
−
! scope="row" | Intel Atom C2750 || 2.4GHz || 8 || 50873 || 21.197 || 6359 || 2.6496 || 8 Threads ||
 
 
|-
 
|-
 
! scope="row" | Intel Atom C2750 || 2.4GHz || 8 || 58506 || 24.378 || 7313 || 3.0471 || 8 Threads || -O3
 
! scope="row" | Intel Atom C2750 || 2.4GHz || 8 || 58506 || 24.378 || 7313 || 3.0471 || 8 Threads || -O3
−
|-
 
−
! scope="row" | Intel Xeon E5-2660 v1 (no HT)|| 2.2GHz || 8 || 91152 || 41.433 || 11394 || 5.1791 || 8 Threads ||
 
 
|-
 
|-
 
! scope="row" | Intel Xeon E5-2660 v1 (no HT) || 2.2GHz || 8 || 105540 || 27.973 || 13192 || 5.9966|| 8 Threads || -O3
 
! scope="row" | Intel Xeon E5-2660 v1 (no HT) || 2.2GHz || 8 || 105540 || 27.973 || 13192 || 5.9966|| 8 Threads || -O3
−
|-
 
−
! scope="row" | Intel Xeon E5-2640 v2 (no HT) || 2.0GHz || 8 || 96455 || 48.228 || 12056 || 6.0284 || 8 Threads ||
 
 
|-
 
|-
 
! scope="row" | Intel Xeon E5-2640 v2 (no HT) || 2.0GHz || 8 || 111095 || 55.548 || 13886 || 6.9434 || 8 Threads || -O3
 
! scope="row" | Intel Xeon E5-2640 v2 (no HT) || 2.0GHz || 8 || 111095 || 55.548 || 13886 || 6.9434 || 8 Threads || -O3
−
|-
 
−
! scope="row" | Intel Xeon E5-2650 v2 (no HT) || 2.6GHz || 8 || 102373 || 39.374 || 12796 || 4.9218 || 8 Threads ||
 
 
|-
 
|-
 
! scope="row" | Intel Xeon E5-2650 v2 (no HT) || 2.6GHz || 8 || 120782 || 46.455 || 15097 || 5.8068 || 8 Threads || -O3
 
! scope="row" | Intel Xeon E5-2650 v2 (no HT) || 2.6GHz || 8 || 120782 || 46.455 || 15097 || 5.8068 || 8 Threads || -O3
−
|-
 
−
! scope="row" | Intel Xeon E5-2660 v2 (w/HT) || 2.2GHz || 10 || ??? || ??? || ??? || ??? || 20 Threads ||
 
 
|-
 
|-
 
! scope="row" | Intel Xeon E5-2660 v2 (w/HT) || 2.2GHz || 10 || ??? || ??? || ??? || ??? || 20 Threads || -O3
 
! scope="row" | Intel Xeon E5-2660 v2 (w/HT) || 2.2GHz || 10 || ??? || ??? || ??? || ??? || 20 Threads || -O3
Line 98: Line 78:
 
| colspan="9"|''AMD''
 
| colspan="9"|''AMD''
 
|-
 
|-
−
! scope="row" | AMD Opteron 6380 || 2.5GHz || 16 || 128439|| 51.376 || 8027 || 3.2110 || 16 Threads ||  
+
! scope="row" | AMD Opteron 6380 || 2.5GHz || 16 || 149107 || 59.643 || 9319 || 3.7277 || 16 Threads || -O3
 
|-
 
|-
−
! scope="row" | AMD Opteron 6380 || 2.5GHz || 16 || 149107 || 59.643 || 9319 || 3.7277 || 16 Threads || -O3
+
|}
 +
 
 +
{| class="wikitable" style="text-align:center; width:100%; "
 +
|+ Coremark V1.0 results with -O2 compile flags
 +
|-
 +
! scope="col" | CPU !! scope="col" | Freq !! scope="col" | Cores !! scope="Cores" | Coremark !! scope="col" | Coremark/<br>MHz !! scope="col" | Coremark/<br>Core !! scope="col" | Coremark/<br>Core/MHz !! scope="col" | Parallel Execution !! scope="col" | Compile Flags
 +
|-
 +
| colspan="9"|''MIPS''
 +
|-
 +
! scope="row" | Cavium Octeon II CN6645 || 2.50GHz || 10 || 25671 || 10.268 || 2567 || 1.0268 || 10 Threads ||
 +
|-
 +
| colspan="9"|''ARM''
 +
|-
 +
! scope="row" | Calxeda Highbank (Cortex A9) || 1.40GHz || 4 || 11764|| 8.403 || 2941 || 2.1007 || 4 Threads ||
 +
|-
 +
! scope="row" | Calxeda Midway (Cortex A15) || 1.50GHz || 4 || 20284 || 13.523 || 5071 || 3.3807 || 4 Threads ||
 +
|-
 +
! scope="row" | APM XGene1 (Cortex A57) || 2.40GHz || 8 || 49304 || 20.543 || 6163 || 2.5679 || 8 Threads ||
 +
|-
 +
| colspan="9"|''Intel''
 +
|-
 +
! scope="row" | Intel Atom C2550 || 2.4GHz || 4 || 26044 || 10.852 || 6511 || 2.7129 || 4 Threads ||
 +
|-
 +
! scope="row" | Intel Atom C2750 || 2.4GHz || 8 || 50873 || 21.197 || 6359 || 2.6496 || 8 Threads ||
 +
|-
 +
! scope="row" | Intel Xeon E5-2660 v1 (no HT)|| 2.2GHz || 8 || 91152 || 41.433 || 11394 || 5.1791 || 8 Threads ||
 +
|-
 +
! scope="row" | Intel Xeon E5-2640 v2 (no HT) || 2.0GHz || 8 || 96455 || 48.228 || 12056 || 6.0284 || 8 Threads ||
 +
|-
 +
! scope="row" | Intel Xeon E5-2650 v2 (no HT) || 2.6GHz || 8 || 102373 || 39.374 || 12796 || 4.9218 || 8 Threads ||
 +
|-
 +
! scope="row" | Intel Xeon E5-2660 v2 (w/HT) || 2.2GHz || 10 || 237177 || ??? || ??? || ??? || 20 Threads ||
 +
|-
 +
| colspan="9"|''AMD''
 +
|-
 +
! scope="row" | AMD Opteron 6380 || 2.5GHz || 16 || 128439 || 51.376 || 8027 || 3.2110 || 16 Threads ||  
 
|-
 
|-
 
|}
 
|}

Revision as of 17:19, 2 April 2014

Decompress

root@jph1:~# tar zxvf coremark_v1.0
cd coremark_v1.0

Adjust compilation flags

Seems to be in ./linux64/core_portme.mak

  • Change PORT_CFLAGS value to -O3
  • Add extra flags to the end of the CFLAGS statement

For example (added -funroll-all-loops --param max-inline-insns-auto=200): 

CC = gcc
# Flag: CFLAGS
#       Use this flag to define compiler options. Note, you can add compiler options from the command line using XCFLAGS="other flags"
PORT_CFLAGS = -O3
FLAGS_STR = "$(PORT_CFLAGS) $(XCFLAGS) $(XLFLAGS) $(LFLAGS_END)"
CFLAGS = $(PORT_CFLAGS) -I$(PORT_DIR) -I. -DFLAGS_STR=\"$(FLAGS_STR)\" -funroll-all-loops --param max-inline-insns-auto=200

Run benchmark (single thread)

Run benchmark with make: 

root@jph1:~/coremark_v1.0# pwd
/root/coremark_v1.0
root@jph1:~/coremark_v1.0# make

Faster systems

If you have a fast system (faster than a RaspberryPi), increase the number of iterations to increase the test run to give a more meaningful result: 

root@jph1:~/coremark_v1.0# make ITERATIONS=10000

32-bit ARM systems

Coremark seems to have an issue when not running in a linux64 environment (e.g. 32-bit ARM). Add a flag to the make command: 

root@jph1:~/coremark_v1.0# make PORT_DIR=simple

Run benchmark (multi thread)

root@jph1:~/coremark_v1.0# make XCFLAGS="-DMULTITHREAD=8 -DUSE_PTHREAD"

Results

Coremark V1.0 results with -O3 compile flags
CPU Freq Cores Coremark Coremark/
MHz		 Coremark/
Core		 Coremark/
Core/MHz		 Parallel Execution Compile Flags
MIPS
Cavium Octeon II CN6645 2.50GHz 10 31172 12.468 3117 1.2468 10 Threads -O3 -funroll-all-loops --param max-inline-insns-auto=200
ARM
Calxeda Highbank (Cortex A9) 1.40GHz 4 12074 8.624 3018 2.1557 4 Threads -O3
Calxeda Midway (Cortex A15) 1.50GHz 4 22013 14.675 5503 3.6687 4 Threads -O3
APM XGene1 (Cortex A57) 2.40GHz 8 54408 22.670 6801 2.8338 8 Threads -O3
Intel
Intel Atom C2550 2.4GHz 4 29333 12.222 7333 3.0554 4 Threads -O3
Intel Atom C2750 2.4GHz 8 58506 24.378 7313 3.0471 8 Threads -O3
Intel Xeon E5-2660 v1 (no HT) 2.2GHz 8 105540 27.973 13192 5.9966 8 Threads -O3
Intel Xeon E5-2640 v2 (no HT) 2.0GHz 8 111095 55.548 13886 6.9434 8 Threads -O3
Intel Xeon E5-2650 v2 (no HT) 2.6GHz 8 120782 46.455 15097 5.8068 8 Threads -O3
Intel Xeon E5-2660 v2 (w/HT) 2.2GHz 10 ??? ??? ??? ??? 20 Threads -O3
AMD
AMD Opteron 6380 2.5GHz 16 149107 59.643 9319 3.7277 16 Threads -O3
Coremark V1.0 results with -O2 compile flags
CPU Freq Cores Coremark Coremark/
MHz		 Coremark/
Core		 Coremark/
Core/MHz		 Parallel Execution Compile Flags
MIPS
Cavium Octeon II CN6645 2.50GHz 10 25671 10.268 2567 1.0268 10 Threads
ARM
Calxeda Highbank (Cortex A9) 1.40GHz 4 11764 8.403 2941 2.1007 4 Threads
Calxeda Midway (Cortex A15) 1.50GHz 4 20284 13.523 5071 3.3807 4 Threads
APM XGene1 (Cortex A57) 2.40GHz 8 49304 20.543 6163 2.5679 8 Threads
Intel
Intel Atom C2550 2.4GHz 4 26044 10.852 6511 2.7129 4 Threads
Intel Atom C2750 2.4GHz 8 50873 21.197 6359 2.6496 8 Threads
Intel Xeon E5-2660 v1 (no HT) 2.2GHz 8 91152 41.433 11394 5.1791 8 Threads
Intel Xeon E5-2640 v2 (no HT) 2.0GHz 8 96455 48.228 12056 6.0284 8 Threads
Intel Xeon E5-2650 v2 (no HT) 2.6GHz 8 102373 39.374 12796 4.9218 8 Threads
Intel Xeon E5-2660 v2 (w/HT) 2.2GHz 10 237177 ??? ??? ??? 20 Threads
AMD
AMD Opteron 6380 2.5GHz 16 128439 51.376 8027 3.2110 16 Threads
Retrieved from "http://wiki.define-technology.com/mediawiki-1.35.0/index.php?title=Benchmarking:_Coremark&oldid=4268"