Benchmarking: STFC Storage (GridPP) with Iozone - Revision history

David: /* Verify the Results */

2014-10-20T08:49:51Z

Verify the Results

David at 08:48, 20 October 2014

2014-10-20T08:48:52Z

David at 08:48, 20 October 2014

2014-10-20T08:48:38Z

David at 18:59, 19 October 2014

2014-10-19T18:59:18Z

David: /* Tuning on the System */

2014-10-19T18:54:01Z

Tuning on the System

David: Created page with "* Notes below are based on the 2014 test suits (these tests have been fairly consistent over the years) == Setup the RAID Array == * 22 Drives RAID6 array with WD SE WD4000F9..."

2014-10-19T18:21:57Z

Created page with "* Notes below are based on the 2014 test suits (these tests have been fairly consistent over the years) == Setup the RAID Array == * 22 Drives RAID6 array with WD SE WD4000F9..."

New page

* Notes below are based on the 2014 test suits (these tests have been fairly consistent over the years)

== Setup the RAID Array ==
* 22 Drives RAID6 array with WD SE WD4000F9YS Drives
* E5-2620v2 CPUs
* 64GB RAM
* LSI 9261 Controller with the following settings:
** RAID Level: 6
** Stripe Size: 256k
** Disk Cache Policy: Enabled
** Read Policy: Always Read Ahead
** Write Policy: Always Write Back
** IO Policy: Direct IO

== Partition and Create FS ==
<syntaxhighlight>
[root@localhost scripts]# cat intelligent-partitioner-dp.sh
#!/bin/bash

# Parted stuff
parted -a optimal /dev/sda unit % mkpart primary 0% 33% ; sleep 1
parted -a optimal /dev/sda unit % mkpart primary 33% 66% ; sleep 1
parted -a optimal /dev/sda unit % mkpart primary 66% 100% ; sleep 1

# sleep for 5
sleep 5

partprobe /dev/sda

sleep 5
# Create the XFS Part
mkfs.xfs -f -l version=2 -i size=1024 -n size=65536 -d su=256k,sw=22 -L castor1 /dev/sda1
sleep 2

mkfs.xfs -f -l version=2 -i size=1024 -n size=65536 -d su=256k,sw=22 -L castor2 /dev/sda2
sleep 2

mkfs.xfs -f -l version=2 -i size=1024 -n size=65536 -d su=256k,sw=22 -L castor3 /dev/sda3
sleep 2
</syntaxhighlight>

Mount the Filesystems - add the follwing to fstab
<syntaxhighlight>
# fstab
/dev/disk/by-label/castor1 /exportstage/castor1 xfs logbufs=8,logbsize=256k,noatime,swalloc,inode64 0 2
/dev/disk/by-label/castor2 /exportstage/castor2 xfs logbufs=8,logbsize=256k,noatime,swalloc,inode64 0 2
/dev/disk/by-label/castor3 /exportstage/castor3 xfs logbufs=8,logbsize=256k,noatime,swalloc,inode64 0 2
</syntaxhighlight>

== Tuning on the System ==
* Set the following
** Readahead
** Request Queue
** Scheduler
<syntaxhighlight>
[root@localhost dp]# cat check_settings.sh
#!/bin/bash

echo -en "[readahead]: "
blockdev --getra /dev/sda
echo -en "[nr_requests]: "
cat /sys/block/sda/queue/nr_requests
echo "[scheduler]: "
cat /sys/block/sda/queue/scheduler
[root@localhost dp]# ./check_settings.sh
[readahead]: 16384
[nr_requests]: 512
[scheduler]:
noop anticipatory [deadline] cfq
</syntaxhighlight>

@@ Line 8: / Line 8: @@
 * http://www.lsi.com/downloads/Public/Direct%20Assets/LSI/Benchmark_Tips.pdf
 * http://www.lsi.com/downloads/Public/Direct%20Assets/LSI/6Gbs_LSI_LRb.pdf
 System Setup:

@@ Line 128: / Line 128: @@
 * Run the script below with an argument of '1' or '2' to check the outputs from the tests above
 <syntaxhighlight>
 </syntaxhighlight>

@@ Line 2: / Line 2: @@
 * Using Centos 6.5
 * Installed Iozone and setup in the $PATH
 == Setup the RAID Array ==
 * 22 Drives RAID6 array with WD SE WD4000F9YS Drives
 * E5-2620v2 CPUs

@@ Line 1: / Line 1: @@
 * Notes below are based on the 2014 test suits (these tests have been fairly consistent over the years)
 == Setup the RAID Array ==
@@ Line 6: / Line 8: @@
 * 64GB RAM
 * LSI 9261 Controller with the following settings:
-** RAID Level: 6
+** RAID Level: <b>6</b>
-** Stripe Size: 256k
+** Stripe Size: <b>256k</b>
-** Disk Cache Policy: Enabled
+** Disk Cache Policy: <b>Enabled</b>
-** Read Policy: Always Read Ahead
+** Read Policy: <b>Always Read Ahead</b>
-** Write Policy: Always Write Back
+** Write Policy: <b>Always Write Back </b>
-** IO Policy: Direct IO
+** IO Policy: <b>Direct IO</b>
 == Partition and Create FS ==
@@ Line 72: / Line 74: @@
 [scheduler]:
 noop anticipatory [deadline] cfq
 </syntaxhighlight>

@@ Line 54: / Line 54: @@
 ** Scheduler
 <syntaxhighlight>
 [root@localhost dp]# cat check_settings.sh
 #!/bin/bash