Check disk failure and send alert - Revision history

Chenhui at 15:04, 2 July 2015

2015-07-02T15:04:46Z

2015-07-02T10:47:43Z

2015-07-02T10:33:40Z

← Older revision		Revision as of 15:04, 2 July 2015
Line 76:		Line 76:
	</syntaxhighlight>		</syntaxhighlight>
	You can then add a fail action if the healthcheck fails like getting an email alert or powering the node off. You can find more information about metrics and monitoring in Bright in chapter 9 of Bright 7.0 admin manual.		You can then add a fail action if the healthcheck fails like getting an email alert or powering the node off. You can find more information about metrics and monitoring in Bright in chapter 9 of Bright 7.0 admin manual.
		+
		+	We can use this scirpt for checking the RAID:
		+	<syntaxhighlight>
		+	#!/bin/sh
		+
		+	allVD=`storcli64 /call/vall show \|grep 'RAID[0-9]'\|wc -l`
		+	optVD=`storcli64 /call/vall show \|grep '\ Optl\ '\|wc -l`
		+	logPath="/tmp/raidCheck.log";
		+	hostname=`hostname`
		+
		+	if [ $optVD -eq $allVD ]; then
		+	echo PASS;
		+	else
		+	echo FAIL;
		+	storcli64 /call/eall/sall show > $logPath
		+	mail -a $logPath -s "RAID ERROR! at $hostname" pol.llovet@gmail.com,HPC@boston.co.uk < /dev/null;
		+	fi
		+
		+	</syntaxhighlight>

@@ Line 25: / Line 25: @@
 </syntaxhighlight>
 when disk failure occurs, the output is:
@@ Line 74: / Line 55: @@
 /0   RAID6 Optl  RW     No      RWBD  -   ON  1.063 TB
 </syntaxhighlight>

@@ Line 1: / Line 1: @@
 when no disks failed, the output of storcli is:
-<bash
+<syntaxhighlight>
 [root@disk-test-node1 ~]# storcli64 /c0/vall show
 Controller = 0
@@ Line 24: / Line 24: @@
 </syntaxhighlight>
 when disk failure occurs, the output is: