Lustre diagnose

From Define Wiki
Jump to navigation Jump to search

Add OST to IML

When we use IML to add OSTs on filesystem, there are chances that IML can only add the entry on the dashboard but can not really mount them. What we can do is to use pcs to add it manually:

 310 pcs resource create lustrefs-OST000c_2c0efc ocf:chroma:Target target=ebf08566-990f-47a0-8e2e-0348fc5e8362

then pcs will create his ost as a resource and mount it and IML will be able to pick it up.

Nodes Offline in IML

  • even when the host is online and can ssh to
  • Restart the following services
    • service corosync restart
    • service pacemaker restart
    • service chroma-agent restart

Then check the pcs status and enable stopped devices if needed

 lustrefs-OST000c_2c0efc	(ocf::chroma:Target):	Started oss7.cm.cluster 
 lustrefs-OST000e_7929c3	(ocf::chroma:Target):	Stopped 
 lustrefs-OST000d_8632be	(ocf::chroma:Target):	Started oss7.cm.cluster 
 lustrefs-OST000f_2feef4	(ocf::chroma:Target):	Started oss8.cm.cluster 

[root@oss8 ~]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_oss08-lv_root
                       50G  2.4G   45G   6% /
tmpfs                  16G   30M   16G   1% /dev/shm
/dev/sdf1             477M  120M  332M  27% /boot
/dev/mapper/vg_oss08-lv_home
                      395G   71M  375G   1% /home
/dev/sdd               55T  1.2M   52T   1% /mnt/lustrefs-OST000f
[root@oss8 ~]# pcs resource enable lustrefs-OST000e_7929c3
[root@oss8 ~]# pcs status
Cluster name: 
Last updated: Sun Oct  4 13:24:27 2015
Last change: Sun Oct  4 13:24:20 2015
Stack: classic openais (with plugin)
Current DC: oss7.cm.cluster - partition with quorum
Version: 1.1.11-97629de
2 Nodes configured, 2 expected votes
4 Resources configured


Online: [ oss7.cm.cluster oss8.cm.cluster ]

Full list of resources:

 lustrefs-OST000c_2c0efc	(ocf::chroma:Target):	Started oss7.cm.cluster 
 lustrefs-OST000e_7929c3	(ocf::chroma:Target):	Started oss8.cm.cluster 
 lustrefs-OST000d_8632be	(ocf::chroma:Target):	Started oss7.cm.cluster 
 lustrefs-OST000f_2feef4	(ocf::chroma:Target):	Started oss8.cm.cluster