IEEL 2.2 - MDTEST for Unit.tv

From Define Wiki
Revision as of 14:38, 22 July 2015 by Adam (talk | contribs)
Jump to navigation Jump to search

Download MDTEST from Sourceforge: [1]

Make a directory called mdtest - copy and Untar MDTEST into that directory.

mkdir /root/mdtest
tar xvf mdtest-1.9.3.tgz

Edit Makefile to point CC.Linux to current MPI and then make - My example I modified to:

CC.Linux = /usr/mpi/gcc/openmpi-1.8.4/bin/mpicc

make


Initial Testing & Observations:

Basic run:'

./mdtest -n 1024 -d /mnt/lustrefs-ib/mdtest

-n Total amount of files to run per process (Standard run is 1 process)

Optimised Run:

/usr/mpi/gcc/openmpi-1.8.4/bin/mpirun --hostfile hostfile -np 16 -npernode 8 --allow-run-as-root ./mdtest -i 20 -b 2 -I 80 -z 5 -d /mnt/lustrefs-ib/mdtest/1

-i Total Number of Test Itterations -b Branching Factor of hierarchical directory structure -I Number of Items per directory tree -z Depth of hierarchical directory structure -d Test directory

Output

[root@mds1 mdtest-1.9.1]# /usr/mpi/gcc/openmpi-1.8.4/bin/mpirun --hostfile hostfile -np 16 -npernode 8 --allow-run-as-root ./mdtest -i 20 -b 2 -I 80 -z 5 -d /mnt/lustrefs-ib/mdtest/1

-- started at 07/22/2015 09:34:24 --

mdtest-1.9.1 was launched with 16 total task(s) on 2 node(s)
Command line used: ./mdtest -i 20 -b 2 -I 80 -z 5 -d /mnt/lustrefs-ib/mdtest/1
Path: /mnt/lustrefs-ib/mdtest
FS: 290.9 TiB   Used FS: 0.4%   Inodes: 291.1 Mi   Used Inodes: 0.0%

16 tasks, 80640 files/directories

SUMMARY: (of 20 iterations)
   Operation                      Max            Min           Mean        Std Dev
   ---------                      ---            ---           ----        -------
   Directory creation:       8763.188       8232.435       8376.081        117.579
   Directory stat    :      51421.884      44970.310      47884.412       1761.017
   Directory removal :       8541.242       7992.884       8339.238        135.393
   File creation     :       7226.927       6714.372       7041.462        152.999
   File stat         :      28105.169      26091.429      27392.123        537.488
   File read         :      11582.120      11297.195      11443.001         77.403
   File removal      :       8581.734       8033.429       8385.055        125.556
   Tree creation     :       7627.989       5464.496       6619.557        367.386
   Tree removal      :       3626.299       2855.457       3308.709        131.297

-- finished at 07/22/2015 09:51:46 --