IEEL 2.2 - MDTEST for Unit.tv

From Define Wiki
Revision as of 14:36, 22 July 2015 by Adam (talk | contribs) (Created page with "Download MDTEST from Sourceforge: [http://sourceforge.net/projects/mdtest/] Make a directory called mdtest - copy and Untar MDTEST into that directory. <syntaxhighlight> mkdir /root/md...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Download MDTEST from Sourceforge: [1]

Make a directory called mdtest - copy and Untar MDTEST into that directory. <syntaxhighlight> mkdir /root/mdtest tar xvf mdtest-1.9.3.tgz <bash/>

Edit Makefile to point CC.Linux to current MPI and then make - My example I modified to: <syntaxhighlight> CC.Linux = /usr/mpi/gcc/openmpi-1.8.4/bin/mpicc

make <bash/>

Initial Testing & Observations:

Basic run: <syntaxhighlight> ./mdtest -n 1024 -d /mnt/lustrefs-ib/mdtest <bash/>

-n Total amount of files to run per process (Standard run is 1 process)

Optimised Run: <syntaxhighlight> /usr/mpi/gcc/openmpi-1.8.4/bin/mpirun --hostfile hostfile -np 16 -npernode 8 --allow-run-as-root ./mdtest -i 20 -b 2 -I 80 -z 5 -d /mnt/lustrefs-ib/mdtest/1 <bash/>

-i Total Number of Test Itterations -b Branching Factor of hierarchical directory structure -I Number of Items per directory tree -z Depth of hierarchical directory structure -d Test directory

Output

<syntaxhighlight> [root@mds1 mdtest-1.9.1]# /usr/mpi/gcc/openmpi-1.8.4/bin/mpirun --hostfile hostfile -np 16 -npernode 8 --allow-run-as-root ./mdtest -i 20 -b 2 -I 80 -z 5 -d /mnt/lustrefs-ib/mdtest/1

-- started at 07/22/2015 09:34:24 --

mdtest-1.9.1 was launched with 16 total task(s) on 2 node(s) Command line used: ./mdtest -i 20 -b 2 -I 80 -z 5 -d /mnt/lustrefs-ib/mdtest/1 Path: /mnt/lustrefs-ib/mdtest FS: 290.9 TiB Used FS: 0.4% Inodes: 291.1 Mi Used Inodes: 0.0%

16 tasks, 80640 files/directories

SUMMARY: (of 20 iterations)

  Operation                      Max            Min           Mean        Std Dev
  ---------                      ---            ---           ----        -------
  Directory creation:       8763.188       8232.435       8376.081        117.579
  Directory stat    :      51421.884      44970.310      47884.412       1761.017
  Directory removal :       8541.242       7992.884       8339.238        135.393
  File creation     :       7226.927       6714.372       7041.462        152.999
  File stat         :      28105.169      26091.429      27392.123        537.488
  File read         :      11582.120      11297.195      11443.001         77.403
  File removal      :       8581.734       8033.429       8385.055        125.556
  Tree creation     :       7627.989       5464.496       6619.557        367.386
  Tree removal      :       3626.299       2855.457       3308.709        131.297

-- finished at 07/22/2015 09:51:46 -- <bash/>