Difference between revisions of "FhGFS Benchmarking"

From Define Wiki
Jump to navigation Jump to search
Line 1: Line 1:
 
== Multi Stream Throughput ==
 
== Multi Stream Throughput ==
Tests with 5 clients reading and writing 1GB each
+
'''5 clients, filesize of ~1GB per storage server'''
 
=== Two Storage Servers ===
 
=== Two Storage Servers ===
 
==== Tuning ====
 
==== Tuning ====
Line 16: Line 16:
 
==== Test command ====
 
==== Test command ====
 
<syntaxhighlight>
 
<syntaxhighlight>
root@cloud24:~/fhgfs-benchmark# mpirun -hostfile hostfile -np 5 /root/ior/IOR/src/C/IOR -wr -C -i5 -t512k -b 1g -F -o /mnt/fhgfs/test.ior
+
root@cloud24:~/fhgfs-benchmark# mpirun -hostfile hostfile -np 5 /root/ior/IOR/src/C/IOR -wr -C -i5 -t512k -b 410m -F -o /mnt/fhgfs/test.ior  
 
</syntaxhighlight>
 
</syntaxhighlight>
 
==== Result ====
 
==== Result ====
Line 29: Line 29:
 
         repetitions        = 5
 
         repetitions        = 5
 
         xfersize          = 524288 bytes
 
         xfersize          = 524288 bytes
         blocksize          = 1 GiB
+
         blocksize          = 410 MiB
         aggregate filesize = 5 GiB
+
         aggregate filesize = 2.00 GiB
 +
 
 +
Operation  Max (MiB)  Min (MiB)  Mean (MiB)  Std Dev  Max (OPs)  Min (OPs)  Mean (OPs)  Std Dev  Mean (s)
 +
---------  ---------  ---------  ----------  -------  ---------  ---------  ----------  -------  --------
 +
write        137.05    127.16      131.73      3.33    274.10    254.32      263.46      6.67  15.57218  EXCEL
 +
read          334.68    305.41      316.45    10.08    669.35    610.82      632.91    20.16  6.48446  EXCEL
 +
 
 +
Max Write: 137.05 MiB/sec (143.71 MB/sec)
 +
Max Read:  334.68 MiB/sec (350.93 MB/sec)
 
</syntaxhighlight>
 
</syntaxhighlight>
  

Revision as of 06:44, 7 February 2014

Multi Stream Throughput

5 clients, filesize of ~1GB per storage server

Two Storage Servers

Tuning

root@cloud28:~# fhgfs-ctl --getentryinfo /mnt/fhgfs
Path:
Mount: /mnt/fhgfs
EntryID: root
Metadata node: cloud32 [ID: 13708]
Stripe pattern details:
+ Type: RAID0
+ Chunksize: 512K
+ Number of storage targets: desired: 2

Test command

root@cloud24:~/fhgfs-benchmark# mpirun -hostfile hostfile -np 5 /root/ior/IOR/src/C/IOR -wr -C -i5 -t512k -b 410m -F -o /mnt/fhgfs/test.ior

Result

Summary:
        api                = POSIX
        test filename      = /mnt/fhgfs/test.ior
        access             = file-per-process
        ordering in a file = sequential offsets
        ordering inter file=constant task offsets = 1
        clients            = 5 (1 per node)
        repetitions        = 5
        xfersize           = 524288 bytes
        blocksize          = 410 MiB
        aggregate filesize = 2.00 GiB

Operation  Max (MiB)  Min (MiB)  Mean (MiB)   Std Dev  Max (OPs)  Min (OPs)  Mean (OPs)   Std Dev  Mean (s)
---------  ---------  ---------  ----------   -------  ---------  ---------  ----------   -------  --------
write         137.05     127.16      131.73      3.33     274.10     254.32      263.46      6.67  15.57218   EXCEL
read          334.68     305.41      316.45     10.08     669.35     610.82      632.91     20.16   6.48446   EXCEL

Max Write: 137.05 MiB/sec (143.71 MB/sec)
Max Read:  334.68 MiB/sec (350.93 MB/sec)

Four Storage Servers

Six Storage Servers

Eight Storage Servers