FhGFS Benchmarking

Multi Stream Throughput

5 clients, filesize of ~1GB per storage server

Two Storage Servers

Tuning

Striping across two servers

root@cloud24:~/fhgfs-benchmark# fhgfs-ctl --setpattern --numtargets=2 --chunksize=512k /mnt/fhgfs
Mount: '/mnt/fhgfs'; Path: ''
Chunksize: 524288
Number of storage targets: 2

root@cloud28:~# fhgfs-ctl --getentryinfo /mnt/fhgfs
Path:
Mount: /mnt/fhgfs
EntryID: root
Metadata node: cloud32 [ID: 13708]
Stripe pattern details:
+ Type: RAID0
+ Chunksize: 512K
+ Number of storage targets: desired: 2

Test

root@cloud24:~/fhgfs-benchmark# mpirun -hostfile hostfile -np 5 /root/ior/IOR/src/C/IOR -wr -C -i5 -t512k -b 410m -F -o /mnt/fhgfs/test.ior

Result

Summary:
        api                = POSIX
        test filename      = /mnt/fhgfs/test.ior
        access             = file-per-process
        ordering in a file = sequential offsets
        ordering inter file=constant task offsets = 1
        clients            = 5 (1 per node)
        repetitions        = 5
        xfersize           = 524288 bytes
        blocksize          = 410 MiB
        aggregate filesize = 2.00 GiB

Operation  Max (MiB)  Min (MiB)  Mean (MiB)   Std Dev  Max (OPs)  Min (OPs)  Mean (OPs)   Std Dev  Mean (s)
---------  ---------  ---------  ----------   -------  ---------  ---------  ----------   -------  --------
write         137.05     127.16      131.73      3.33     274.10     254.32      263.46      6.67  15.57218   EXCEL
read          334.68     305.41      316.45     10.08     669.35     610.82      632.91     20.16   6.48446   EXCEL

Max Write: 137.05 MiB/sec (143.71 MB/sec)
Max Read:  334.68 MiB/sec (350.93 MB/sec)