CEPH: Ceph on the Blades - Revision history

Roshan: /* Rados internal benchmark */

2013-05-07T11:50:12Z

Rados internal benchmark

Roshan: /* Ceph Benchmarks */

2013-05-05T11:04:36Z

Ceph Benchmarks

Roshan: /* RBD Mapped Devices */

2013-05-05T11:04:36Z

RBD Mapped Devices

Roshan: /* OSDs */

2013-05-05T11:04:36Z

OSDs

Roshan: /* OSDs */

2013-05-05T11:04:36Z

OSDs

Roshan: /* Rados internal benchmark */

2013-05-05T11:04:36Z

Rados internal benchmark

Roshan: /* Rados internal benchmark */

2013-05-05T11:04:36Z

Rados internal benchmark

Roshan: /* Ceph Benchmarks */

2013-05-05T11:04:36Z

Ceph Benchmarks

Roshan: /* NETCAT */

2013-05-03T12:41:15Z

NETCAT

Roshan: /* IPERF */

2013-05-03T12:37:21Z

IPERF

@@ Line 314: / Line 314: @@
 OSD Reads:
+ rados bench -p pbench <no of seconds> seq
 {| class="wikitable"
 |-

@@ Line 391: / Line 391: @@
 +0 records out
 1073741824 bytes (1.1 GB) copied, 9.56429 s, 112 MB/s</syntaxhighlight>
 |}

@@ Line 367: / Line 367: @@
 ==== RBD Mapped Devices ====
 {| class="wikitable"
 |-

@@ Line 344: / Line 344: @@
 ! 1G Ethernet !! 10G Ethernet
 |-
-| <syntaxhighlight>2013-07-03 22:00:30.283085 osd.2 172.28.1.93:6800/6321 2342 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.476351 sec at 228 MB/sec
+| <syntaxhighlight>[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.476351 sec at 228 MB/sec
--05-02 21:52:45.673270 osd.1 172.28.0.115:6800/6361 1753 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.238013 sec at 241 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.238013 sec at 241 MB/sec
--07-03 22:00:39.200515 osd.2 172.28.1.93:6800/6321 2344 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.347836 sec at 235 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.347836 sec at 235 MB/sec
--05-02 22:52:21.680061 osd.0 172.28.0.232:6801/14958 1761 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.455193 sec at 229 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.455193 sec at 229 MB/sec
--05-02 22:52:26.889293 osd.0 172.28.0.232:6801/14958 1762 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.436797 sec at 230 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.436797 sec at 230 MB/sec
--05-02 21:52:54.939377 osd.1 172.28.0.115:6800/6361 1754 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.459931 sec at 229 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.459931 sec at 229 MB/sec
--07-03 22:00:57.379833 osd.2 172.28.1.93:6800/6321 2347 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.480481 sec at 228 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.480481 sec at 228 MB/sec
--05-02 21:56:29.527394 osd.1 172.28.0.115:6800/14860 3 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.310322 sec at 237 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.310322 sec at 237 MB/sec
--05-02 22:56:05.385578 osd.0 172.28.0.232:6801/28745 3 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.377688 sec at 233 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.377688 sec at 233 MB/sec
--07-03 22:04:32.027021 osd.2 172.28.1.93:6800/13630 3 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.388466 sec at 233 MB/sec</syntaxhighlight>
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.388466 sec at 233 MB/sec</syntaxhighlight>
-|| <syntaxhighlight>2013-05-03 00:30:55.582512 osd.1 100.100.0.4:6800/15875 772 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.581096 sec at 223 MB/sec
+|| <syntaxhighlight>[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.581096 sec at 223 MB/sec
--05-03 01:30:27.003070 osd.0 100.100.0.3:6801/794 486 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.804200 sec at 213 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.804200 sec at 213 MB/sec
--05-03 01:30:32.230223 osd.0 100.100.0.3:6801/794 487 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.968500 sec at 206 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.968500 sec at 206 MB/sec
--07-04 00:38:47.254018 osd.2 100.100.0.5:6800/15015 653 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.667843 sec at 219 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.667843 sec at 219 MB/sec
--07-04 00:38:51.747400 osd.2 100.100.0.5:6800/15015 654 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.233254 sec at 241 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.233254 sec at 241 MB/sec
--05-03 00:31:00.310074 osd.1 100.100.0.4:6800/15875 773 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.466140 sec at 229 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.466140 sec at 229 MB/sec
--05-03 00:31:05.149834 osd.1 100.100.0.4:6800/15875 774 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.575729 sec at 223 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.575729 sec at 223 MB/sec
--05-03 01:30:37.396286 osd.0 100.100.0.3:6801/794 488 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.906584 sec at 208 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.906584 sec at 208 MB/sec
--07-04 00:38:57.343656 osd.2 100.100.0.5:6800/15015 655 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 5.392144 sec at 189 MB/sec
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 5.392144 sec at 189 MB/sec
--07-04 00:39:02.071547 osd.2 100.100.0.5:6800/15015 656 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.473388 sec at 228 MB/sec</syntaxhighlight>
+[INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.473388 sec at 228 MB/sec</syntaxhighlight>
 |}

@@ Line 338: / Line 338: @@
 ==== OSDs ====
 {| class="wikitable"
 |-
 ! 1G Ethernet !! 10G Ethernet
 |-
-| <syntaxhighlight></syntaxhighlight>
+| <syntaxhighlight>2013-07-03 22:00:30.283085 osd.2 172.28.1.93:6800/6321 2342 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.476351 sec at 228 MB/sec
-|| <syntaxhighlight></syntaxhighlight>
+-05-02 21:52:45.673270 osd.1 172.28.0.115:6800/6361 1753 : [INF] bench: wrote 1024 MB in blocks of 4096 KB in 4.238013 sec at 241 MB/sec
 |}

@@ Line 327: / Line 327: @@
 Max latency:           15.2291
 Min latency:           0.049004</syntaxhighlight>
-|| <syntaxhighlight> Total time run:        1.691854
+|| <syntaxhighlight>Total time run:        1.691854
 Total reads made:     42
 Read size:            4194304

@@ Line 295: / Line 295: @@
 Min bandwidth (MB/sec): 0
 Average Latency:        3.25449
 Stddev Latency:         2.84939
 Max latency:            15.3193
@@ Line 325: / Line 326: @@
 Average Latency:       4.10843
 Max latency:           15.2291
-Min latency:           0.049004
+Min latency:           0.049004</syntaxhighlight>
 || <syntaxhighlight> Total time run:        1.691854
 Total reads made:     42

@@ Line 276: / Line 276: @@
 === Ceph Benchmarks ===
 {| class="wikitable"
 |-

@@ Line 166: / Line 166: @@
 TCP window size: 85.3 KByte (default)
 ------------------------------------------------------------
-[  4] local 100.100.0.3 port 5001 connected with 100.100.0.8 port 51166
+[  4] local 172.28.0.232 port 5001 connected with 172.28.0.101 port 33826
 [ ID] Interval       Transfer     Bandwidth
-[  4]  0.0-10.0 sec  10.8 GBytes  9.26 Gbits/sec
+[  4]  0.0-10.1 sec  1.12 GBytes    948 Mbits/sec</syntaxhighlight>
 From client
   iperf -c 172.28.0.232 -i1 -t 10
@@ Line 200: / Line 199: @@
 [ ID] Interval       Transfer     Bandwidth
 [  3]  0.0-10.0 sec  1.12 GBytes    956 Mbits/sec</syntaxhighlight>
-|| <syntaxhighlight></syntaxhighlight>
+||From server
 |}