CEPH filesystem development
 help / color / mirror / Atom feed
From: Fyodor Ustinov <ufm@ufm.su>
To: ceph-devel@vger.kernel.org
Subject: Re: read and write speed.
Date: Tue, 31 May 2011 13:01:26 +0300	[thread overview]
Message-ID: <4DE4BC76.1080906@ufm.su> (raw)
In-Reply-To: <4DE41F34.8020504@ufm.su>

On 05/31/2011 01:50 AM, Fyodor Ustinov wrote:
> Hi!
>
> Fresh 0.28.2 cluster.
>
> Why reading two times slower than the writing by dd, but rados show 
> different.
> (Second question - why rados bench crash on read test?)
>
>
> root@gate0:/mnt# dd if=/dev/zero of=aaa bs=1024000 count=10000
> 10000+0 records in
> 10000+0 records out
> 10240000000 bytes (10 GB) copied, 64.5598 s, 159 MB/s
>
> root@gate0:/mnt# dd if=aaa of=/dev/null bs=1024000
> 10000+0 records in
> 10000+0 records out
> 10240000000 bytes (10 GB) copied, 122.513 s, 83.6 MB/s
> root@gate0:/mnt#
Additional. fuse vs kernel mount

fuse:

root@gate0:/mnt# dd if=/dev/zero of=bbb bs=1024000 count=10000 
conv=fdatasync
10000+0 records in
10000+0 records out
10240000000 bytes (10 GB) copied, 75.7654 s, 135 MB/s

root@gate0:/mnt# dd if=bbb of=/dev/null bs=1024000
10000+0 records in
10000+0 records out
10240000000 bytes (10 GB) copied, 101.613 s, 101 MB/s


kernel:

root@gate0:/mnt# rm bbb
root@gate0:/mnt# dd if=/dev/zero of=bbb bs=1024000 count=10000 
conv=fdatasync
10000+0 records in
10000+0 records out
10240000000 bytes (10 GB) copied, 73.143 s, 140 MB/s

root@gate0:/mnt# dd if=bbb of=/dev/null bs=1024000
10000+0 records in
10000+0 records out
10240000000 bytes (10 GB) copied, 150.84 s, 67.9 MB/s
root@gate0:/mnt#

What? Ok. reboot. After reboot:

root@gate0:/mnt# rm bbb
root@gate0:/mnt# dd if=/dev/zero of=bbb bs=1024000 count=10000 
conv=fdatasync
10000+0 records in
10000+0 records out
10240000000 bytes (10 GB) copied, 68.9618 s, 148 MB/s

root@gate0:/mnt# dd if=bbb of=/dev/null bs=1024000
10000+0 records in
10000+0 records out
10240000000 bytes (10 GB) copied, 165.564 s, 61.8 MB/s
root@gate0:/mnt#


Hmm...  unmount kernel and mount fuse...

root@gate0:/mnt# cd
root@gate0:~# umount /mnt
root@gate0:~# cfuse -m 10.5.51.230:/ /mnt
  ** WARNING: Ceph is still under development.  Any feedback can be 
directed  **
  **          at ceph-devel@vger.kernel.org or 
http://ceph.newdream.net/.     **
cfuse[1102]: starting ceph client
cfuse[1102]: starting fuse
root@gate0:~# cd /mnt/
root@gate0:/mnt# dd if=bbb of=/dev/null bs=1024000
10000+0 records in
10000+0 records out
10240000000 bytes (10 GB) copied, 93.076 s, 110 MB/s
root@gate0:/mnt#


What the hell?



WBR,
     Fyodor.


  parent reply	other threads:[~2011-05-31 10:01 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-05-30 22:50 read and write speed Fyodor Ustinov
2011-05-31  2:26 ` djlee064
2011-05-31  2:48   ` Henry C Chang
2011-05-31  3:20     ` djlee064
2011-05-31  7:06       ` Henry C Chang
2011-05-31  7:29         ` djlee064
2011-05-31 10:01 ` Fyodor Ustinov [this message]
2011-05-31 14:51   ` Gregory Farnum
2011-05-31 15:05     ` Fyodor Ustinov

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4DE4BC76.1080906@ufm.su \
    --to=ufm@ufm.su \
    --cc=ceph-devel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox