Re: Initial newstore vs filestore results

[Mark Nelson <mnelson@redhat.com>]

On 04/07/2015 02:16 PM, Mark Nelson wrote:
> On 04/07/2015 09:57 AM, Mark Nelson wrote:
>> Hi Guys,
>>
>> I ran some quick tests on Sage's newstore branch.  So far given that
>> this is a prototype, things are looking pretty good imho.  The 4MB
>> object rados bench read/write and small read performance looks
>> especially good.  Keep in mind that this is not using the SSD journals
>> in any way, so 640MB/s sequential writes is actually really good
>> compared to filestore without SSD journals.
>>
>> small write performance appears to be fairly bad, especially in the RBD
>> case where it's small writes to larger objects.  I'm going to sit down
>> and see if I can figure out what's going on.  It's bad enough that I
>> suspect there's just something odd going on.
>>
>> Mark
>
> Seekwatcher/blktrace graphs of a 4 OSD cluster using newstore for those
> interested:
>
> http://nhm.ceph.com/newstore/
>
> Interestingly small object write/read performance with 4 OSDs was about
> 1/3-1/4 the speed of the same cluster with 36 OSDs.
>
> Note: Thanks Dan for fixing the directory column width!
>
> Mark

New fio/librbd results using Sage's latest code that attempts to keep 
small overwrite extents in the db.  This is 4 OSD so not directly 
comparable to the 36 OSD tests above, but does include seekwatcher 
graphs.  Results in MB/s:

	write	read	randw	randr
4MB	57.9	319.6	55.2	285.9
128KB	2.5	230.6	2.4	125.4
4KB	0.46	55.65	1.11	3.56

Seekwatcher graphs:

http://nhm.ceph.com/newstore/20150407/

Mark