From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mark Nelson Subject: Re: [ceph-users] Initial performance cluster SimpleMessenger vs AsyncMessenger results Date: Tue, 13 Oct 2015 08:03:15 -0500 Message-ID: <561D0113.108@redhat.com> References: <561BE4E3.7050404@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Return-path: Received: from mx1.redhat.com ([209.132.183.28]:47339 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752095AbbJMNDS (ORCPT ); Tue, 13 Oct 2015 09:03:18 -0400 In-Reply-To: Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Haomai Wang Cc: ceph-devel , "ceph-users@lists.ceph.com" Hi Haomai, Great! I haven't had a chance to dig in and look at it with valgrind yet, but if I get a chance after I'm done with newstore fragment testing and somnath's writepath work I'll try to go back and dig in if you haven't had a chance yet. Mark On 10/12/2015 09:56 PM, Haomai Wang wrote: > resend > > On Tue, Oct 13, 2015 at 10:56 AM, Haomai Wang wrote: >> COOL >> >> Interesting that async messenger will consume more memory than simple, in my >> mind I always think async should use less memory. I will give a look at this >> >> On Tue, Oct 13, 2015 at 12:50 AM, Mark Nelson wrote: >>> >>> Hi Guy, >>> >>> Given all of the recent data on how different memory allocator >>> configurations improve SimpleMessenger performance (and the effect of memory >>> allocators and transparent hugepages on RSS memory usage), I thought I'd run >>> some tests looking how AsyncMessenger does in comparison. We spoke about >>> these a bit at the last performance meeting but here's the full write up. >>> The rough conclusion as of right now appears to be: >>> >>> 1) AsyncMessenger performance is not dependent on the memory allocator >>> like with SimpleMessenger. >>> >>> 2) AsyncMessenger is faster than SimpleMessenger with TCMalloc + 32MB (ie >>> default) thread cache. >>> >>> 3) AsyncMessenger is consistently faster than SimpleMessenger for 128K >>> random reads. >>> >>> 4) AsyncMessenger is sometimes slower than SimpleMessenger when memory >>> allocator optimizations are used. >>> >>> 5) AsyncMessenger currently uses far more RSS memory than SimpleMessenger. >>> >>> Here's a link to the paper: >>> >>> https://drive.google.com/file/d/0B2gTBZrkrnpZS1Q4VktjZkhrNHc/view >>> >>> Mark >>> _______________________________________________ >>> ceph-users mailing list >>> ceph-users@lists.ceph.com >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> >> >> >> >> -- >> >> Best Regards, >> >> Wheat > > >