From mboxrd@z Thu Jan  1 00:00:00 1970
Received: from eggs.gnu.org ([2001:4830:134:3::10]:48311)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <paolo.bonzini@gmail.com>) id 1Xila3-0006Qf-Tn
	for qemu-devel@nongnu.org; Mon, 27 Oct 2014 10:47:45 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <paolo.bonzini@gmail.com>) id 1XilZu-00010x-SP
	for qemu-devel@nongnu.org; Mon, 27 Oct 2014 10:47:35 -0400
Received: from mail-la0-x22c.google.com ([2a00:1450:4010:c03::22c]:54194)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <paolo.bonzini@gmail.com>) id 1XilZu-00010i-Jw
	for qemu-devel@nongnu.org; Mon, 27 Oct 2014 10:47:26 -0400
Received: by mail-la0-f44.google.com with SMTP id hs14so5974300lab.31
	for <qemu-devel@nongnu.org>; Mon, 27 Oct 2014 07:47:25 -0700 (PDT)
Sender: Paolo Bonzini <paolo.bonzini@gmail.com>
Message-ID: <544E5AF7.2030106@redhat.com>
Date: Mon, 27 Oct 2014 15:47:19 +0100
From: Paolo Bonzini <pbonzini@redhat.com>
MIME-Version: 1.0
References: <20141027131958.GC15071@stefanha-thinkpad.redhat.com>
	<33a4db31-a5e2-4bfc-b73b-c0e7d3023542@mailpro>
In-Reply-To: <33a4db31-a5e2-4bfc-b73b-c0e7d3023542@mailpro>
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
Subject: Re: [Qemu-devel] is it possible to use a disk with multiple
	iothreads ?
List-Id: <qemu-devel.nongnu.org>
List-Unsubscribe: <https://lists.nongnu.org/mailman/options/qemu-devel>,
	<mailto:qemu-devel-request@nongnu.org?subject=unsubscribe>
List-Archive: <http://lists.nongnu.org/archive/html/qemu-devel>
List-Post: <mailto:qemu-devel@nongnu.org>
List-Help: <mailto:qemu-devel-request@nongnu.org?subject=help>
List-Subscribe: <https://lists.nongnu.org/mailman/listinfo/qemu-devel>,
	<mailto:qemu-devel-request@nongnu.org?subject=subscribe>
To: Alexandre DERUMIER <aderumier@odiso.com>, Stefan Hajnoczi <stefanha@redhat.com>
Cc: josh durgin <josh.durgin@inktank.com>, qemu-devel <qemu-devel@nongnu.org>



On 10/27/2014 03:13 PM, Alexandre DERUMIER wrote:
>>> That's very interesting! Please keep Josh and me in CC when you want to 
>>> >>discuss the results. 
> Here the aggregate results (perf report details attached in this mail)
> 
> +  33,02%    3974368751  kvm  [kernel.kallsyms]                                                                                                                                                                                              
> +  23,66%    2847206635  kvm  libc-2.13.so                                                                                                                                                                                                   
> +  18,79%    2262052133  kvm  librados.so.2.0.0                                                                                                                                                                                              
> +  11,04%    1328581527  kvm  librbd.so.1.0.0                                                                                                                                                                                                
> +   5,87%     706713737  kvm  libpthread-2.13.so                                                                                                                                                                                             
> +   3,75%     451690142  kvm  kvm                                                                                                                                                                                                            
> +   2,74%     329457334  kvm  libstdc++.so.6.0.17                                                                                                                                                                                            
> +   0,51%      61519664  kvm  [vdso]                                                                                                                                                                                                         +   0,42%      50000089  kvm  libglib-2.0.so.0.3200.4                                                                                                                                                                                        +   0,15%      18119658  kvm  libm-2.13.so                                                                                                                                                                                                   +   0,05%       5705776  kvm  librt-2.13.so                                                                                                                                                                                                  +   0,00%        356625  kvm  libz.so.1.2.7    
> 
> 
> 
> 
>>> >> 23,66%    2847206635  kvm  libc-2.13.so 
> This one is mostly malloc,free,...
> 
> 
> I see almost same results using fio with rbdengine on the host (outside the kvm process).
> So I think they are all mostly related to librbd.

You are missing debug information unfortunately, but the slowdown seems
to be related to futexes.

Paolo