From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:56873) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Xhf64-0004hj-4a for qemu-devel@nongnu.org; Fri, 24 Oct 2014 09:40:08 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Xhf60-00006c-7E for qemu-devel@nongnu.org; Fri, 24 Oct 2014 09:40:04 -0400 Received: from mailpro.odiso.net ([89.248.209.98]:53852) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Xhf5z-00006R-MS for qemu-devel@nongnu.org; Fri, 24 Oct 2014 09:40:00 -0400 Date: Fri, 24 Oct 2014 15:39:52 +0200 (CEST) From: Alexandre DERUMIER Message-ID: <884af3f3-d7fc-4080-8c54-09384314e006@mailpro> In-Reply-To: <20141024090406.GA32480@stefanha-thinkpad.redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [Qemu-devel] is it possible to use a disk with multiple iothreads ? List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Stefan Hajnoczi Cc: josh durgin , qemu-devel >>virtio-blk and virtio-scsi emulation only runs in 1 thread at a time. >>It is currently not possible to achieve true multiqueue from guest, >>through QEMU, and down to the host. >> >>This is what the final slides in my presentation were about. Ok Thanks ! >>Regarding Ceph, do you know why it burns a lot of CPU? I'm currently doing some perfs to find why is so huge. One thing is that qemu+ qemu rbd block driver + librbd seem to use 2-3x mor= e cpu, than passing krbd /dev/rbd0 from host to qemu. Don't known yet if the problem is librbd or qemu rbd block driver. ----- Mail original ----- De: "Stefan Hajnoczi" =C3=80: "Alexandre DERUMIER" Cc: "qemu-devel" , "josh durgin" Envoy=C3=A9: Vendredi 24 Octobre 2014 11:04:06 Objet: Re: is it possible to use a disk with multiple iothreads ? On Thu, Oct 23, 2014 at 08:26:17PM +0200, Alexandre DERUMIER wrote: > I was reading this interesting presentation, > > http://vmsplice.net/~stefan/stefanha-kvm-forum-2014.pdf > > and I have a specific question. > > > I'm currently evaluate ceph/rbd storage performance through qemu, > > and the current bottleneck seem to be the cpu usage of the iothread. > (rbd procotol cpu usage is really huge). > > Currently It's around 10000iops on 1core of recent xeons. > > > > So, I had tried with virtio-scsi multiqueue, but it doesn't help. (Not su= re, but I think that all queues are mapped on 1 iothread ?) > > I had tried with with virtio-blk and iothread/dataplane, it's help a litt= le , but not too much too. > > So, my question is : Is it possible to use multiple iothreads with 1 disk= ? > > (something like 1 queue - 1 iothread?) virtio-blk and virtio-scsi emulation only runs in 1 thread at a time. It is currently not possible to achieve true multiqueue from guest, through QEMU, and down to the host. This is what the final slides in my presentation were about. Regarding Ceph, do you know why it burns a lot of CPU? CCed Josh in case he has ideas for reducing Ceph library CPU utilization. Stefan