From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:48973) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XMx5H-0000ou-9J for qemu-devel@nongnu.org; Thu, 28 Aug 2014 06:37:44 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1XMx5C-0002jD-Cc for qemu-devel@nongnu.org; Thu, 28 Aug 2014 06:37:39 -0400 Received: from mail-pa0-x230.google.com ([2607:f8b0:400e:c03::230]:44676) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XMx5C-0002j3-1v for qemu-devel@nongnu.org; Thu, 28 Aug 2014 06:37:34 -0400 Received: by mail-pa0-f48.google.com with SMTP id ey11so2013449pad.21 for ; Thu, 28 Aug 2014 03:37:30 -0700 (PDT) Date: Thu, 28 Aug 2014 18:37:30 +0800 From: Liu Yuan Message-ID: <20140828103730.GB720@ubuntu-trusty> References: <1408354865-23490-1-git-send-email-namei.unix@gmail.com> <20140828103308.GD26741@stefanha-thinkpad.redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20140828103308.GD26741@stefanha-thinkpad.redhat.com> Subject: Re: [Qemu-devel] [PATCH v6 0/2] add read-pattern for block qourum List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Stefan Hajnoczi Cc: Kevin Wolf , qemu-devel@nongnu.org, Stefan Hajnoczi , Benoit Canet On Thu, Aug 28, 2014 at 11:33:08AM +0100, Stefan Hajnoczi wrote: > On Mon, Aug 18, 2014 at 05:41:03PM +0800, Liu Yuan wrote: > > v6: > > - fix a unused warning introduced by last version > > > > v5: > > - simplify a for loop in quorum_aio_finalize() > > > > v4: > > - swap the patch order > > - update comment for fifo pattern in qaip > > - use qapi enumeration in quorum driver instead of manual parsing > > > > v3: > > - separate patch into two, one for quorum and one for qapi for easier review > > - add enumeration for quorum read pattern > > - remove unrelated blank line fix from this patch set > > > > v2: > > - rename single as 'fifo' > > - rename read_all_children as read_quorum_children > > - fix quorum_aio_finalize() for fifo pattern > > > > This patch adds single read pattern to quorum driver and quorum vote is default > > pattern. > > > > For now we do a quorum vote on all the reads, it is designed for unreliable > > underlying storage such as non-redundant NFS to make sure data integrity at the > > cost of the read performance. > > > > For some use cases as following: > > > > VM > > -------------- > > | | > > v v > > A B > > > > Both A and B has hardware raid storage to justify the data integrity on its own. > > So it would help performance if we do a single read instead of on all the nodes. > > Further, if we run VM on either of the storage node, we can make a local read > > request for better performance. > > > > This patch generalize the above 2 nodes case in the N nodes. That is, > > > > vm -> write to all the N nodes, read just one of them. If single read fails, we > > try to read next node in FIFO order specified by the startup command. > > > > The 2 nodes case is very similar to DRBD[1] though lack of auto-sync > > functionality in the single device/node failure for now. But compared with DRBD > > we still have some advantages over it: > > > > - Suppose we have 20 VMs running on one(assume A) of 2 nodes' DRBD backed > > storage. And if A crashes, we need to restart all the VMs on node B. But for > > practice case, we can't because B might not have enough resources to setup 20 VMs > > at once. So if we run our 20 VMs with quorum driver, and scatter the replicated > > images over the data center, we can very likely restart 20 VMs without any > > resource problem. > > > > After all, I think we can build a more powerful replicated image functionality > > on quorum and block jobs(block mirror) to meet various High Availibility needs. > > > > E.g, Enable single read pattern on 2 children, > > > > -drive driver=quorum,children.0.file.filename=0.qcow2,\ > > children.1.file.filename=1.qcow2,read-pattern=fifo,vote-threshold=1 > > > > [1] http://en.wikipedia.org/wiki/Distributed_Replicated_Block_Device > > > > Cc: Benoit Canet > > Cc: Eric Blake > > Cc: Kevin Wolf > > Cc: Stefan Hajnoczi > > Liu Yuan (2): > > qapi: add read-pattern enum for quorum > > block/quorum: add simple read pattern support > > > > block/quorum.c | 177 +++++++++++++++++++++++++++++++++++++-------------- > > qapi/block-core.json | 20 +++++- > > 2 files changed, 148 insertions(+), 49 deletions(-) > > I dropped the \n from the error_setg() error message while merging. > Please do not use \n with error_setg(). Thanks for your fix. > Please extend the quorum qemu-iotests to cover the new fifo read > pattern. You can send the tests as a separate patch series. > Okay, will do later. Yuan