From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:46972) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UuMFb-0000Ps-Hx for qemu-devel@nongnu.org; Wed, 03 Jul 2013 08:33:38 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UuMFW-0005Vg-1o for qemu-devel@nongnu.org; Wed, 03 Jul 2013 08:33:35 -0400 Received: from nodalink.pck.nerim.net ([62.212.105.220]:39020 helo=paradis.irqsave.net) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UuMFV-0005Va-Ny for qemu-devel@nongnu.org; Wed, 03 Jul 2013 08:33:29 -0400 Date: Wed, 3 Jul 2013 14:35:14 +0200 From: =?iso-8859-1?Q?Beno=EEt?= Canet Message-ID: <20130703123514.GB5482@irqsave.net> References: <1371738392-9594-1-git-send-email-benoit@irqsave.net> <1371738392-9594-2-git-send-email-benoit@irqsave.net> <20130702144224.GF9870@stefanha-thinkpad.redhat.com> <20130702212355.GB4985@irqsave.net> <20130703080153.GC16585@stefanha-thinkpad.muc.redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20130703080153.GC16585@stefanha-thinkpad.muc.redhat.com> Subject: Re: [Qemu-devel] [RFC V8 01/24] qcow2: Add journal specification. List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Stefan Hajnoczi Cc: =?iso-8859-1?Q?Beno=EEt?= Canet , kwolf@redhat.com, qemu-devel@nongnu.org > Does this mean the journal forms the first-stage data structure for > deduplication? Dedup records will accumulate in the journal until it > becomes time to convert them in bulk into a more compact representation? The journal is mainly used to persist the last inserted dedup metadata across QEMU stop and restart. I replay it at startup to rebuild the hash table. So yes it's the first stage even it's never used for regular queries. > > When I read this specification I was thinking of a journal purely for > logging operations. You could use a commit record to mark previous > records applied. Upon startup, qcow2 would inspect uncommitted records > and deal with them. Maybe that could help regular QCOW2 usage. I don't know.