From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([208.118.235.92]:48956) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TcyNL-0002Bw-Cr for qemu-devel@nongnu.org; Mon, 26 Nov 2012 08:05:31 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1TcyNG-000504-HB for qemu-devel@nongnu.org; Mon, 26 Nov 2012 08:05:27 -0500 Received: from nodalink.pck.nerim.net ([62.212.105.220]:44772 helo=paradis.irqsave.net) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1TcyNG-0004zf-8U for qemu-devel@nongnu.org; Mon, 26 Nov 2012 08:05:22 -0500 From: =?UTF-8?q?Beno=C3=AEt=20Canet?= Date: Mon, 26 Nov 2012 14:04:59 +0100 Message-Id: <1353935123-24199-1-git-send-email-benoit@irqsave.net> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Subject: [Qemu-devel] [RFC V3 00/24] QCOW2 deduplication List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: qemu-devel@nongnu.org Cc: kwolf@redhat.com, =?UTF-8?q?Beno=C3=AEt=20Canet?= , stefanha@redhat.com This patchset is the first working version of the QCOW2 deduplication. Images must be created with "-o dedup=3Don" in order to activate the deduplication in the image. Since v2: make it work barely replace kernel red black trees by gtree. Beno=C3=AEt Canet (24): qcow2: Add deduplication to the qcow2 specification. qcow2: Add deduplication structures and fields. qcow2: Add qcow2_dedup_read_missing_and_concatenate qcow2: Make update_cluster_refcount public. qcow2: Create a way to link to l2 tables in dedup. qcow2: Add qcow2_dedup and related functions. qcow2: Add qcow2_dedup_write_new_hashes. qcow2: Implement qcow2_compute_cluster_hash. qcow2: Extract qcow2_dedup_grow_table qcow2: create function to load deduplication hashes at startup. qcow2: Load and save deduplication table header extension. qcow2: Extract qcow2_do_table_init. qcow2: Add qcow2_dedup_init and qcow2_dedup_close. qcow2: Extract qcow2_add_feature and qcow2_remove_feature. block: Add dedup image create option. qcow2: Allow creation of images using deduplication. qcow2: Behave correctly when refcount reach 0 or 2^16. qcow2: Integrate deduplication in qcow2_co_writev loop. qcow2: Add verification of dedup table. qcow2: Adapt checking of QCOW_OFLAG_COPIED for dedup. qcow2: Add check_dedup_l2 in order to check l2 of dedup table. qcow2: Do not overwrite existing entries with QCOW_OFLAG_COPIED. qcow2: init and cleanup deduplication. qemu-iotests: Filter dedup=3Don/off so existing tests don't break. Makefile | 3 + Makefile.target | 2 +- block/Makefile.objs | 1 + block/qcow2-cluster.c | 115 ++++-- block/qcow2-dedup.c | 914 ++++++++++++++++++++++++++++++++++++= ++++++ block/qcow2-refcount.c | 154 +++++-- block/qcow2.c | 267 ++++++++++-- block/qcow2.h | 89 +++- block_int.h | 1 + docs/specs/qcow2.txt | 33 +- tests/qemu-iotests/common.rc | 3 +- 11 files changed, 1480 insertions(+), 102 deletions(-) create mode 100644 block/qcow2-dedup.c --=20 1.7.10.4