From: Stefan Hajnoczi <stefanha@gmail.com>
To: "Denis V. Lunev" <den@openvz.org>
Cc: qemu-block@nongnu.org, qemu-devel@nongnu.org,
Kevin Wolf <kwolf@redhat.com>,
Pavel Butsykin <pbutsykin@virtuozzo.com>,
Jeff Cody <jcody@redhat.com>,
Markus Armbruster <armbru@redhat.com>,
Stefan Hajnoczi <stefanha@redhat.com>,
John Snow <jsnow@redhat.com>
Subject: Re: [Qemu-devel] [PATCH v7 00/16] backup compression
Date: Mon, 8 Aug 2016 14:02:44 +0100 [thread overview]
Message-ID: <20160808130244.GH30105@stefanha-x1.localdomain> (raw)
In-Reply-To: <1469175475-15420-1-git-send-email-den@openvz.org>
[-- Attachment #1: Type: text/plain, Size: 4091 bytes --]
On Fri, Jul 22, 2016 at 11:17:39AM +0300, Denis V. Lunev wrote:
> The idea is simple - backup is "written-once" data. It is written block
> by block and it is large enough. It would be nice to save storage
> space and compress it.
>
> These patches add the ability to compress data during backup. This
> functionality is implemented by means of adding options to the qmp/hmp
> commands(drive-backup, blockdev-backup). The implementation is quite
> simple, because the responsibility for data compression imposed on the
> format driver.
>
> Changes from v1:
> - added unittest for backup compression (12, 13)
>
> Changes from v2:
> - implemented a new .bdrv_co_write_compressed interface to replace the
> old .bdrv_write_compressed (2,3,4,5,6)
>
> Changes from v3:
> - added the byte-based interfaces:
> blk_pwrite_compressed()/blk_co_pwritev_compressed() (1, 7)
> - fix drive/blockdev-backup documentation (10, 11)
>
> Changes from v4:
> - added assert that offset and count are aligned (1)
> - reuse RwCo and bdrv_co_pwritev() for write compressed (2)
> - converted interfaces to byte-based for format drivers (2, 3, 5, 6)
> - move an unrelated cleanup in a separate patches (4, 7)
> - turn on dirty_bitmaps for the compressed writes (9)
> - added simplify drive/blockdev-backup by using the boxed commands (10, 11)
> - reworded drive/blockdev-backup documentation about compression (12, 13)
> - fix s/bakup/backup/ (14)
>
> Changes from v5:
> - rebased on master
> - fix grammar (5, 8)
>
> Changes from v6:
> - more grammar fixes (1,11)
> - assignment cleanup as suggested by Eric in 11
>
> Signed-off-by: Pavel Butsykin <pbutsykin@virtuozzo.com>
> Signed-off-by: Denis V. Lunev <den@openvz.org>
> CC: Jeff Cody <jcody@redhat.com>
> CC: Markus Armbruster <armbru@redhat.com>
> CC: Eric Blake <eblake@redhat.com>
> CC: John Snow <jsnow@redhat.com>
> CC: Stefan Hajnoczi <stefanha@redhat.com>
> CC: Kevin Wolf <kwolf@redhat.com>
>
> Pavel Butsykin (16):
> block: switch blk_write_compressed() to byte-based interface
> block: Convert bdrv_pwrite_compressed() to BdrvChild
> block/io: reuse bdrv_co_pwritev() for write compressed
> qcow2: add qcow2_co_pwritev_compressed
> qcow2: cleanup qcow2_co_pwritev_compressed to avoid the recursion
> vmdk: add vmdk_co_pwritev_compressed
> qcow: add qcow_co_pwritev_compressed
> qcow: cleanup qcow_co_pwritev_compressed to avoid the recursion
> block: remove BlockDriver.bdrv_write_compressed
> block/io: turn on dirty_bitmaps for the compressed writes
> block: simplify drive-backup
> block: simplify blockdev-backup
> drive-backup: added support for data compression
> blockdev-backup: added support for data compression
> qemu-iotests: test backup compression in 055
> qemu-iotests: add vmdk for test backup compression in 055
>
> block/backup.c | 12 ++-
> block/block-backend.c | 27 +-----
> block/io.c | 48 ++++------
> block/qcow.c | 113 +++++++++---------------
> block/qcow2.c | 128 ++++++++++-----------------
> block/vmdk.c | 55 ++----------
> blockdev.c | 193 ++++++++++++++---------------------------
> hmp-commands.hx | 8 +-
> hmp.c | 24 ++---
> include/block/block.h | 5 +-
> include/block/block_int.h | 5 +-
> include/sysemu/block-backend.h | 4 +-
> qapi/block-core.json | 18 +++-
> qemu-img.c | 8 +-
> qemu-io-cmds.c | 2 +-
> qmp-commands.hx | 9 +-
> tests/qemu-iotests/055 | 118 +++++++++++++++++++++++++
> tests/qemu-iotests/055.out | 4 +-
> tests/qemu-iotests/iotests.py | 10 +--
> 19 files changed, 366 insertions(+), 425 deletions(-)
>
> --
> 2.1.4
>
>
Since no one else has applied this...
Thanks, applied to my block-next tree:
https://github.com/stefanha/qemu/commits/block-next
Stefan
[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 473 bytes --]
next prev parent reply other threads:[~2016-08-08 13:03 UTC|newest]
Thread overview: 29+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-07-22 8:17 [Qemu-devel] [PATCH v7 00/16] backup compression Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 01/16] block: switch blk_write_compressed() to byte-based interface Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 02/16] block: Convert bdrv_pwrite_compressed() to BdrvChild Denis V. Lunev
2016-08-04 9:35 ` Stefan Hajnoczi
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 03/16] block/io: reuse bdrv_co_pwritev() for write compressed Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 04/16] qcow2: add qcow2_co_pwritev_compressed Denis V. Lunev
2016-08-08 13:44 ` Kevin Wolf
2016-08-15 8:53 ` Pavel Butsykin
2016-08-15 9:39 ` [Qemu-devel] [PATCH] qcow2: fix iovec size at qcow2_co_pwritev_compressed Pavel Butsykin
2016-08-15 10:11 ` Kevin Wolf
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 05/16] qcow2: cleanup qcow2_co_pwritev_compressed to avoid the recursion Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 06/16] vmdk: add vmdk_co_pwritev_compressed Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 07/16] qcow: add qcow_co_pwritev_compressed Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 08/16] qcow: cleanup qcow_co_pwritev_compressed to avoid the recursion Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 09/16] block: remove BlockDriver.bdrv_write_compressed Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 10/16] block/io: turn on dirty_bitmaps for the compressed writes Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 11/16] block: simplify drive-backup Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 12/16] block: simplify blockdev-backup Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 13/16] drive-backup: added support for data compression Denis V. Lunev
2016-08-08 14:07 ` Kevin Wolf
2016-08-08 14:10 ` Kevin Wolf
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 14/16] blockdev-backup: " Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 15/16] qemu-iotests: test backup compression in 055 Denis V. Lunev
2016-07-22 8:17 ` [Qemu-devel] [PATCH v7 16/16] qemu-iotests: add vmdk for " Denis V. Lunev
2016-08-04 9:40 ` [Qemu-devel] [PATCH v7 00/16] backup compression Stefan Hajnoczi
2016-08-08 13:02 ` Stefan Hajnoczi [this message]
2016-08-08 13:06 ` Denis V. Lunev
2016-08-08 13:16 ` Kevin Wolf
2016-08-08 14:21 ` Kevin Wolf
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20160808130244.GH30105@stefanha-x1.localdomain \
--to=stefanha@gmail.com \
--cc=armbru@redhat.com \
--cc=den@openvz.org \
--cc=jcody@redhat.com \
--cc=jsnow@redhat.com \
--cc=kwolf@redhat.com \
--cc=pbutsykin@virtuozzo.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=stefanha@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).