From: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>
To: qemu-block@nongnu.org
Cc: qemu-devel@nongnu.org, armbru@redhat.com, fam@euphon.net,
stefanha@redhat.com, eblake@redhat.com, hreitz@redhat.com,
kwolf@redhat.com, vsementsov@virtuozzo.com, jsnow@redhat.com,
nikita.lapshin@virtuozzo.com
Subject: [PATCH v5 00/16] Make image fleecing more usable
Date: Mon, 28 Feb 2022 12:39:11 +0100 [thread overview]
Message-ID: <20220228113927.1852146-1-vsementsov@virtuozzo.com> (raw)
v5: Drop immutable_source backup parameter: it's not necessary with new scheme. Other changes:
03,06,07,08,10,13 : add Hanna's r-bs
04: add (Since 7.0)
11: s/filter/block driver/, also add note about snapshot size
12: fix text and s/bs/child->bs/kk
update iotest 257 output
14: use qemu_io_wrap_args
16: drop 'immutable_source=True' option
===
These series brings several improvements to fleecing scheme:
1. support bitmap in copy-before-write filter
2. introduce snapshot-access API and filter, to make a new fleecing
scheme. See "block: copy-before-write: realize snapshot-access API"
commit message for details.
3. support "push backup with fleecing" scheme, when backup job is a
client of common fleecing scheme. That helps when writes to final
backup target are slow and we don't want guest writes hang waiting
for copy-before-write operations to final target.
Vladimir Sementsov-Ogievskiy (16):
block/block-copy: move copy_bitmap initialization to
block_copy_state_new()
block/dirty-bitmap: bdrv_merge_dirty_bitmap(): add return value
block/block-copy: block_copy_state_new(): add bitmap parameter
block/copy-before-write: add bitmap open parameter
block/block-copy: add block_copy_reset()
block: intoduce reqlist
block/reqlist: reqlist_find_conflict(): use ranges_overlap()
block/dirty-bitmap: introduce bdrv_dirty_bitmap_status()
block/reqlist: add reqlist_wait_all()
block/io: introduce block driver snapshot-access API
block: introduce snapshot-access block driver
block: copy-before-write: realize snapshot-access API
iotests/image-fleecing: add test-case for fleecing format node
iotests.py: add qemu_io_pipe_and_status()
iotests/image-fleecing: add test case with bitmap
iotests/image-fleecing: test push backup with fleecing
qapi/block-core.json | 14 +-
include/block/block-copy.h | 2 +
include/block/block_int.h | 27 ++
include/block/dirty-bitmap.h | 4 +-
include/block/reqlist.h | 75 ++++++
include/qemu/hbitmap.h | 12 +
block/block-copy.c | 150 +++++------
block/copy-before-write.c | 265 +++++++++++++++++++-
block/dirty-bitmap.c | 15 +-
block/io.c | 69 +++++
block/monitor/bitmap-qmp-cmds.c | 5 +-
block/reqlist.c | 85 +++++++
block/snapshot-access.c | 132 ++++++++++
util/hbitmap.c | 33 +++
MAINTAINERS | 5 +-
block/meson.build | 2 +
tests/qemu-iotests/257.out | 224 +++++++++++++++++
tests/qemu-iotests/iotests.py | 3 +
tests/qemu-iotests/tests/image-fleecing | 174 ++++++++++---
tests/qemu-iotests/tests/image-fleecing.out | 223 +++++++++++++++-
20 files changed, 1378 insertions(+), 141 deletions(-)
create mode 100644 include/block/reqlist.h
create mode 100644 block/reqlist.c
create mode 100644 block/snapshot-access.c
--
2.31.1
next reply other threads:[~2022-02-28 11:42 UTC|newest]
Thread overview: 24+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-02-28 11:39 Vladimir Sementsov-Ogievskiy [this message]
2022-02-28 11:39 ` [PATCH v5 01/16] block/block-copy: move copy_bitmap initialization to block_copy_state_new() Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 02/16] block/dirty-bitmap: bdrv_merge_dirty_bitmap(): add return value Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 03/16] block/block-copy: block_copy_state_new(): add bitmap parameter Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 04/16] block/copy-before-write: add bitmap open parameter Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 05/16] block/block-copy: add block_copy_reset() Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 06/16] block: intoduce reqlist Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 07/16] block/reqlist: reqlist_find_conflict(): use ranges_overlap() Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 08/16] block/dirty-bitmap: introduce bdrv_dirty_bitmap_status() Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 09/16] block/reqlist: add reqlist_wait_all() Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 10/16] block/io: introduce block driver snapshot-access API Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 11/16] block: introduce snapshot-access block driver Vladimir Sementsov-Ogievskiy
2022-03-03 11:05 ` Hanna Reitz
2022-03-03 11:11 ` Hanna Reitz
2022-03-03 17:26 ` Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 12/16] block: copy-before-write: realize snapshot-access API Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 13/16] iotests/image-fleecing: add test-case for fleecing format node Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 14/16] iotests.py: add qemu_io_pipe_and_status() Vladimir Sementsov-Ogievskiy
2022-02-28 11:39 ` [PATCH v5 15/16] iotests/image-fleecing: add test case with bitmap Vladimir Sementsov-Ogievskiy
2022-03-03 11:44 ` Hanna Reitz
2022-03-03 12:57 ` Hanna Reitz
2022-02-28 11:39 ` [PATCH v5 16/16] iotests/image-fleecing: test push backup with fleecing Vladimir Sementsov-Ogievskiy
2022-03-03 10:58 ` Hanna Reitz
2022-03-03 17:35 ` Vladimir Sementsov-Ogievskiy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20220228113927.1852146-1-vsementsov@virtuozzo.com \
--to=vsementsov@virtuozzo.com \
--cc=armbru@redhat.com \
--cc=eblake@redhat.com \
--cc=fam@euphon.net \
--cc=hreitz@redhat.com \
--cc=jsnow@redhat.com \
--cc=kwolf@redhat.com \
--cc=nikita.lapshin@virtuozzo.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=stefanha@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).