From: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>
To: qemu-block@nongnu.org
Cc: fam@euphon.net, kwolf@redhat.com, vsementsov@virtuozzo.com,
armbru@redhat.com, qemu-devel@nongnu.org, mreitz@redhat.com,
stefanha@redhat.com, den@openvz.org
Subject: [PATCH v3 00/12] preallocate filter
Date: Mon, 17 Aug 2020 12:15:41 +0300 [thread overview]
Message-ID: <20200817091553.283155-1-vsementsov@virtuozzo.com> (raw)
Hi all!
Here is a filter, which does preallocation on write.
In Virtuozzo we have to deal with some custom distributed storage
solution, where allocation is relatively expensive operation. We have to
workaround it in Qemu, so here is a new filter.
Patches 1-10 introduces the new filter and suggested to be merged
to master.
Patches 11,12 are here just to show how we are going to use the feature.
I don't know can they be somehow generally useful, ideas are welcome.
Difference from v1:
1-6 are new and substitutes bdrv_co_range_try_lock mechanism used in v1
07: add note to docs/system/qemu-block-drivers.rst.inc
add open options
rebase on new BDRV_REQ_NO_WAIT flag
drop bs->file check in _co_flush()
add active logic, to make it possible to insert filter dynamically
08,09: new
10: - use new iotests.verify_o_direct()
10: - add qemu-img check call
11,12: not for commit
Vladimir Sementsov-Ogievskiy (12):
block: simplify comment to BDRV_REQ_SERIALISING
block/io.c: drop assertion on double waiting for request serialisation
block/io: split out bdrv_find_conflicting_request
block/io: bdrv_wait_serialising_requests_locked: drop extra bs arg
block: bdrv_mark_request_serialising: split non-waiting function
block: introduce BDRV_REQ_NO_WAIT flag
block: introduce preallocate filter
iotests.py: add verify_o_direct helper
iotests.py: add filter_img_check
iotests: add 298 to test new preallocate filter driver
block: add bdrv_is_file_on_fuse helper
block/qcow2: automatically insert preallocate filter when on FUSE
docs/system/qemu-block-drivers.rst.inc | 26 +++
qapi/block-core.json | 20 +-
include/block/block.h | 22 +-
include/block/block_int.h | 3 +-
block/file-posix.c | 23 +-
block/io.c | 131 ++++++-----
block/preallocate.c | 291 +++++++++++++++++++++++++
block/qcow2.c | 38 ++++
block/Makefile.objs | 1 +
tests/qemu-iotests/298 | 50 +++++
tests/qemu-iotests/298.out | 6 +
tests/qemu-iotests/group | 1 +
tests/qemu-iotests/iotests.py | 10 +
13 files changed, 554 insertions(+), 68 deletions(-)
create mode 100644 block/preallocate.c
create mode 100644 tests/qemu-iotests/298
create mode 100644 tests/qemu-iotests/298.out
--
2.18.0
next reply other threads:[~2020-08-17 9:23 UTC|newest]
Thread overview: 31+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-08-17 9:15 Vladimir Sementsov-Ogievskiy [this message]
2020-08-17 9:15 ` [PATCH v3 01/12] block: simplify comment to BDRV_REQ_SERIALISING Vladimir Sementsov-Ogievskiy
2020-08-19 14:59 ` Stefan Hajnoczi
2020-08-17 9:15 ` [PATCH v3 02/12] block/io.c: drop assertion on double waiting for request serialisation Vladimir Sementsov-Ogievskiy
2020-08-19 15:28 ` Stefan Hajnoczi
2020-08-19 15:48 ` Paolo Bonzini
2020-08-17 9:15 ` [PATCH v3 03/12] block/io: split out bdrv_find_conflicting_request Vladimir Sementsov-Ogievskiy
2020-08-19 14:59 ` Stefan Hajnoczi
2020-08-17 9:15 ` [PATCH v3 04/12] block/io: bdrv_wait_serialising_requests_locked: drop extra bs arg Vladimir Sementsov-Ogievskiy
2020-08-19 14:59 ` Stefan Hajnoczi
2020-08-17 9:15 ` [PATCH v3 05/12] block: bdrv_mark_request_serialising: split non-waiting function Vladimir Sementsov-Ogievskiy
2020-08-19 14:40 ` Stefan Hajnoczi
2020-08-17 9:15 ` [PATCH v3 06/12] block: introduce BDRV_REQ_NO_WAIT flag Vladimir Sementsov-Ogievskiy
2020-08-19 14:42 ` Stefan Hajnoczi
2020-08-17 9:15 ` [PATCH v3 07/12] block: introduce preallocate filter Vladimir Sementsov-Ogievskiy
2020-08-19 14:57 ` Stefan Hajnoczi
2020-08-17 9:15 ` [PATCH v3 08/12] iotests.py: add verify_o_direct helper Vladimir Sementsov-Ogievskiy
2020-08-19 14:59 ` Stefan Hajnoczi
2020-08-17 9:15 ` [PATCH v3 09/12] iotests.py: add filter_img_check Vladimir Sementsov-Ogievskiy
2020-08-19 14:59 ` Stefan Hajnoczi
2020-08-17 9:15 ` [PATCH v3 10/12] iotests: add 298 to test new preallocate filter driver Vladimir Sementsov-Ogievskiy
2020-08-19 14:59 ` Stefan Hajnoczi
2020-08-17 9:15 ` [PATCH v3 11/12] block: add bdrv_is_file_on_fuse helper Vladimir Sementsov-Ogievskiy
2020-08-17 9:15 ` [PATCH v3 12/12] block/qcow2: automatically insert preallocate filter when on FUSE Vladimir Sementsov-Ogievskiy
2020-08-19 15:15 ` Stefan Hajnoczi
2020-08-20 9:46 ` Vladimir Sementsov-Ogievskiy
2020-08-17 9:45 ` [PATCH v3 00/12] preallocate filter no-reply
2020-08-17 10:44 ` Vladimir Sementsov-Ogievskiy
2020-08-17 9:48 ` no-reply
2020-08-17 10:46 ` Vladimir Sementsov-Ogievskiy
2020-08-19 15:29 ` Stefan Hajnoczi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200817091553.283155-1-vsementsov@virtuozzo.com \
--to=vsementsov@virtuozzo.com \
--cc=armbru@redhat.com \
--cc=den@openvz.org \
--cc=fam@euphon.net \
--cc=kwolf@redhat.com \
--cc=mreitz@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=stefanha@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).