From: Max Reitz <mreitz@redhat.com>
To: Vladimir Sementsov-Ogievskiy <vsementsov@virtuozzo.com>,
qemu-block@nongnu.org
Cc: Kevin Wolf <kwolf@redhat.com>, qemu-devel@nongnu.org
Subject: Re: [PATCH 0/7] iotests/129: Fix it
Date: Wed, 13 Jan 2021 16:19:42 +0100 [thread overview]
Message-ID: <e2d3fd8e-f138-c37f-8b63-be3aa9ff31be@redhat.com> (raw)
In-Reply-To: <746f2be4-4093-fcff-fddb-60b0cae74c31@virtuozzo.com>
On 13.01.21 15:31, Vladimir Sementsov-Ogievskiy wrote:
> 13.01.2021 17:06, Max Reitz wrote:
>> Hi,
>>
>> There are some problems with iotests 129 (perhaps more than these, but
>> these are the ones I know of):
>>
>> 1. It checks @busy to see whether a block job is still running; however,
>> block jobs tend to unset @busy all the time (when they yield).
>> [Fixed by patch 3]
>>
>> 2. It uses blockdev throttling, which quite some time ago has been moved
>> to the BB level; since then, such throttling will no longer affect
>> block jobs. We can get throttling to work by using a throttle filter
>> node.
>> [Fixed by patch 4]
>>
>> 3. The mirror job has a large buffer size by default. A simple drain
>> may lead to it making significant process, which is kind of
>> dangerous, because we don’t want the job to complete.
>
> Not quite clear to me. iotest 129 wants to mirror 128M of data. Mirror by
> default will have 1M chunk size and maximum of 16 parallel requests. So
> with
> throttling (even if throttling can't correctly handle parallel requests)
> we will not exceed 16M of progress.. Why we need limiting buffer size?
It does exceed 16M of progress; without the limit, I generally see
something between 16M and 32M.
Now, that still is below 128M, but it’s kind of in the same magnitude.
I don’t feel comfortable with that, especially given it’s so easy to
limit it to much less (buf_size=64k makes the job proceed to 128k).
Also, maybe the default is increased in the future. Increasing the
chunk size by 4 would mean that it might be possible to reach 128M.
I find not relying on the default better.
Max
next prev parent reply other threads:[~2021-01-13 15:31 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-01-13 14:06 [PATCH 0/7] iotests/129: Fix it Max Reitz
2021-01-13 14:06 ` [PATCH 1/7] iotests: Move try_remove to iotests.py Max Reitz
2021-01-13 14:25 ` Eric Blake
2021-01-13 14:06 ` [PATCH 2/7] iotests/129: Remove test images in tearDown() Max Reitz
2021-01-13 14:34 ` Vladimir Sementsov-Ogievskiy
2021-01-13 14:43 ` Eric Blake
2021-01-13 14:06 ` [PATCH 3/7] iotests/129: Do not check @busy Max Reitz
2021-01-13 14:48 ` Eric Blake
2021-01-13 15:01 ` Vladimir Sementsov-Ogievskiy
2021-01-13 14:06 ` [PATCH 4/7] iotests/129: Use throttle node Max Reitz
2021-01-13 14:10 ` Max Reitz
2021-01-13 14:53 ` Eric Blake
2021-01-13 15:07 ` Vladimir Sementsov-Ogievskiy
2021-01-13 15:15 ` Max Reitz
2021-01-13 16:46 ` Vladimir Sementsov-Ogievskiy
2021-01-13 17:02 ` Max Reitz
2021-01-13 17:05 ` Vladimir Sementsov-Ogievskiy
2021-01-13 14:06 ` [PATCH 5/7] iotests/129: Actually test a commit job Max Reitz
2021-01-13 15:58 ` Eric Blake
2021-01-13 16:52 ` Vladimir Sementsov-Ogievskiy
2021-01-13 14:06 ` [PATCH 6/7] iotests/129: Limit mirror job's buffer size Max Reitz
2021-01-13 16:03 ` Eric Blake
2021-01-13 17:02 ` Vladimir Sementsov-Ogievskiy
2021-01-13 14:06 ` [PATCH 7/7] iotests/129: Clean up pylint and mypy complaints Max Reitz
2021-01-13 16:04 ` Eric Blake
2021-01-13 14:31 ` [PATCH 0/7] iotests/129: Fix it Vladimir Sementsov-Ogievskiy
2021-01-13 15:19 ` Max Reitz [this message]
2021-01-13 15:29 ` Vladimir Sementsov-Ogievskiy
2021-01-13 14:38 ` Kevin Wolf
2021-01-13 14:59 ` Vladimir Sementsov-Ogievskiy
2021-01-13 15:26 ` Max Reitz
2021-01-13 15:43 ` Kevin Wolf
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=e2d3fd8e-f138-c37f-8b63-be3aa9ff31be@redhat.com \
--to=mreitz@redhat.com \
--cc=kwolf@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=vsementsov@virtuozzo.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).