From: Kevin Wolf <kwolf@redhat.com>
To: qemu-block@nongnu.org
Cc: kwolf@redhat.com, hreitz@redhat.com, stefanha@redhat.com,
qemu-devel@nongnu.org
Subject: [PATCH for-8.2 4/4] iotests: Test two stream jobs in a single iothread
Date: Wed, 15 Nov 2023 18:20:12 +0100 [thread overview]
Message-ID: <20231115172012.112727-5-kwolf@redhat.com> (raw)
In-Reply-To: <20231115172012.112727-1-kwolf@redhat.com>
This tests two parallel stream jobs that will complete around the same
time and run on two different disks in the same iothreads. It is loosely
based on the bug report at https://issues.redhat.com/browse/RHEL-1761.
For me, this test hangs reliably with the originally reported bug in
blk_remove_bs(). After fixing it, it intermittently hangs for the bugs
fixed after it, missing AioContext unlocking in bdrv_graph_wrunlock()
and in stream_prepare(). The deadlocks seem to happen more frequently
when the test directory is on tmpfs.
Signed-off-by: Kevin Wolf <kwolf@redhat.com>
---
tests/qemu-iotests/tests/iothreads-stream | 73 +++++++++++++++++++
tests/qemu-iotests/tests/iothreads-stream.out | 11 +++
2 files changed, 84 insertions(+)
create mode 100755 tests/qemu-iotests/tests/iothreads-stream
create mode 100644 tests/qemu-iotests/tests/iothreads-stream.out
diff --git a/tests/qemu-iotests/tests/iothreads-stream b/tests/qemu-iotests/tests/iothreads-stream
new file mode 100755
index 0000000000..dfd52ac2cc
--- /dev/null
+++ b/tests/qemu-iotests/tests/iothreads-stream
@@ -0,0 +1,73 @@
+#!/usr/bin/env python3
+# group: rw quick auto
+#
+# Copyright (C) 2023 Red Hat, Inc.
+#
+# This program is free software; you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation; either version 2 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program. If not, see <http://www.gnu.org/licenses/>.
+#
+# Creator/Owner: Kevin Wolf <kwolf@redhat.com>
+
+import iotests
+
+iotests.script_initialize(supported_fmts=['qcow2'],
+ supported_platforms=['linux'])
+iotests.verify_virtio_scsi_pci_or_ccw()
+
+with iotests.FilePath('disk1.img') as base1_path, \
+ iotests.FilePath('disk1-snap.img') as snap1_path, \
+ iotests.FilePath('disk2.img') as base2_path, \
+ iotests.FilePath('disk2-snap.img') as snap2_path, \
+ iotests.VM() as vm:
+
+ img_size = '10M'
+
+ # Only one iothread for both disks
+ vm.add_object('iothread,id=iothread0')
+ vm.add_device('virtio-scsi,iothread=iothread0')
+
+ iotests.log('Preparing disks...')
+ for i, base_path, snap_path in ((0, base1_path, snap1_path),
+ (1, base2_path, snap2_path)):
+ iotests.qemu_img_create('-f', iotests.imgfmt, base_path, img_size)
+ iotests.qemu_img_create('-f', iotests.imgfmt, '-b', base_path,
+ '-F', iotests.imgfmt, snap_path)
+
+ iotests.qemu_io_log('-c', f'write 0 {img_size}', base_path)
+
+ vm.add_blockdev(f'file,node-name=disk{i}-base-file,filename={base_path}')
+ vm.add_blockdev(f'qcow2,node-name=disk{i}-base,file=disk{i}-base-file')
+ vm.add_blockdev(f'file,node-name=disk{i}-file,filename={snap_path}')
+ vm.add_blockdev(f'qcow2,node-name=disk{i},file=disk{i}-file,'
+ f'backing=disk{i}-base')
+ vm.add_device(f'scsi-hd,drive=disk{i}')
+
+ iotests.log('Launching VM...')
+ vm.launch()
+
+ iotests.log('Starting stream jobs...')
+ iotests.log(vm.qmp('block-stream', device='disk0', job_id='job0'))
+ iotests.log(vm.qmp('block-stream', device='disk1', job_id='job1'))
+
+ finished = 0
+ while True:
+ try:
+ ev = vm.event_wait('JOB_STATUS_CHANGE', timeout=0.1)
+ if ev is not None and ev['data']['status'] == 'null':
+ finished += 1
+ # The test is done once both jobs are gone
+ if finished == 2:
+ break
+ except TimeoutError:
+ pass
+ vm.cmd('query-jobs')
diff --git a/tests/qemu-iotests/tests/iothreads-stream.out b/tests/qemu-iotests/tests/iothreads-stream.out
new file mode 100644
index 0000000000..ef134165e5
--- /dev/null
+++ b/tests/qemu-iotests/tests/iothreads-stream.out
@@ -0,0 +1,11 @@
+Preparing disks...
+wrote 10485760/10485760 bytes at offset 0
+10 MiB, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec)
+
+wrote 10485760/10485760 bytes at offset 0
+10 MiB, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec)
+
+Launching VM...
+Starting stream jobs...
+{"return": {}}
+{"return": {}}
--
2.41.0
next prev parent reply other threads:[~2023-11-15 17:21 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-11-15 17:20 [PATCH for-8.2 0/4] block: Fix deadlocks with the stream job Kevin Wolf
2023-11-15 17:20 ` [PATCH for-8.2 1/4] block: Fix bdrv_graph_wrlock() call in blk_remove_bs() Kevin Wolf
2023-11-15 17:20 ` [PATCH for-8.2 2/4] block: Fix deadlocks in bdrv_graph_wrunlock() Kevin Wolf
2023-11-15 17:20 ` [PATCH for-8.2 3/4] stream: Fix AioContext locking during bdrv_graph_wrlock() Kevin Wolf
2023-11-15 17:20 ` Kevin Wolf [this message]
2023-11-15 18:36 ` [PATCH for-8.2 0/4] block: Fix deadlocks with the stream job Stefan Hajnoczi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20231115172012.112727-5-kwolf@redhat.com \
--to=kwolf@redhat.com \
--cc=hreitz@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=stefanha@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.