From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from lists1p.gnu.org (lists1p.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id F2FBB606A330 for ; Thu, 12 Nov 2026 11:51:19 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=k20260515 header.b=DGU5wj2e Received: from localhost ([::1] helo=lists1p.gnu.org) by lists1p.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1xRTKk-0005Vj-3S; Thu, 12 Nov 2026 06:51:14 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists1p.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1xRTJi-0004Oy-EL; Thu, 12 Nov 2026 06:50:16 -0500 Received: from sea.source.kernel.org ([2600:3c0a:e001:78e:0:1991:8:25]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1xRTJe-0001M1-P5; Thu, 12 Nov 2026 06:50:10 -0500 Received: from smtp.kernel.org (quasi.space.kernel.org [100.103.45.18]) by sea.source.kernel.org (Postfix) with ESMTP id D5C3241F35; Thu, 12 Nov 2026 11:49:56 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id BBF6D1F00A07; Thu, 12 Nov 2026 11:49:53 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1794484196; bh=PAth3kyvImzuFpouaGZ7RYU3EbBdgA6rh4Sylxo/y+o=; h=From:To:Cc:Subject:Date; b=DGU5wj2eXT97TsXzEIkp4D9bbuiwS4e58wOJCMRnSAW0C7MuYgrrF3MoZ0k03MMhJ oZzlYZ95Ok9zMidRvQbkyJX8cONuqf50uFbfXa9DSlMSuLy+7zzSKoRL0rVJpR4Moc TohYBXVZP+Ohr8wlzmG4ZQLHxT+T0o7xgOnoIb/HFhOs4RoiImPCwL+qpEgBoKuBv2 IIwQbG7Z6m87kzJEYgAmCtbfcK6S6h18ZgLaaCAHnW/nEo93GNjefL3hySCjhoE4Gr +oUbQ3UhRWau+WqLAmWQk2tLxqHlpsOOTFvNq4JJNU3AeUfkRZOOfil1Rq7FCpWOh1 2mXU6dt3tDqXw== From: Niklas Cassel To: qemu-devel@nongnu.org Cc: Damien Le Moal , Stefan Hajnoczi , Pierrick Bouvier , "Michael S. Tsirkin" , Hanna Reitz , Markus Armbruster , Kevin Wolf , Eric Blake , qemu-block@nongnu.org, Sam Li , Paolo Bonzini , Fam Zheng , Jeuk Kim , Daejun Park , Niklas Cassel Subject: [PATCH v17 0/9] Add full zoned storage emulation to the qcow2 driver Date: Thu, 12 Nov 2026 12:49:09 +0100 Message-ID: <20261112114918.1269168-1-cassel@kernel.org> X-Mailer: git-send-email 2.56.0 X-Archived-By: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=2600:3c0a:e001:78e:0:1991:8:25; envelope-from=cassel@kernel.org; helo=sea.source.kernel.org X-Spam_score_int: -43 X-Spam_score: -4.4 X-Spam_bar: ---- X-Spam_report: (-4.4 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_MED=-2.3, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: qemu development List-Archive: List-Post: List-Help: List-Subscribe: , Sender: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org X-Spam-Status: No, score=-18.8 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING,SPF_HELO_PASS, SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=4.0.1 X-Spam-Checker-Version: SpamAssassin 4.0.1 (2024-03-26) on aws-us-west-2-korg-listserv-alma10-1 This patch series adds a new extension - zoned format - to the qcow2 driver, allowing full zoned storage emulation on a qcow2 image file. A user can attach such an image to a guest and have it appear as a host-managed zoned block device. The zoned format is opt-in through a new qcow2 header extension that pins the zone geometry. Behind the extension is a dedicated zoned metadata region that stores one 8-byte write pointer (WP) per zone. The extension is gated by an incompatible bit, so an older qcow2 implementation cannot accidentally open the image. Each write pointer is routed through the write pointer cache, a Qcow2Cache object. The write pointer cache is written to disk after the qcow2 metadata is written, thus guaranteeing that the write pointer is updated after the corresponding data is written. Zone states are in memory. Read-only and offline states are device-internal events, which are not modelled in qcow2 emulation for simplicity. The other zone states (closed, empty, full) can be inferred from write pointer values, persistent across QEMU reboots. The open states are kept in memory using open zone lists. To create a qcow2 file with the zoned format: qemu-img create -f qcow2 zbc.qcow2 \ -o size=768M \ -o zone.size=64M \ -o zone.capacity=64M \ -o zone.conventional_zones=0 \ -o zone.max_open_zones=6 \ -o zone.max_active_zones=8 \ -o zone.mode=host-managed Then attach it to a guest via the QEMU command line: -blockdev node-name=drive1,driver=qcow2,file.driver=file,file.filename=zbc.qcow2 \ -device virtio-blk-pci,drive=drive1 \ Tested with blktests, fio, zbd_state (an internal test suite) and zonefs, comparing a zoned qcow2 image attached via virtio-blk with zloop, null_blk and scsi_debug (passed/failed/skipped): +--------------------+----------+---------+-----------+---------+ | Testrun | blktests | fio | zbd_state | zonefs | +--------------------+----------+---------+-----------+---------+ | zloop | 9/0/10 | 57/0/18 | 29/0/8 | 113/0/0 | | null_blk | 9/0/10 | 57/0/18 | 29/0/8 | 113/0/0 | | scsi_debug | 10/0/12 | 61/0/14 | 29/0/8 | 113/0/0 | | virtio-blk + qcow2 | 9/0/10 | 57/0/18 | 29/0/8 | 113/0/0 | +--------------------+----------+---------+-----------+---------+ The last two patches are not used by the qcow2 driver. Both Daejun Park's zoned UFS series and an upcoming series that adds zoned support to ATA depend on this series, and both also require these two patches, so they are included here, to avoid both series needing to carry them separately as dependencies. Git branch can be found at: https://github.com/floatious/qemu/tree/qcow2-v17 v16->v17: - Rebase on master (v11.2.0-rc0) - Report the errors of qcow2_check_zone_options() through errp instead of warn_report() (Stefan Hajnoczi) - Move the zone lists, the write pointer tracking and their fields in BDRVQcow2State from "qcow2: add configurations for zoned format extension" to "qcow2: add zoned emulation capability", the first patch that uses them (Stefan Hajnoczi) - Move the check that the zoned metadata fits in the image file to "qcow2: add zoned emulation capability" as well, where the zoned metadata is read. In the earlier patch, it checked an offset that was not byte-swapped yet. - Reject an image whose write pointer table starts at offset 0, where the image header is, or not on a cluster boundary: the write pointer cache reads and writes the table in whole clusters, aborts on an offset of 0, and marks the image corrupt on an unaligned one. Add a test for the same. - Declare variables at the start of blocks, as the coding style requires. - Pick up Stefan Hajnoczi's Reviewed-by on "qcow2: add configurations for zoned format extension" Niklas Cassel (5): block: define errnos for zone protocol errors qcow2: validate the write pointer table when opening an image virtio-blk: report zone errors with their zone status codes block: add accessors for the zone model, capacity and open zone limit scsi: add the sense codes of zoned block devices Sam Li (4): docs/qcow2: add the zoned format feature qcow2: add configurations for zoned format extension qcow2: add zoned emulation capability iotests: test the zoned format feature for qcow2 file MAINTAINERS | 1 + block/block-backend.c | 33 + block/io.c | 13 +- block/qcow2-cache.c | 11 +- block/qcow2-refcount.c | 18 + block/qcow2.c | 1724 ++++++++++++++++- block/qcow2.h | 86 +- block/trace-events | 10 + docs/interop/qcow2.rst | 115 +- docs/system/qemu-block-drivers.rst.inc | 44 + hw/block/block.c | 7 + hw/block/virtio-blk.c | 49 +- include/block/block-common.h | 17 + include/block/block-io.h | 6 + include/block/block_int-common.h | 12 + include/qemu/osdep.h | 6 + include/scsi/utils.h | 6 + include/system/block-backend-io.h | 3 + qapi/block-core.json | 86 +- scsi/utils.c | 15 + tests/qemu-iotests/031.out | 8 +- tests/qemu-iotests/036.out | 4 +- tests/qemu-iotests/061.out | 14 +- tests/qemu-iotests/082.out | 108 ++ tests/qemu-iotests/303.out | 4 +- tests/qemu-iotests/tests/qcow2-encryption.out | 4 +- tests/qemu-iotests/tests/zoned-qcow2 | 379 ++++ tests/qemu-iotests/tests/zoned-qcow2.out | 267 +++ 28 files changed, 3002 insertions(+), 48 deletions(-) create mode 100755 tests/qemu-iotests/tests/zoned-qcow2 create mode 100644 tests/qemu-iotests/tests/zoned-qcow2.out base-commit: 29760efaf96bbe5928f8111881eddbf5ac06439e -- 2.56.0