From: "Michael S. Tsirkin" <mst@redhat.com>
To: Stefan Hajnoczi <stefanha@gmail.com>
Cc: Thomas Huth <thuth@redhat.com>,
Stefano Garzarella <sgarzare@redhat.com>,
Changpeng Liu <changpeng.liu@intel.com>,
Laurent Vivier <lvivier@redhat.com>,
Kevin Wolf <kwolf@redhat.com>,
qemu-block@nongnu.org, qemu-devel@nongnu.org,
Max Reitz <mreitz@redhat.com>,
Stefan Hajnoczi <stefanha@redhat.com>,
Paolo Bonzini <pbonzini@redhat.com>,
virtio-comment@lists.oasis-open.org
Subject: [virtio-comment] Re: [Qemu-devel] [PATCH RFC 2/2] tests/virtio-blk: add test for WRITE_ZEROES command
Date: Fri, 25 Jan 2019 14:17:01 -0500 [thread overview]
Message-ID: <20190125141502-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <20190125151245.GD28305@stefanha-x1.localdomain>
On Fri, Jan 25, 2019 at 03:12:45PM +0000, Stefan Hajnoczi wrote:
> On Fri, Jan 25, 2019 at 09:49:03AM +0100, Thomas Huth wrote:
> > On 2019-01-25 09:16, Stefano Garzarella wrote:
> > > On Fri, Jan 25, 2019 at 07:07:35AM +0100, Thomas Huth wrote:
> > >> On 2019-01-25 07:01, Thomas Huth wrote:
> > >>> On 2019-01-24 18:23, Stefano Garzarella wrote:
> > >>>> If the WRITE_ZEROES feature is enabled, we check this
> > >>>> command in the test_basic().
> > >>>>
> > >>>> Signed-off-by: Stefano Garzarella <sgarzare@redhat.com>
> > >>>> ---
> > >>>> tests/virtio-blk-test.c | 63 +++++++++++++++++++++++++++++++++++++++++
> > >>>> 1 file changed, 63 insertions(+)
> > >>>>
> > >>>> diff --git a/tests/virtio-blk-test.c b/tests/virtio-blk-test.c
> > >>>> index 04c608764b..8cabbcb85a 100644
> > >>>> --- a/tests/virtio-blk-test.c
> > >>>> +++ b/tests/virtio-blk-test.c
> > >>>> @@ -231,6 +231,69 @@ static void test_basic(QVirtioDevice *dev, QGuestAllocator *alloc,
> > >>>>
> > >>>> guest_free(alloc, req_addr);
> > >>>>
> > >>>> + if (features & (1u << VIRTIO_BLK_F_WRITE_ZEROES)) {
> > >>>> + struct virtio_blk_discard_write_zeroes *dwz_hdr;
> > >>>> + void *expected;
> > >>>> +
> > >>>> + /*
> > >>>> + * WRITE_ZEROES request on the same sector of previous test where
> > >>>> + * we wrote "TEST".
> > >>>> + */
> > >>>> + req.type = VIRTIO_BLK_T_WRITE_ZEROES;
> > >>>> + req.data = g_malloc0(512);
> > >>>
> > >>> Wouldn't it be more interesting to do a memset(req.data, 0xaa, 512) or
> > >>> something similar here, to see whether zeroes or 0xaa is written?
> > >>
> > >> Ah, never mind, I thought req.data would be a sector buffer here, but
> > >> looking at the lines below, it apparently is something different.
> > >>
> > >> Why do you allocate 512 bytes here? I'd rather expect
> > >> g_malloc0(sizeof(struct virtio_blk_discard_write_zeroes)) here. ... and
> > >> then you could also use a local "struct virtio_blk_discard_write_zeroes
> > >> dwz_hdr" variable instead of a pointer, and drop the g_malloc0() completely?
> > >>
> > >
> > > Hi Thomas,
> > > it was my initial implementation, but on the first test I discovered
> > > that virtio_blk_request() has an assert on the data_size and it requires
> > > a multiple of 512 bytes.
> > > Then I looked at the virtio-spec #1, and it seems that data should be
> > > multiple of 512 bytes also if it contains the struct
> > > virtio_blk_discard_write_zeroes. (I'm not sure)
> > >
> > > Anyway I tried to allocate only the space for that struct, commented the
> > > assert and the test works well.
> > >
> > > How do you suggest to proceed?
> >
> > Wow, that's a tough question. Looking at the virtio spec, I agree with
> > you, it looks like struct virtio_blk_discard_write_zeroes should be
> > padded to 512 bytes here. But when I look at the Linux sources
> > (drivers/block/virtio_blk.c), I fail to see that they are doing the
> > padding there (but maybe I'm just too blind).
>
> The only evidence for "pad to 512 bytes" interpretation that I see in
> the spec is "u8 data[][512];". Or have I missed something more
> explicit?
That's it. But if it doesn't mean "any number of 512 byte chunks"
then what does it mean?
> Based on the Linux guest driver code and the lack of more evidence in
> the spec, I'm pretty sure data[] doesn't need to be padded to 512 bytes
> for discard/write zero requests.
OK. Must devices support such padding?
> > Looking at the QEMU sources, it seems like it can deal with both and
> > always sets the status right behind the last byte:
> >
> > req->in = (void *)in_iov[in_num - 1].iov_base
> > + in_iov[in_num - 1].iov_len
> > - sizeof(struct virtio_blk_inhdr);
> >
> > Anyway, I think the virtio spec should be clearer here to avoid bad
> > implementations in the future, so maybe Changpeng or Michael could
> > update the spec here a little bit?
>
> Yep, good point. VIRTIO 1.1 is available for public comments, so I've
> CCed the list.
>
> Stefan
Thanks!
Care creating a github issue? And maybe proposing a spec patch.
> > Thomas
> >
> >
> > > [1](https://github.com/oasis-tcs/virtio-spec/blob/master/content.tex#L3944)
> > >
> > >
> > > Thanks,
> > > Stefano
> > >
> >
> >
This publicly archived list offers a means to provide input to the
OASIS Virtual I/O Device (VIRTIO) TC.
In order to verify user consent to the Feedback License terms and
to minimize spam in the list archive, subscription is required
before posting.
Subscribe: virtio-comment-subscribe@lists.oasis-open.org
Unsubscribe: virtio-comment-unsubscribe@lists.oasis-open.org
List help: virtio-comment-help@lists.oasis-open.org
List archive: https://lists.oasis-open.org/archives/virtio-comment/
Feedback License: https://www.oasis-open.org/who/ipr/feedback_license.pdf
List Guidelines: https://www.oasis-open.org/policies-guidelines/mailing-lists
Committee: https://www.oasis-open.org/committees/virtio/
Join OASIS: https://www.oasis-open.org/join/
WARNING: multiple messages have this Message-ID (diff)
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Stefan Hajnoczi <stefanha@gmail.com>
Cc: Thomas Huth <thuth@redhat.com>,
Stefano Garzarella <sgarzare@redhat.com>,
Changpeng Liu <changpeng.liu@intel.com>,
Laurent Vivier <lvivier@redhat.com>,
Kevin Wolf <kwolf@redhat.com>,
qemu-block@nongnu.org, qemu-devel@nongnu.org,
Max Reitz <mreitz@redhat.com>,
Stefan Hajnoczi <stefanha@redhat.com>,
Paolo Bonzini <pbonzini@redhat.com>,
virtio-comment@lists.oasis-open.org
Subject: Re: [Qemu-devel] [PATCH RFC 2/2] tests/virtio-blk: add test for WRITE_ZEROES command
Date: Fri, 25 Jan 2019 14:17:01 -0500 [thread overview]
Message-ID: <20190125141502-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <20190125151245.GD28305@stefanha-x1.localdomain>
On Fri, Jan 25, 2019 at 03:12:45PM +0000, Stefan Hajnoczi wrote:
> On Fri, Jan 25, 2019 at 09:49:03AM +0100, Thomas Huth wrote:
> > On 2019-01-25 09:16, Stefano Garzarella wrote:
> > > On Fri, Jan 25, 2019 at 07:07:35AM +0100, Thomas Huth wrote:
> > >> On 2019-01-25 07:01, Thomas Huth wrote:
> > >>> On 2019-01-24 18:23, Stefano Garzarella wrote:
> > >>>> If the WRITE_ZEROES feature is enabled, we check this
> > >>>> command in the test_basic().
> > >>>>
> > >>>> Signed-off-by: Stefano Garzarella <sgarzare@redhat.com>
> > >>>> ---
> > >>>> tests/virtio-blk-test.c | 63 +++++++++++++++++++++++++++++++++++++++++
> > >>>> 1 file changed, 63 insertions(+)
> > >>>>
> > >>>> diff --git a/tests/virtio-blk-test.c b/tests/virtio-blk-test.c
> > >>>> index 04c608764b..8cabbcb85a 100644
> > >>>> --- a/tests/virtio-blk-test.c
> > >>>> +++ b/tests/virtio-blk-test.c
> > >>>> @@ -231,6 +231,69 @@ static void test_basic(QVirtioDevice *dev, QGuestAllocator *alloc,
> > >>>>
> > >>>> guest_free(alloc, req_addr);
> > >>>>
> > >>>> + if (features & (1u << VIRTIO_BLK_F_WRITE_ZEROES)) {
> > >>>> + struct virtio_blk_discard_write_zeroes *dwz_hdr;
> > >>>> + void *expected;
> > >>>> +
> > >>>> + /*
> > >>>> + * WRITE_ZEROES request on the same sector of previous test where
> > >>>> + * we wrote "TEST".
> > >>>> + */
> > >>>> + req.type = VIRTIO_BLK_T_WRITE_ZEROES;
> > >>>> + req.data = g_malloc0(512);
> > >>>
> > >>> Wouldn't it be more interesting to do a memset(req.data, 0xaa, 512) or
> > >>> something similar here, to see whether zeroes or 0xaa is written?
> > >>
> > >> Ah, never mind, I thought req.data would be a sector buffer here, but
> > >> looking at the lines below, it apparently is something different.
> > >>
> > >> Why do you allocate 512 bytes here? I'd rather expect
> > >> g_malloc0(sizeof(struct virtio_blk_discard_write_zeroes)) here. ... and
> > >> then you could also use a local "struct virtio_blk_discard_write_zeroes
> > >> dwz_hdr" variable instead of a pointer, and drop the g_malloc0() completely?
> > >>
> > >
> > > Hi Thomas,
> > > it was my initial implementation, but on the first test I discovered
> > > that virtio_blk_request() has an assert on the data_size and it requires
> > > a multiple of 512 bytes.
> > > Then I looked at the virtio-spec #1, and it seems that data should be
> > > multiple of 512 bytes also if it contains the struct
> > > virtio_blk_discard_write_zeroes. (I'm not sure)
> > >
> > > Anyway I tried to allocate only the space for that struct, commented the
> > > assert and the test works well.
> > >
> > > How do you suggest to proceed?
> >
> > Wow, that's a tough question. Looking at the virtio spec, I agree with
> > you, it looks like struct virtio_blk_discard_write_zeroes should be
> > padded to 512 bytes here. But when I look at the Linux sources
> > (drivers/block/virtio_blk.c), I fail to see that they are doing the
> > padding there (but maybe I'm just too blind).
>
> The only evidence for "pad to 512 bytes" interpretation that I see in
> the spec is "u8 data[][512];". Or have I missed something more
> explicit?
That's it. But if it doesn't mean "any number of 512 byte chunks"
then what does it mean?
> Based on the Linux guest driver code and the lack of more evidence in
> the spec, I'm pretty sure data[] doesn't need to be padded to 512 bytes
> for discard/write zero requests.
OK. Must devices support such padding?
> > Looking at the QEMU sources, it seems like it can deal with both and
> > always sets the status right behind the last byte:
> >
> > req->in = (void *)in_iov[in_num - 1].iov_base
> > + in_iov[in_num - 1].iov_len
> > - sizeof(struct virtio_blk_inhdr);
> >
> > Anyway, I think the virtio spec should be clearer here to avoid bad
> > implementations in the future, so maybe Changpeng or Michael could
> > update the spec here a little bit?
>
> Yep, good point. VIRTIO 1.1 is available for public comments, so I've
> CCed the list.
>
> Stefan
Thanks!
Care creating a github issue? And maybe proposing a spec patch.
> > Thomas
> >
> >
> > > [1](https://github.com/oasis-tcs/virtio-spec/blob/master/content.tex#L3944)
> > >
> > >
> > > Thanks,
> > > Stefano
> > >
> >
> >
next prev parent reply other threads:[~2019-01-25 19:17 UTC|newest]
Thread overview: 28+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-01-24 17:23 [Qemu-devel] [PATCH RFC 0/2] virtio-blk: add DISCARD and WRITE ZEROES features Stefano Garzarella
2019-01-24 17:23 ` [Qemu-devel] [PATCH RFC 1/2] " Stefano Garzarella
2019-01-24 17:55 ` Dr. David Alan Gilbert
2019-01-24 18:31 ` Stefano Garzarella
2019-01-25 14:58 ` Stefan Hajnoczi
2019-01-25 16:18 ` Stefano Garzarella
2019-01-27 12:51 ` Stefan Hajnoczi
2019-01-28 8:28 ` Stefano Garzarella
2019-01-24 17:23 ` [Qemu-devel] [PATCH RFC 2/2] tests/virtio-blk: add test for WRITE_ZEROES command Stefano Garzarella
2019-01-25 6:01 ` Thomas Huth
2019-01-25 6:07 ` Thomas Huth
2019-01-25 8:16 ` Stefano Garzarella
2019-01-25 8:49 ` Thomas Huth
2019-01-25 11:58 ` Liu, Changpeng
2019-01-25 12:48 ` Thomas Huth
2019-01-25 19:18 ` Michael S. Tsirkin
2019-01-25 15:12 ` Stefan Hajnoczi
2019-01-25 19:17 ` Michael S. Tsirkin [this message]
2019-01-25 19:17 ` Michael S. Tsirkin
2019-01-27 12:57 ` Stefan Hajnoczi
2019-01-27 18:42 ` [virtio-comment] " Michael S. Tsirkin
2019-01-27 18:42 ` Michael S. Tsirkin
2019-01-30 7:39 ` [virtio-comment] " Stefan Hajnoczi
2019-01-30 7:39 ` Stefan Hajnoczi
2019-01-30 7:59 ` [virtio-comment] " Liu, Changpeng
2019-01-30 7:59 ` Liu, Changpeng
2019-01-25 19:14 ` Michael S. Tsirkin
2019-01-25 6:07 ` Thomas Huth
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20190125141502-mutt-send-email-mst@kernel.org \
--to=mst@redhat.com \
--cc=changpeng.liu@intel.com \
--cc=kwolf@redhat.com \
--cc=lvivier@redhat.com \
--cc=mreitz@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=sgarzare@redhat.com \
--cc=stefanha@gmail.com \
--cc=stefanha@redhat.com \
--cc=thuth@redhat.com \
--cc=virtio-comment@lists.oasis-open.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.