From: Jason Wang <jasowang@redhat.com>
To: Si-Wei Liu <si-wei.liu@oracle.com>,
"Zhu, Lingshan" <lingshan.zhu@intel.com>,
Parav Pandit <parav@nvidia.com>,
"mst@redhat.com" <mst@redhat.com>, Eli Cohen <elic@nvidia.com>
Cc: "netdev@vger.kernel.org" <netdev@vger.kernel.org>,
"gautam.dawar@amd.com" <gautam.dawar@amd.com>,
"virtualization@lists.linux-foundation.org"
<virtualization@lists.linux-foundation.org>,
"xieyongji@bytedance.com" <xieyongji@bytedance.com>
Subject: Re: [PATCH V3 4/6] vDPA: !FEATURES_OK should not block querying device config space
Date: Thu, 28 Jul 2022 10:06:12 +0800 [thread overview]
Message-ID: <c8bd5396-84f2-e782-79d7-f493aca95781@redhat.com> (raw)
In-Reply-To: <8002554a-a77c-7b25-8f99-8d68248a741d@oracle.com>
在 2022/7/28 08:56, Si-Wei Liu 写道:
>
>
> On 7/27/2022 4:47 AM, Zhu, Lingshan wrote:
>>
>>
>> On 7/27/2022 5:43 PM, Si-Wei Liu wrote:
>>> Sorry to chime in late in the game. For some reason I couldn't get
>>> to most emails for this discussion (I only subscribed to the
>>> virtualization list), while I was taking off amongst the past few
>>> weeks.
>>>
>>> It looks to me this patch is incomplete. Noted down the way in
>>> vdpa_dev_net_config_fill(), we have the following:
>>> features = vdev->config->get_driver_features(vdev);
>>> if (nla_put_u64_64bit(msg, VDPA_ATTR_DEV_NEGOTIATED_FEATURES, features,
>>> VDPA_ATTR_PAD))
>>> return -EMSGSIZE;
>>>
>>> Making call to .get_driver_features() doesn't make sense when
>>> feature negotiation isn't complete. Neither should present
>>> negotiated_features to userspace before negotiation is done.
>>>
>>> Similarly, max_vqp through vdpa_dev_net_mq_config_fill() probably
>>> should not show before negotiation is done - it depends on driver
>>> features negotiated.
>> I have another patch in this series introduces device_features and
>> will report device_features to the userspace even features
>> negotiation not done. Because the spec says we should allow driver
>> access the config space before FEATURES_OK.
> The config space can be accessed by guest before features_ok doesn't
> necessarily mean the value is valid.
It's valid as long as the device offers the feature:
"The device MUST allow reading of any device-specific configuration
field before FEATURES_OK is set by the driver. This includes fields
which are conditional on feature bits, as long as those feature bits are
offered by the device."
> You may want to double check with Michael for what he quoted earlier:
>> Nope:
>>
>> 2.5.1 Driver Requirements: Device Configuration Space
>>
>> ...
>>
>> For optional configuration space fields, the driver MUST check that the corresponding feature is offered
>> before accessing that part of the configuration space.
>
> and how many driver bugs taking wrong assumption of the validity of
> config space field without features_ok. I am not sure what use case
> you want to expose config resister values for before features_ok, if
> it's mostly for live migration I guess it's probably heading a wrong
> direction.
I guess it's not for migration. For migration, a provision with the
correct features/capability would be sufficient.
Thanks
>
>
>>>
>>>
>>> Last but not the least, this "vdpa dev config" command was not
>>> designed to display the real config space register values in the
>>> first place. Quoting the vdpa-dev(8) man page:
>>>
>>>> vdpa dev config show - Show configuration of specific device or all
>>>> devices.
>>>> DEV - specifies the vdpa device to show its configuration. If this
>>>> argument is omitted all devices configuration is listed.
>>> It doesn't say anything about configuration space or register values
>>> in config space. As long as it can convey the config attribute when
>>> instantiating vDPA device instance, and more importantly, the config
>>> can be easily imported from or exported to userspace tools when
>>> trying to reconstruct vdpa instance intact on destination host for
>>> live migration, IMHO in my personal interpretation it doesn't matter
>>> what the config space may present. It may be worth while adding a
>>> new debug command to expose the real register value, but that's
>>> another story.
>> I am not sure getting your points. vDPA now reports device feature
>> bits(device_features) and negotiated feature bits(driver_features),
>> and yes, the drivers features can be a subset of the device features;
>> and the vDPA device features can be a subset of the management device
>> features.
> What I said is after unblocking the conditional check, you'd have to
> handle the case for each of the vdpa attribute when feature
> negotiation is not yet done: basically the register values you got
> from config space via the vdpa_get_config_unlocked() call is not
> considered to be valid before features_ok (per-spec). Although in some
> case you may get sane value, such behavior is generally undefined. If
> you desire to show just the device_features alone without any config
> space field, which the device had advertised *before feature
> negotiation is complete*, that'll be fine. But looks to me this is not
> how patch has been implemented. Probably need some more work?
>
> Regards,
> -Siwei
>
>>>
>>> Having said, please consider to drop the Fixes tag, as appears to me
>>> you're proposing a new feature rather than fixing a real issue.
>> it's a new feature to report the device feature bits than only
>> negotiated features, however this patch is a must, or it will block
>> the device feature bits reporting. but I agree, the fix tag is not a
>> must.
>>>
>>> Thanks,
>>> -Siwei
>>>
>>> On 7/1/2022 3:12 PM, Parav Pandit via Virtualization wrote:
>>>>> From: Zhu Lingshan<lingshan.zhu@intel.com>
>>>>> Sent: Friday, July 1, 2022 9:28 AM
>>>>>
>>>>> Users may want to query the config space of a vDPA device, to choose a
>>>>> appropriate one for a certain guest. This means the users need to read the
>>>>> config space before FEATURES_OK, and the existence of config space
>>>>> contents does not depend on FEATURES_OK.
>>>>>
>>>>> The spec says:
>>>>> The device MUST allow reading of any device-specific configuration field
>>>>> before FEATURES_OK is set by the driver. This includes fields which are
>>>>> conditional on feature bits, as long as those feature bits are offered by the
>>>>> device.
>>>>>
>>>>> Fixes: 30ef7a8ac8a07 (vdpa: Read device configuration only if FEATURES_OK)
>>>> Fix is fine, but fixes tag needs correction described below.
>>>>
>>>> Above commit id is 13 letters should be 12.
>>>> And
>>>> It should be in format
>>>> Fixes: 30ef7a8ac8a0 ("vdpa: Read device configuration only if FEATURES_OK")
>>>>
>>>> Please use checkpatch.pl script before posting the patches to catch these errors.
>>>> There is a bot that looks at the fixes tag and identifies the right kernel version to apply this fix.
>>>>
>>>>> Signed-off-by: Zhu Lingshan<lingshan.zhu@intel.com>
>>>>> ---
>>>>> drivers/vdpa/vdpa.c | 8 --------
>>>>> 1 file changed, 8 deletions(-)
>>>>>
>>>>> diff --git a/drivers/vdpa/vdpa.c b/drivers/vdpa/vdpa.c index
>>>>> 9b0e39b2f022..d76b22b2f7ae 100644
>>>>> --- a/drivers/vdpa/vdpa.c
>>>>> +++ b/drivers/vdpa/vdpa.c
>>>>> @@ -851,17 +851,9 @@ vdpa_dev_config_fill(struct vdpa_device *vdev,
>>>>> struct sk_buff *msg, u32 portid, {
>>>>> u32 device_id;
>>>>> void *hdr;
>>>>> - u8 status;
>>>>> int err;
>>>>>
>>>>> down_read(&vdev->cf_lock);
>>>>> - status = vdev->config->get_status(vdev);
>>>>> - if (!(status & VIRTIO_CONFIG_S_FEATURES_OK)) {
>>>>> - NL_SET_ERR_MSG_MOD(extack, "Features negotiation not
>>>>> completed");
>>>>> - err = -EAGAIN;
>>>>> - goto out;
>>>>> - }
>>>>> -
>>>>> hdr = genlmsg_put(msg, portid, seq, &vdpa_nl_family, flags,
>>>>> VDPA_CMD_DEV_CONFIG_GET);
>>>>> if (!hdr) {
>>>>> --
>>>>> 2.31.1
>>>> _______________________________________________
>>>> Virtualization mailing list
>>>> Virtualization@lists.linux-foundation.org
>>>> https://lists.linuxfoundation.org/mailman/listinfo/virtualization
>>>
>>
>
_______________________________________________
Virtualization mailing list
Virtualization@lists.linux-foundation.org
https://lists.linuxfoundation.org/mailman/listinfo/virtualization
next prev parent reply other threads:[~2022-07-28 2:06 UTC|newest]
Thread overview: 72+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <20220701132826.8132-1-lingshan.zhu@intel.com>
[not found] ` <20220701132826.8132-4-lingshan.zhu@intel.com>
2022-07-01 22:02 ` [PATCH V3 3/6] vDPA: allow userspace to query features of a vDPA device Parav Pandit via Virtualization
2022-07-04 4:46 ` Jason Wang
2022-07-04 12:53 ` Parav Pandit via Virtualization
[not found] ` <1e1e5f8c-d20e-4e54-5fc0-e12a7ba818a3@intel.com>
2022-07-05 11:56 ` Parav Pandit via Virtualization
[not found] ` <a59209f3-9005-b9f6-6f27-e136443aa3e1@intel.com>
2022-07-05 17:01 ` Parav Pandit via Virtualization
[not found] ` <814143c9-b7ab-a1c7-c5e2-cff8b024fc2f@intel.com>
2022-07-06 2:28 ` Parav Pandit via Virtualization
[not found] ` <cbd81bad-b188-2895-4606-326eac36b02f@intel.com>
2022-07-24 15:23 ` Parav Pandit via Virtualization
2022-07-27 8:15 ` Si-Wei Liu
[not found] ` <bfd46eb1-bc82-b1c8-f492-7bcaaada8aa4@intel.com>
2022-07-08 16:13 ` Parav Pandit via Virtualization
[not found] ` <20220701132826.8132-6-lingshan.zhu@intel.com>
2022-07-01 22:07 ` [PATCH V3 5/6] vDPA: answer num of queue pairs = 1 to userspace when VIRTIO_NET_F_MQ == 0 Parav Pandit via Virtualization
[not found] ` <ef1c42e8-2350-dd9c-c6c0-2e9bbe85adb4@intel.com>
2022-07-08 16:23 ` Parav Pandit via Virtualization
[not found] ` <00c1f5e8-e58d-5af7-cc6b-b29398e17c8b@intel.com>
2022-07-12 16:48 ` Parav Pandit via Virtualization
[not found] ` <c7c8f49c-484f-f5b3-39e6-0d17f396cca7@intel.com>
2022-07-13 3:06 ` Parav Pandit via Virtualization
[not found] ` <1246d2f1-2822-0edb-cd57-efc4015f05a2@intel.com>
2022-07-26 15:56 ` Parav Pandit via Virtualization
2022-07-26 19:52 ` Michael S. Tsirkin
2022-07-26 20:49 ` Parav Pandit via Virtualization
[not found] ` <19681358-fc81-be5b-c20b-7394a549f0be@intel.com>
2022-07-27 2:17 ` Parav Pandit via Virtualization
[not found] ` <e98fc062-021b-848b-5cf4-15bd63a11c5c@intel.com>
2022-07-27 3:47 ` Parav Pandit via Virtualization
2022-07-27 6:01 ` Michael S. Tsirkin
2022-07-27 6:54 ` Jason Wang
2022-07-27 9:02 ` Michael S. Tsirkin
2022-07-27 9:50 ` Jason Wang
2022-07-27 15:45 ` Michael S. Tsirkin
2022-07-28 1:21 ` Jason Wang
[not found] ` <459524bc-0e21-422b-31c1-39745fd25fac@intel.com>
2022-07-28 5:53 ` Jason Wang
2022-07-28 6:41 ` Michael S. Tsirkin
2022-08-01 4:50 ` Jason Wang
[not found] ` <4925d1db-51d1-148a-72e0-2347b20e82f4@intel.com>
2022-07-27 6:56 ` Jason Wang
2022-07-27 9:05 ` Michael S. Tsirkin
2022-07-27 7:50 ` Si-Wei Liu
2022-07-27 9:01 ` Michael S. Tsirkin
2022-07-27 10:09 ` Si-Wei Liu
2022-07-27 15:48 ` Michael S. Tsirkin
2022-07-28 7:22 ` Si-Wei Liu
[not found] ` <939bc589-b3ad-d317-8b1d-6da58e4670c0@intel.com>
2022-07-28 1:41 ` Si-Wei Liu
[not found] ` <685241b9-3487-489c-2784-2a2209f660ad@intel.com>
2022-07-28 21:54 ` Si-Wei Liu
2022-07-13 5:26 ` Michael S. Tsirkin
2022-07-26 15:54 ` Parav Pandit via Virtualization
2022-07-26 19:48 ` Michael S. Tsirkin
2022-07-26 20:53 ` Parav Pandit via Virtualization
[not found] ` <20220701132826.8132-5-lingshan.zhu@intel.com>
2022-07-01 22:12 ` [PATCH V3 4/6] vDPA: !FEATURES_OK should not block querying device config space Parav Pandit via Virtualization
2022-07-13 5:23 ` Michael S. Tsirkin
2022-07-27 9:43 ` Si-Wei Liu
[not found] ` <63242254-ba84-6810-dad8-34f900b97f2f@intel.com>
2022-07-28 0:56 ` Si-Wei Liu
2022-07-28 2:06 ` Jason Wang [this message]
2022-07-28 7:08 ` Si-Wei Liu
2022-07-28 7:36 ` Jason Wang
2022-07-28 8:20 ` spec clarification (was Re: [PATCH V3 4/6] vDPA: !FEATURES_OK should not block querying device config space) Si-Wei Liu
2022-07-28 11:28 ` Michael S. Tsirkin
2022-07-28 11:35 ` [PATCH V3 4/6] vDPA: !FEATURES_OK should not block querying device config space Michael S. Tsirkin
2022-07-28 22:12 ` Si-Wei Liu
[not found] ` <00e2e07e-1a2e-7af8-a060-cc9034e0d33f@intel.com>
2022-07-28 21:48 ` Si-Wei Liu
[not found] ` <c143e2da-208e-b046-9b8f-1780f75ed3e6@intel.com>
2022-07-29 20:55 ` Si-Wei Liu
2022-08-01 4:44 ` Jason Wang
2022-08-01 22:53 ` Si-Wei Liu
2022-08-01 22:58 ` Si-Wei Liu
2022-08-02 6:33 ` Jason Wang
2022-08-03 1:26 ` Si-Wei Liu
[not found] ` <213dec42-bd3d-2b5c-9003-276bc2a9f649@intel.com>
2022-08-03 23:09 ` Si-Wei Liu
[not found] ` <20220701132826.8132-3-lingshan.zhu@intel.com>
2022-07-04 4:43 ` [PATCH V3 2/6] vDPA/ifcvf: support userspace to query features and MQ of a management device Jason Wang
[not found] ` <20220701132826.8132-2-lingshan.zhu@intel.com>
2022-07-04 4:39 ` [PATCH V3 1/6] vDPA/ifcvf: get_config_size should return a value no greater than dev implementation Jason Wang
[not found] ` <b2b2fb5e-c1c2-84b6-0315-a6eef121cdac@intel.com>
2022-07-13 5:44 ` Michael S. Tsirkin
2022-07-13 5:31 ` Michael S. Tsirkin
[not found] ` <20220701132826.8132-7-lingshan.zhu@intel.com>
2022-07-01 22:18 ` [PATCH V3 6/6] vDPA: fix 'cast to restricted le16' warnings in vdpa.c Parav Pandit via Virtualization
[not found] ` <dea8be07-bc25-192c-ecd7-636cbdb2a629@intel.com>
2022-07-08 16:08 ` Parav Pandit via Virtualization
2022-07-29 8:53 ` Michael S. Tsirkin
[not found] ` <7ce4da7f-80aa-14d6-8200-c7f928f32b48@intel.com>
2022-07-29 9:17 ` Michael S. Tsirkin
[not found] ` <50b4e7ba-3e49-24b7-5c23-d8a76c61c924@intel.com>
2022-07-29 9:23 ` Michael S. Tsirkin
[not found] ` <05bf4c84-28dd-4956-4719-3a5361d151d8@intel.com>
2022-07-29 9:39 ` Michael S. Tsirkin
[not found] ` <87efac3e-2196-f9ad-1af1-a27470824eac@intel.com>
2022-07-29 10:16 ` Michael S. Tsirkin
2022-08-01 4:33 ` Jason Wang
2022-08-01 6:25 ` Michael S. Tsirkin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=c8bd5396-84f2-e782-79d7-f493aca95781@redhat.com \
--to=jasowang@redhat.com \
--cc=elic@nvidia.com \
--cc=gautam.dawar@amd.com \
--cc=lingshan.zhu@intel.com \
--cc=mst@redhat.com \
--cc=netdev@vger.kernel.org \
--cc=parav@nvidia.com \
--cc=si-wei.liu@oracle.com \
--cc=virtualization@lists.linux-foundation.org \
--cc=xieyongji@bytedance.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).