From: Heng Qi <hengqi@linux.alibaba.com>
To: "Michael S. Tsirkin" <mst@redhat.com>
Cc: Parav Pandit <parav@nvidia.com>,
"virtio-comment@lists.oasis-open.org"
<virtio-comment@lists.oasis-open.org>,
"virtio-dev@lists.oasis-open.org"
<virtio-dev@lists.oasis-open.org>,
Yuri Benditovich <yuri.benditovich@daynix.com>,
Xuan Zhuo <xuanzhuo@linux.alibaba.com>,
Jason Wang <jasowang@redhat.com>
Subject: [virtio-dev] Re: [virtio-comment] Re: [virtio-dev] Re: [virtio-comment] Re: [virtio-dev] RE: [virtio-comment] RE: [PATCH v19] virtio-net: support inner header hash
Date: Fri, 30 Jun 2023 22:04:08 +0800 [thread overview]
Message-ID: <38fe3702-ea32-0d4a-fe23-cc7dbc823415@linux.alibaba.com> (raw)
In-Reply-To: <20230630041337-mutt-send-email-mst@kernel.org>
在 2023/6/30 下午4:17, Michael S. Tsirkin 写道:
> On Fri, Jun 30, 2023 at 02:15:13PM +0800, Heng Qi wrote:
>>
>> 在 2023/6/30 下午1:59, Michael S. Tsirkin 写道:
>>> On Fri, Jun 30, 2023 at 09:55:41AM +0800, Heng Qi wrote:
>>>> 在 2023/6/30 上午9:36, Parav Pandit 写道:
>>>>>> From: Heng Qi <hengqi@linux.alibaba.com>
>>>>>> Sent: Thursday, June 29, 2023 8:54 PM
>>>>>>
>>>>>> On Thu, Jun 29, 2023 at 04:59:28PM +0000, Parav Pandit wrote:
>>>>>>>> From: Michael S. Tsirkin <mst@redhat.com>
>>>>>>>> Sent: Thursday, June 29, 2023 7:48 AM
>>>>>>>>>> struct virtio_net_hash_config reserved is fine.
>>>>>>>>> +1.
>>>>>>>>>
>>>>>>>>> Inner header hash is orthogonal to RSS, and it's fine to have its
>>>>>>>>> own structure and commands.
>>>>>>>>> There is no need to send additional RSS fields when we configure
>>>>>>>>> inner header hash.
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>> Not RSS, hash calculations. It's not critical, but I note that
>>>>>>>> practically you said you will enable this with symmetric hash so it
>>>>>>>> makes sense to me to send this in the same command with the key.
>>>>>>>>
>>>>>>> In the v19, we have,
>>>>>>>
>>>>>>> +\item[VIRTIO_NET_F_HASH_TUNNEL] Requires VIRTIO_NET_F_CTRL_VQ
>>>>>> along with VIRTIO_NET_F_RSS or VIRTIO_NET_F_HASH_REPORT.
>>>>>>> So it is done along with rss, so in same struct as rss config is fine.
>>>>>> Do you mean having both virtio_net_rss_config and virtio_net_hash_config
>>>>>> have enabled_hash_types?
>>>>>> Like this:
>>>>>>
>>>>>> struct virtio_net_rss_config {
>>>>>> le32 hash_types;
>>>>>> le16 indirection_table_mask;
>>>>>> struct rss_rq_id unclassified_queue;
>>>>>> struct rss_rq_id indirection_table[indirection_table_length];
>>>>>> le16 max_tx_vq;
>>>>>> u8 hash_key_length;
>>>>>> u8 hash_key_data[hash_key_length];
>>>>>> + le32 enabled_tunnel_types;
>>>>>> };
>>>>>>
>>>>>> struct virtio_net_hash_config {
>>>>>> le32 hash_types;
>>>>>> - le16 reserved[4];
>>>>>> + le32 enabled_tunnel_types;
>>>>>> + le16 reserved[2];
>>>>>> u8 hash_key_length;
>>>>>> u8 hash_key_data[hash_key_length];
>>>>>> };
>>> Oh, I forgot that rss and hash had identical structures.
>>> And we want to keep that I think.
>>>
>>> But now it's not clear to me: does the same enabled_tunnel_types
>>> apply to both hash calculation and rss?
>> Yes. What I'm trying to say is that making the inner header hash and
>> RSS/hash calculation clear delimitation will make everything easier.
>> The inner header hash just configures enabled_tunnel_types.
>> The RSS/hash calculation is configured as before without modification.
>>
>>> I note we normally have separate configs for hash and rss.
>>> So to keep it consistent what should we do? two set commands?
>> As I explained above, like outer udp port hash/symmetric toeplitz hash,
>> these fall under the umbrella of RSS/hash calculation.
> Yes but note that symmetric toeplitz hash has to be configured
> separately for RSS and for hashing.
Yes, this requires a field like \field{mode}, with different values
corresponding to different hashing algorithms, such as toeplitz or
symmetric toeplitz.
The outer port hash belongs to RSS/hash calculation.
>
>> Let's keep the inner header hash simple.
>>
>>> Or does enabled_tunnel_types apply to both rss and hash?
>> Certainly. See:
>>
>> +\item[VIRTIO_NET_F_HASH_TUNNEL] Requires VIRTIO_NET_F_CTRL_VQ along
>> with VIRTIO_NET_F_RSS or VIRTIO_NET_F_HASH_REPORT.
>
> It does not really say that.
Oh! I understand now. I think a VIRTIO_NET_CTRL_HASH_TUNNEL_SET command
is applied to hash and RSS. Yes.
When one wants to configure inner header hash separately, use
VIRTIO_NET_CTRL_HASH_TUNNEL_SET command to send enabled_tunnel_types
separately.
When one wants to configure both inner header hash and RSS/hash, use
VIRTIO_NET_CTRL_HASH_TUNNEL_SET together with
VIRTIO_NET_CTRL_MQ_RSS_CONFIG/VIRTIO_NET_CTRL_MQ_HASH_CONFIG.
The inner header hash is decoupled from RSS/hash, and no extra fields
will be sent every configuration.
>
>
>
>>> We should have reserved more space. We can still do it if you like:
>>>
>>> struct virtio_net_rss_tunnel_config {
>>> le32 enabled_tunnel_types;
>>> le16 reserved[6];
>>> struct virtio_net_rss_config hash;
>>> };
>>>
>>> struct virtio_net_hash_tunnel_config {
>>> le32 enabled_tunnel_types;
>>> le16 reserved[6];
>>> struct virtio_net_hash_config hash;
>>> };
>>>
>>> ?
>>>
>>>
>>>
>>>
>>>
>>>>>> If yes, this should have been discussed in v10 [1] before, enabled_tunnel_types
>>>>>> in virtio_net_rss_config will follow the variable length field and cause
>>>>>> misalignment.
>>>>>>
>>>>>> If we let the inner header hash reuse the virtio_net_hash_config structure, it
>>>>>> can work, but the only disadvantage is that the configuration of the inner
>>>>>> header hash and *RSS*(not hash calculations) becomes somewhat coupled.
>>>>>> Just imagine:
>>>>>> If the driver and the device negotiated VIRTIO_NET_F_HASH_TUNNEL and
>>>>>> VIRTIO_NET_F_RSS, but did not negotiate VIRTIO_NET_F_HASH_REPORT, 1.
>>>>>> then if we only want to configure the inner header hash (such as
>>>>>> enabled_tunnel_types), it is good for us to send virtio_net_hash_config alone;
>>>>>> 2. but then if we want to configure the inner header hash and RSS (such as
>>>>>> indirection table), we need to send all virtio_net_rss_config and
>>>>>> virtio_net_hash_config once, because virtio_net_rss_config now does not carry
>>>>>> enabled_tunnel_types due to misalignment.
>>>>>>
>>>>>> So, I think the following structure will make it clearer to configure inner header
>>>>>> hash and RSS/hash calculation.
>>>>>> But in any case, if we still propose to reuse virtio_net_hash_config proposal, I
>>>>>> am ok, no objection:
>>>>>>
>>>>>> 1. The supported_tunnel_types are placed in the device config space;
>>>>>>
>>>>> Yes. I forgot the variable length part.
>>>>> The second disadvantage I remember now is one need to resupply all the rss hash config parameter and device needs to compare and modify for this one field.
>>> Or it could be an advantage since one normally wants to configure a
>>> symmetric key with this. Further device can just use the new config
>> When we want to configure the hash key, he continues to use the previous
>> rss/hash calculation interface. This is ok.
>>
>> Thanks.
> I don't understand this sentence. My point is simply that
> to use the tunnel key has to be symmetric. So two commands
> will be required: one to set tunnel types, one to
> set the key.
Yes, you are right. Then one should be VIRTIO_NET_CTRL_HASH_TUNNEL_SET
and the other
should be VIRTIO_NET_CTRL_MQ_RSS_CONFIG/VIRTIO_NET_CTRL_MQ_HASH_CONFIG.
Thanks.
>
>>> with no need to check what the old one was. I'd call it a wash.
>>>
>>>>> Given these two disadvantages, I also prefer independent SET command the way you have it.
>>>> OK, let's wait for Michael's input again.
>>>>
>>>> Thanks.
>>> This part is not critical to me, but now I understand we need two sets of SET commands.
>>>
>>>
>>>>>> 2.
>>>>>> Reserve the following structure:
>>>>>>
>>>>>> struct virtnet_hash_tunnel {
>>>>>> le32 enabled_tunnel_types;
>>>>>> };
>>>>>>
>>>>>> 3. Reserve the SET command for enabled_tunnel_types and remove the GET
>>>>>> command for enabled_tunnel_types.
>>>>>>
>>>>>> [1] https://lists.oasis-open.org/archives/virtio-dev/202303/msg00317.html
>>>>>>
>>>>>> Thanks a lot!
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: virtio-dev-unsubscribe@lists.oasis-open.org
>>> For additional commands, e-mail: virtio-dev-help@lists.oasis-open.org
>
> This publicly archived list offers a means to provide input to the
> OASIS Virtual I/O Device (VIRTIO) TC.
>
> In order to verify user consent to the Feedback License terms and
> to minimize spam in the list archive, subscription is required
> before posting.
>
> Subscribe: virtio-comment-subscribe@lists.oasis-open.org
> Unsubscribe: virtio-comment-unsubscribe@lists.oasis-open.org
> List help: virtio-comment-help@lists.oasis-open.org
> List archive: https://lists.oasis-open.org/archives/virtio-comment/
> Feedback License: https://www.oasis-open.org/who/ipr/feedback_license.pdf
> List Guidelines: https://www.oasis-open.org/policies-guidelines/mailing-lists
> Committee: https://www.oasis-open.org/committees/virtio/
> Join OASIS: https://www.oasis-open.org/join/
---------------------------------------------------------------------
To unsubscribe, e-mail: virtio-dev-unsubscribe@lists.oasis-open.org
For additional commands, e-mail: virtio-dev-help@lists.oasis-open.org
next prev parent reply other threads:[~2023-06-30 14:05 UTC|newest]
Thread overview: 44+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-06-27 16:35 [virtio-dev] [PATCH v19] virtio-net: support inner header hash Heng Qi
2023-06-28 3:46 ` [virtio-dev] " Jason Wang
2023-06-28 4:23 ` [virtio-dev] " Parav Pandit
2023-06-28 5:37 ` [virtio-dev] " Jason Wang
2023-06-28 15:59 ` [virtio-dev] " Parav Pandit
2023-06-29 3:17 ` [virtio-dev] " Jason Wang
2023-06-30 11:42 ` Parav Pandit
2023-06-28 10:27 ` [virtio-dev] Re: [virtio-comment] " Michael S. Tsirkin
2023-06-28 16:18 ` [virtio-dev] " Parav Pandit
2023-06-28 16:45 ` [virtio-dev] " Michael S. Tsirkin
2023-06-28 17:06 ` [virtio-dev] " Parav Pandit
2023-06-28 17:16 ` [virtio-dev] " Michael S. Tsirkin
2023-06-28 17:28 ` [virtio-dev] " Parav Pandit
2023-06-28 17:23 ` [virtio-dev] " Michael S. Tsirkin
2023-06-28 17:38 ` [virtio-dev] " Parav Pandit
2023-06-28 19:44 ` [virtio-dev] " Michael S. Tsirkin
2023-06-29 1:56 ` [virtio-dev] " Parav Pandit
2023-06-29 2:05 ` [virtio-dev] " Heng Qi
2023-06-29 11:48 ` Michael S. Tsirkin
2023-06-29 13:08 ` Heng Qi
2023-06-29 16:59 ` [virtio-dev] " Parav Pandit
2023-06-30 0:54 ` Heng Qi
2023-06-30 1:36 ` Parav Pandit
2023-06-30 1:55 ` Heng Qi
2023-06-30 5:59 ` [virtio-dev] Re: [virtio-comment] " Michael S. Tsirkin
2023-06-30 6:15 ` Heng Qi
2023-06-30 8:17 ` Michael S. Tsirkin
2023-06-30 14:04 ` Heng Qi [this message]
2023-06-30 14:52 ` [virtio-dev] Re: [virtio-comment] " Michael S. Tsirkin
2023-06-30 16:09 ` Heng Qi
2023-06-30 16:56 ` Michael S. Tsirkin
2023-06-30 17:33 ` Heng Qi
2023-06-29 6:03 ` [virtio-dev] " Michael S. Tsirkin
2023-06-29 6:40 ` Heng Qi
2023-06-29 11:38 ` [virtio-dev] " Parav Pandit
2023-06-29 11:46 ` [virtio-dev] " Michael S. Tsirkin
2023-06-29 12:01 ` [virtio-dev] " Parav Pandit
2023-06-29 7:07 ` [virtio-dev] " Michael S. Tsirkin
2023-06-30 11:38 ` Parav Pandit
2023-06-30 15:30 ` Michael S. Tsirkin
2023-06-28 10:10 ` [virtio-dev] " Michael S. Tsirkin
2023-06-29 3:31 ` Jason Wang
2023-06-29 11:54 ` [virtio-dev] Re: [virtio-comment] " Michael S. Tsirkin
2023-06-29 11:55 ` Michael S. Tsirkin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=38fe3702-ea32-0d4a-fe23-cc7dbc823415@linux.alibaba.com \
--to=hengqi@linux.alibaba.com \
--cc=jasowang@redhat.com \
--cc=mst@redhat.com \
--cc=parav@nvidia.com \
--cc=virtio-comment@lists.oasis-open.org \
--cc=virtio-dev@lists.oasis-open.org \
--cc=xuanzhuo@linux.alibaba.com \
--cc=yuri.benditovich@daynix.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox