All of lore.kernel.org
 help / color / mirror / Atom feed
From: Jakub Kicinski <kuba@kernel.org>
To: Paolo Abeni <pabeni@redhat.com>
Cc: Jiri Pirko <jiri@resnulli.us>,
	netdev@vger.kernel.org, John Fastabend <john.fastabend@gmail.com>,
	Jamal Hadi Salim <jhs@mojatatu.com>,
	edumazet@google.com, Madhu Chittim <madhu.chittim@intel.com>,
	anthony.l.nguyen@intel.com, Simon Horman <horms@kernel.org>,
	Sridhar Samudrala <sridhar.samudrala@intel.com>,
	Donald Hunter <donald.hunter@gmail.com>,
	intel-wired-lan@lists.osuosl.org, przemyslaw.kitszel@intel.com,
	Sunil Kovvuri Goutham <sgoutham@marvell.com>
Subject: Re: [Intel-wired-lan] [PATCH v5 net-next 02/12] net-shapers: implement NL get operation
Date: Fri, 30 Aug 2024 12:14:18 -0700	[thread overview]
Message-ID: <20240830121418.39f3e6f8@kernel.org> (raw)
In-Reply-To: <58730142-2064-46cb-bc84-0060ea73c4a0@redhat.com>

On Fri, 30 Aug 2024 17:43:08 +0200 Paolo Abeni wrote:
> Please allow me to put a few high level questions together, to both 
> underline them as most critical, and keep the thread focused.
> 
> On 8/30/24 03:20, Jakub Kicinski wrote:
>  > This 'binding' has the same meaning as 'binding' in TCP ZC? :(  
> 
> I hope we can agree that good naming is difficult. I thought we agreed 
> on such naming in the past week’s discussion. The term 'binding' is 
> already used in the networking stack in many places to identify 
> different things (i.e. device tree, socket, netfilter.. ). The name 
> prefix avoids any ambiguity and I think this a good name, but if you 
> have any better suggestions, this change should be trivial.

Ack. Maybe we can cut down the number of ambiguous nouns elsewhere:

maybe call net_shaper_info -> net_shaper ?

maybe net_shaper_data -> net_shaper_hierarchy ?

>  > I've been wondering if we shouldn't move this lock
>  > directly into net_device and combine it with the RSS lock.
>  > Create a "per-netdev" lock, instead of having multiple disparate
>  > mutexes which are hard to allocate?  
> 
> The above looks like a quite unrelated refactor and one I think it will 
> not be worthy. The complexity of locking code in this series is very 
> limited, and self-encapsulated. Different locks for different things 
> increases scalability. Possibly we will not see much contention on the 
> same device, but some years ago we did not think there would be much 
> contention on RTNL...

We need to do this, anyway. Let me do it myself, then.

> Additionally, if we use a per _network device_ lock, future expansion of 
> the core to support devlink objects will be more difficult.

You parse out the binding you can store a pointer to the right mutex.

> [about separate handle from shaper_info arguments]
>  > Wouldn't it be convenient to store the handle in the "info"
>  > object? AFAIU the handle is forever for an info, so no risk of it
>  > being out of sync…  
> 
> Was that way a couple of iterations ago. Jiri explicitly asked for the 
> separation, I asked for confirmation and nobody objected.

Could you link to that? I must have not read it.
You can keep it wrapped in a struct *_handle, that's fine.
But it can live inside the shaper object.

> Which if the 2 options is acceptable from both of you?
> 
> [about queue limit and channel reconf]
>  > we probably want to trim the queue shapers on channel reconfig,
>  > then, too? :(  
> 
> what about exposing to the drivers an helper alike:
> 
> 	net_shaper_notify_delete(binding, handle);
> 
> that tells the core the shaper at the given handle just went away in the 
> H/W? The driver will call it in the queue deletion helper, and such 
> helper could be later on used more generically, i.e. for vf/devlink port 
> deletion.

We can either prevent disabling queues which have shapers attached, 
or auto-removing the shapers. No preference on that. But put the
callback in the core, please, netif_set_real_num_rx_queues() ?
Why not?

>  > It's not just for introspection, it's also for the core to do
>  > error checking.  
> 
> Actually, in the previous discussions it was never mentioned to use 
> capabilities to fully centralize the error checking.
> 
> This really looks like another feature, and can easily be added in a 
> second time (say, a follow-up series), with no functionality loss.
> 
> I (or anybody else) can’t keep adding new features at every iteration. 
> At some point we need to draw a line, and we should agree that the scope 
> of this activity has already expanded a lot in the past year. I would 
> like to draw such a line here.

I can help you. Just tell me which parts you want me to take care of.

WARNING: multiple messages have this Message-ID (diff)
From: Jakub Kicinski <kuba@kernel.org>
To: Paolo Abeni <pabeni@redhat.com>
Cc: Jiri Pirko <jiri@resnulli.us>,
	netdev@vger.kernel.org, Madhu Chittim <madhu.chittim@intel.com>,
	Sridhar Samudrala <sridhar.samudrala@intel.com>,
	Simon Horman <horms@kernel.org>,
	John Fastabend <john.fastabend@gmail.com>,
	Sunil Kovvuri Goutham <sgoutham@marvell.com>,
	Jamal Hadi Salim <jhs@mojatatu.com>,
	Donald Hunter <donald.hunter@gmail.com>,
	anthony.l.nguyen@intel.com, przemyslaw.kitszel@intel.com,
	intel-wired-lan@lists.osuosl.org, edumazet@google.com
Subject: Re: [PATCH v5 net-next 02/12] net-shapers: implement NL get operation
Date: Fri, 30 Aug 2024 12:14:18 -0700	[thread overview]
Message-ID: <20240830121418.39f3e6f8@kernel.org> (raw)
In-Reply-To: <58730142-2064-46cb-bc84-0060ea73c4a0@redhat.com>

On Fri, 30 Aug 2024 17:43:08 +0200 Paolo Abeni wrote:
> Please allow me to put a few high level questions together, to both 
> underline them as most critical, and keep the thread focused.
> 
> On 8/30/24 03:20, Jakub Kicinski wrote:
>  > This 'binding' has the same meaning as 'binding' in TCP ZC? :(  
> 
> I hope we can agree that good naming is difficult. I thought we agreed 
> on such naming in the past week’s discussion. The term 'binding' is 
> already used in the networking stack in many places to identify 
> different things (i.e. device tree, socket, netfilter.. ). The name 
> prefix avoids any ambiguity and I think this a good name, but if you 
> have any better suggestions, this change should be trivial.

Ack. Maybe we can cut down the number of ambiguous nouns elsewhere:

maybe call net_shaper_info -> net_shaper ?

maybe net_shaper_data -> net_shaper_hierarchy ?

>  > I've been wondering if we shouldn't move this lock
>  > directly into net_device and combine it with the RSS lock.
>  > Create a "per-netdev" lock, instead of having multiple disparate
>  > mutexes which are hard to allocate?  
> 
> The above looks like a quite unrelated refactor and one I think it will 
> not be worthy. The complexity of locking code in this series is very 
> limited, and self-encapsulated. Different locks for different things 
> increases scalability. Possibly we will not see much contention on the 
> same device, but some years ago we did not think there would be much 
> contention on RTNL...

We need to do this, anyway. Let me do it myself, then.

> Additionally, if we use a per _network device_ lock, future expansion of 
> the core to support devlink objects will be more difficult.

You parse out the binding you can store a pointer to the right mutex.

> [about separate handle from shaper_info arguments]
>  > Wouldn't it be convenient to store the handle in the "info"
>  > object? AFAIU the handle is forever for an info, so no risk of it
>  > being out of sync…  
> 
> Was that way a couple of iterations ago. Jiri explicitly asked for the 
> separation, I asked for confirmation and nobody objected.

Could you link to that? I must have not read it.
You can keep it wrapped in a struct *_handle, that's fine.
But it can live inside the shaper object.

> Which if the 2 options is acceptable from both of you?
> 
> [about queue limit and channel reconf]
>  > we probably want to trim the queue shapers on channel reconfig,
>  > then, too? :(  
> 
> what about exposing to the drivers an helper alike:
> 
> 	net_shaper_notify_delete(binding, handle);
> 
> that tells the core the shaper at the given handle just went away in the 
> H/W? The driver will call it in the queue deletion helper, and such 
> helper could be later on used more generically, i.e. for vf/devlink port 
> deletion.

We can either prevent disabling queues which have shapers attached, 
or auto-removing the shapers. No preference on that. But put the
callback in the core, please, netif_set_real_num_rx_queues() ?
Why not?

>  > It's not just for introspection, it's also for the core to do
>  > error checking.  
> 
> Actually, in the previous discussions it was never mentioned to use 
> capabilities to fully centralize the error checking.
> 
> This really looks like another feature, and can easily be added in a 
> second time (say, a follow-up series), with no functionality loss.
> 
> I (or anybody else) can’t keep adding new features at every iteration. 
> At some point we need to draw a line, and we should agree that the scope 
> of this activity has already expanded a lot in the past year. I would 
> like to draw such a line here.

I can help you. Just tell me which parts you want me to take care of.

  reply	other threads:[~2024-08-30 19:14 UTC|newest]

Thread overview: 58+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-08-29 15:16 [Intel-wired-lan] [PATCH v5 net-next 00/12] net: introduce TX H/W shaping API Paolo Abeni
2024-08-29 15:16 ` Paolo Abeni
2024-08-29 15:16 ` [Intel-wired-lan] [PATCH v5 net-next 01/12] netlink: spec: add shaper YAML spec Paolo Abeni
2024-08-29 15:16   ` Paolo Abeni
2024-08-29 15:16 ` [Intel-wired-lan] [PATCH v5 net-next 02/12] net-shapers: implement NL get operation Paolo Abeni
2024-08-29 15:16   ` Paolo Abeni
2024-08-29 23:28   ` [Intel-wired-lan] " Jakub Kicinski
2024-08-29 23:28     ` Jakub Kicinski
2024-08-30  1:20   ` [Intel-wired-lan] " Jakub Kicinski
2024-08-30  1:20     ` Jakub Kicinski
2024-08-30 10:55     ` [Intel-wired-lan] " Paolo Abeni
2024-08-30 10:55       ` Paolo Abeni
2024-08-30 18:39       ` [Intel-wired-lan] " Jakub Kicinski
2024-08-30 18:39         ` Jakub Kicinski
2024-08-30 23:42         ` [Intel-wired-lan] " Jakub Kicinski
2024-08-30 23:42           ` Jakub Kicinski
2024-09-02 13:00         ` [Intel-wired-lan] " Paolo Abeni
2024-09-02 13:00           ` Paolo Abeni
2024-08-30 15:43     ` [Intel-wired-lan] " Paolo Abeni
2024-08-30 15:43       ` Paolo Abeni
2024-08-30 19:14       ` Jakub Kicinski [this message]
2024-08-30 19:14         ` Jakub Kicinski
2024-09-02 10:10         ` [Intel-wired-lan] " Paolo Abeni
2024-09-02 10:10           ` Paolo Abeni
2024-09-03  0:37           ` [Intel-wired-lan] " Jakub Kicinski
2024-09-03  0:37             ` Jakub Kicinski
2024-08-29 15:16 ` [Intel-wired-lan] [PATCH v5 net-next 03/12] net-shapers: implement NL set and delete operations Paolo Abeni
2024-08-29 15:16   ` Paolo Abeni
2024-08-30  1:43   ` [Intel-wired-lan] " Jakub Kicinski
2024-08-30  1:43     ` Jakub Kicinski
2024-08-29 15:16 ` [Intel-wired-lan] [PATCH v5 net-next 04/12] net-shapers: implement NL group operation Paolo Abeni
2024-08-29 15:16   ` Paolo Abeni
2024-08-30  2:04   ` [Intel-wired-lan] " Jakub Kicinski
2024-08-30  2:04     ` Jakub Kicinski
2024-08-30 16:48     ` [Intel-wired-lan] " Paolo Abeni
2024-08-30 16:48       ` Paolo Abeni
2024-08-30 18:48       ` [Intel-wired-lan] " Jakub Kicinski
2024-08-30 18:48         ` Jakub Kicinski
2024-08-29 15:16 ` [Intel-wired-lan] [PATCH v5 net-next 05/12] net-shapers: implement delete support for NODE scope shaper Paolo Abeni
2024-08-29 15:16   ` Paolo Abeni
2024-08-29 15:16 ` [Intel-wired-lan] [PATCH v5 net-next 06/12] netlink: spec: add shaper introspection support Paolo Abeni
2024-08-29 15:16   ` Paolo Abeni
2024-08-29 15:17 ` [Intel-wired-lan] [PATCH v5 net-next 07/12] net: shaper: implement " Paolo Abeni
2024-08-29 15:17   ` Paolo Abeni
2024-08-30  2:11   ` [Intel-wired-lan] " Jakub Kicinski
2024-08-30  2:11     ` Jakub Kicinski
2024-08-29 15:17 ` [Intel-wired-lan] [PATCH v5 net-next 08/12] testing: net-drv: add basic shaper test Paolo Abeni
2024-08-29 15:17   ` Paolo Abeni
2024-08-29 15:17 ` [Intel-wired-lan] [PATCH v5 net-next 09/12] virtchnl: support queue rate limit and quanta size configuration Paolo Abeni
2024-08-29 15:17   ` Paolo Abeni
2024-08-29 15:17 ` [Intel-wired-lan] [PATCH v5 net-next 10/12] ice: Support VF " Paolo Abeni
2024-08-29 15:17   ` Paolo Abeni
2024-08-29 15:17 ` [Intel-wired-lan] [PATCH v5 net-next 11/12] iavf: Add net_shaper_ops support Paolo Abeni
2024-08-29 15:17   ` Paolo Abeni
2024-08-30  2:09   ` [Intel-wired-lan] " Jakub Kicinski
2024-08-30  2:09     ` Jakub Kicinski
2024-08-29 15:17 ` [Intel-wired-lan] [PATCH v5 net-next 12/12] iavf: add support to exchange qos capabilities Paolo Abeni
2024-08-29 15:17   ` Paolo Abeni

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20240830121418.39f3e6f8@kernel.org \
    --to=kuba@kernel.org \
    --cc=anthony.l.nguyen@intel.com \
    --cc=donald.hunter@gmail.com \
    --cc=edumazet@google.com \
    --cc=horms@kernel.org \
    --cc=intel-wired-lan@lists.osuosl.org \
    --cc=jhs@mojatatu.com \
    --cc=jiri@resnulli.us \
    --cc=john.fastabend@gmail.com \
    --cc=madhu.chittim@intel.com \
    --cc=netdev@vger.kernel.org \
    --cc=pabeni@redhat.com \
    --cc=przemyslaw.kitszel@intel.com \
    --cc=sgoutham@marvell.com \
    --cc=sridhar.samudrala@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.