The Linux Kernel Mailing List
 help / color / mirror / Atom feed
From: Florian Bezdeka <florian.bezdeka@siemens.com>
To: Yury Norov <ynorov@nvidia.com>
Cc: Maxime Chevallier <maxime.chevallier@bootlin.com>,
	Andrew Lunn	 <andrew+netdev@lunn.ch>,
	"David S. Miller" <davem@davemloft.net>,
	Eric Dumazet	 <edumazet@google.com>,
	Jakub Kicinski <kuba@kernel.org>,
	Paolo Abeni	 <pabeni@redhat.com>,
	Maxime Coquelin <mcoquelin.stm32@gmail.com>,
	Alexandre Torgue <alexandre.torgue@foss.st.com>,
	Yury Norov <yury.norov@gmail.com>,
	Rasmus Villemoes	 <linux@rasmusvillemoes.dk>,
	Andrew Morton <akpm@linux-foundation.org>,
	 Sebastian Andrzej Siewior	 <bigeasy@linutronix.de>,
	Clark Williams <clrkwllms@kernel.org>,
	Steven Rostedt	 <rostedt@goodmis.org>,
	Thomas Gleixner <tglx@kernel.org>,
	Jan Kiszka	 <jan.kiszka@siemens.com>,
	netdev@vger.kernel.org,
	 linux-stm32@st-md-mailman.stormreply.com,
	linux-arm-kernel@lists.infradead.org,
		linux-kernel@vger.kernel.org, linux-rt-devel@lists.linux.dev
Subject: Re: [PATCH RFC 3/3] net: stmmac: Migrate IRQ balancing to cpumask_local_spread()
Date: Fri, 21 Aug 2026 18:40:11 +0200	[thread overview]
Message-ID: <ade455ea48cbb0680945536dc8f05c8db64f41ba.camel@siemens.com> (raw)
In-Reply-To: <aoX5wglLYYtLcE5J@yury>

Hi Yury,

On Wed, 2026-08-19 at 14:45 -0400, Yury Norov wrote:
> On Wed, Aug 19, 2026 at 04:30:32PM +0200, Florian Bezdeka wrote:
> > The previous balancing mechanism was based on num_online_cpus(), which
> > is a problem for systems cpu-isolating workloads. IRQs were targeting
> > CPUs that were isolated for those sensitive workloads.
> > 
> > With a migration to cpumask_local_spread() we
> >     - get NUMA locality
> >     - honor the default SMP affinity mask, which avoids targeting
> >       isolated CPUs.
> > 
> > This also aligns with the pattern used by most network drivers dealing
> > with IRQ affinities / affinity hints.
> > 
> > Signed-off-by: Florian Bezdeka <florian.bezdeka@siemens.com>
> > ---
> >  drivers/net/ethernet/stmicro/stmmac/stmmac_main.c | 21 +++++++++++++++++----
> >  1 file changed, 17 insertions(+), 4 deletions(-)
> > 
> > diff --git a/drivers/net/ethernet/stmicro/stmmac/stmmac_main.c b/drivers/net/ethernet/stmicro/stmmac/stmmac_main.c
> > index a71f0df263785dd8badc45292ca3067ab33bda05..949ced7e46d2814b57c6bd86b4886ac3bf33996c 100644
> > --- a/drivers/net/ethernet/stmicro/stmmac/stmmac_main.c
> > +++ b/drivers/net/ethernet/stmicro/stmmac/stmmac_main.c
> > @@ -3826,11 +3826,16 @@ static int stmmac_request_irq_multi_msi(struct net_device *dev)
> >  	struct stmmac_priv *priv = netdev_priv(dev);
> >  	struct stmmac_msi *msi = priv->msi;
> >  	enum request_irq_err irq_err;
> > +	cpumask_var_t affinity;
> >  	int irq_idx = 0;
> >  	char *int_name;
> > +	int node;
> >  	int ret;
> >  	int i;
> >  
> > +	if (!zalloc_cpumask_var(&affinity, GFP_KERNEL))
> > +		return -ENOMEM;
> > +
> >  	/* For common interrupt */
> >  	int_name = msi->int_name_mac;
> >  	sprintf(int_name, "%s:%s", dev->name, "mac");
> > @@ -3916,6 +3921,7 @@ static int stmmac_request_irq_multi_msi(struct net_device *dev)
> >  	}
> >  
> >  	/* Request Rx MSI irq */
> > +	node = dev_to_node(&priv->dev->dev);
> >  	for (i = 0; i < priv->plat->rx_queues_to_use; i++) {
> >  		if (i >= MTL_MAX_RX_QUEUES)
> >  			break;
> > @@ -3935,8 +3941,10 @@ static int stmmac_request_irq_multi_msi(struct net_device *dev)
> >  			irq_idx = i;
> >  			goto irq_error;
> >  		}
> > -		irq_set_affinity_hint(msi->rx_irq[i],
> > -				      cpumask_of(i % num_online_cpus()));
> > +
> > +		cpumask_clear(affinity);
> > +		cpumask_set_cpu(cpumask_local_spread(i, node), affinity);
> > +		irq_set_affinity_and_hint(msi->rx_irq[i], affinity);
> 
> If you want to spread more than one IRQ, you'd better convert your
> loop into for_each_numa_hop_mask(). That way you don't need to
> introduce new function. See the comment on top of
> cpumask_local_spread():
> 

I was knowingly ignoring this "optimization". As already noted the patch
1 thread: I'm currently trying to demonstrate the shortcomings,
optimizations will follow once we agree on a plan / vision.

  reply	other threads:[~2026-08-21 16:40 UTC|newest]

Thread overview: 24+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-08-19 14:30 [PATCH RFC 0/3] genirq: Allow drivers to respect userspace IRQ affinities Florian Bezdeka
2026-08-19 14:30 ` [PATCH RFC 1/3] cpumask: Honor irq_default_affinity in cpumask_local_spread() Florian Bezdeka
2026-08-19 18:38   ` Yury Norov
2026-08-20 16:09     ` Sebastian Andrzej Siewior
2026-08-21 17:14       ` Florian Bezdeka
2026-08-21 16:36     ` Florian Bezdeka
2026-08-20 14:30   ` sashiko-bot
2026-08-19 14:30 ` [PATCH RFC 2/3] genirq: Honor existing IRQ affinities when setting affinity hints Florian Bezdeka
2026-08-20 14:30   ` sashiko-bot
2026-08-20 16:41   ` Jakub Kicinski
2026-08-21 10:38     ` Jan Kiszka
2026-08-21 10:53       ` Sebastian Andrzej Siewior
2026-08-21 17:30         ` Florian Bezdeka
2026-08-19 14:30 ` [PATCH RFC 3/3] net: stmmac: Migrate IRQ balancing to cpumask_local_spread() Florian Bezdeka
2026-08-19 18:45   ` Yury Norov
2026-08-21 16:40     ` Florian Bezdeka [this message]
2026-08-20 14:30   ` sashiko-bot
2026-08-19 18:28 ` [PATCH RFC 0/3] genirq: Allow drivers to respect userspace IRQ affinities Yury Norov
2026-08-19 23:54 ` Andrew Lunn
2026-08-20  0:10   ` Andrew Lunn
2026-08-21 16:57     ` Florian Bezdeka
2026-08-21 16:47   ` Florian Bezdeka
2026-08-20 15:12 ` Sebastian Andrzej Siewior
2026-08-21 17:09   ` Florian Bezdeka

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ade455ea48cbb0680945536dc8f05c8db64f41ba.camel@siemens.com \
    --to=florian.bezdeka@siemens.com \
    --cc=akpm@linux-foundation.org \
    --cc=alexandre.torgue@foss.st.com \
    --cc=andrew+netdev@lunn.ch \
    --cc=bigeasy@linutronix.de \
    --cc=clrkwllms@kernel.org \
    --cc=davem@davemloft.net \
    --cc=edumazet@google.com \
    --cc=jan.kiszka@siemens.com \
    --cc=kuba@kernel.org \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-rt-devel@lists.linux.dev \
    --cc=linux-stm32@st-md-mailman.stormreply.com \
    --cc=linux@rasmusvillemoes.dk \
    --cc=maxime.chevallier@bootlin.com \
    --cc=mcoquelin.stm32@gmail.com \
    --cc=netdev@vger.kernel.org \
    --cc=pabeni@redhat.com \
    --cc=rostedt@goodmis.org \
    --cc=tglx@kernel.org \
    --cc=ynorov@nvidia.com \
    --cc=yury.norov@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox