* [PATCH] net/core/dev.c: enable timestamp static key if CPU isolation is configured
@ 2024-02-20 10:35 Marcelo Tosatti
2024-02-22 9:34 ` Paolo Abeni
2024-02-22 15:11 ` Willem de Bruijn
0 siblings, 2 replies; 6+ messages in thread
From: Marcelo Tosatti @ 2024-02-20 10:35 UTC (permalink / raw)
To: netdev, linux-kernel
Cc: Jakub Kicinski, Eric Dumazet, Frederic Weisbecker,
Valentin Schneider
For systems that use CPU isolation (via nohz_full), creating or destroying
a socket with timestamping (SOF_TIMESTAMPING_OPT_TX_SWHW) might cause a
static key to be enabled/disabled. This in turn causes undesired
IPIs to isolated CPUs.
So enable the static key unconditionally, if CPU isolation is enabled,
thus avoiding the IPIs.
Signed-off-by: Marcelo Tosatti <mtosatti@redhat.com>
diff --git a/net/core/dev.c b/net/core/dev.c
index 0d548431f3fa..cc9a77b4aa4e 100644
--- a/net/core/dev.c
+++ b/net/core/dev.c
@@ -153,6 +153,7 @@
#include <linux/prandom.h>
#include <linux/once_lite.h>
#include <net/netdev_rx_queue.h>
+#include <linux/sched/isolation.h>
#include "dev.h"
#include "net-sysfs.h"
@@ -11601,3 +11602,14 @@ static int __init net_dev_init(void)
}
subsys_initcall(net_dev_init);
+
+static int __init net_dev_late_init(void)
+{
+ /* avoid static key IPIs to isolated CPUs */
+ if (housekeeping_enabled(HK_TYPE_MISC))
+ net_enable_timestamp();
+
+ return 0;
+}
+
+late_initcall(net_dev_late_init);
^ permalink raw reply related [flat|nested] 6+ messages in thread* Re: [PATCH] net/core/dev.c: enable timestamp static key if CPU isolation is configured
2024-02-20 10:35 [PATCH] net/core/dev.c: enable timestamp static key if CPU isolation is configured Marcelo Tosatti
@ 2024-02-22 9:34 ` Paolo Abeni
2024-02-22 15:11 ` Willem de Bruijn
1 sibling, 0 replies; 6+ messages in thread
From: Paolo Abeni @ 2024-02-22 9:34 UTC (permalink / raw)
To: Marcelo Tosatti, netdev, linux-kernel
Cc: Jakub Kicinski, Eric Dumazet, Frederic Weisbecker,
Valentin Schneider
On Tue, 2024-02-20 at 07:35 -0300, Marcelo Tosatti wrote:
> For systems that use CPU isolation (via nohz_full), creating or destroying
> a socket with timestamping (SOF_TIMESTAMPING_OPT_TX_SWHW) might cause a
> static key to be enabled/disabled. This in turn causes undesired
> IPIs to isolated CPUs.
>
> So enable the static key unconditionally, if CPU isolation is enabled,
> thus avoiding the IPIs.
>
> Signed-off-by: Marcelo Tosatti <mtosatti@redhat.com>
This looks like net-next material, but it does not apply cleanly to the
net-next tree. Could you please rebase and repost including the 'net-
next' tag into the patch prefix?
Thanks!
Paolo
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH] net/core/dev.c: enable timestamp static key if CPU isolation is configured
2024-02-20 10:35 [PATCH] net/core/dev.c: enable timestamp static key if CPU isolation is configured Marcelo Tosatti
2024-02-22 9:34 ` Paolo Abeni
@ 2024-02-22 15:11 ` Willem de Bruijn
2024-02-22 17:52 ` Marcelo Tosatti
1 sibling, 1 reply; 6+ messages in thread
From: Willem de Bruijn @ 2024-02-22 15:11 UTC (permalink / raw)
To: Marcelo Tosatti, netdev, linux-kernel
Cc: Jakub Kicinski, Eric Dumazet, Frederic Weisbecker,
Valentin Schneider
Marcelo Tosatti wrote:
> For systems that use CPU isolation (via nohz_full), creating or destroying
> a socket with timestamping (SOF_TIMESTAMPING_OPT_TX_SWHW) might cause a
> static key to be enabled/disabled. This in turn causes undesired
> IPIs to isolated CPUs.
This refers to SOF_TIMESTAMPING_RX_SOFTWARE, not SOF_TIMESTAMPING_OPT_TX_SWHW.
See also sock_set_timestamping.
>
> So enable the static key unconditionally, if CPU isolation is enabled,
> thus avoiding the IPIs.
>
> Signed-off-by: Marcelo Tosatti <mtosatti@redhat.com>
>
> diff --git a/net/core/dev.c b/net/core/dev.c
> index 0d548431f3fa..cc9a77b4aa4e 100644
> --- a/net/core/dev.c
> +++ b/net/core/dev.c
> @@ -153,6 +153,7 @@
> #include <linux/prandom.h>
> #include <linux/once_lite.h>
> #include <net/netdev_rx_queue.h>
> +#include <linux/sched/isolation.h>
>
> #include "dev.h"
> #include "net-sysfs.h"
> @@ -11601,3 +11602,14 @@ static int __init net_dev_init(void)
> }
>
> subsys_initcall(net_dev_init);
> +
> +static int __init net_dev_late_init(void)
> +{
> + /* avoid static key IPIs to isolated CPUs */
> + if (housekeeping_enabled(HK_TYPE_MISC))
> + net_enable_timestamp();
> +
> + return 0;
> +}
> +
> +late_initcall(net_dev_late_init);
>
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: [PATCH] net/core/dev.c: enable timestamp static key if CPU isolation is configured
2024-02-22 15:11 ` Willem de Bruijn
@ 2024-02-22 17:52 ` Marcelo Tosatti
2024-02-22 18:42 ` Willem de Bruijn
0 siblings, 1 reply; 6+ messages in thread
From: Marcelo Tosatti @ 2024-02-22 17:52 UTC (permalink / raw)
To: Willem de Bruijn
Cc: netdev, linux-kernel, Jakub Kicinski, Eric Dumazet,
Frederic Weisbecker, Valentin Schneider
On Thu, Feb 22, 2024 at 10:11:08AM -0500, Willem de Bruijn wrote:
> Marcelo Tosatti wrote:
> > For systems that use CPU isolation (via nohz_full), creating or destroying
> > a socket with timestamping (SOF_TIMESTAMPING_OPT_TX_SWHW) might cause a
> > static key to be enabled/disabled. This in turn causes undesired
> > IPIs to isolated CPUs.
>
> This refers to SOF_TIMESTAMPING_RX_SOFTWARE, not SOF_TIMESTAMPING_OPT_TX_SWHW.
> See also sock_set_timestamping.
Willem,
This test program does trigger the static key change:
int main (void)
{
int option = SOF_TIMESTAMPING_OPT_TX_SWHW;
int sock_fd;
int ret;
int pid_fd;
pid_t pid;
char buf[50];
...
/* set the timestamping option
* this is to trigger the IPIs that notify all cpus of the change
*/
if (setsockopt(sock_fd, SOL_SOCKET, SO_TIMESTAMP, &option, sizeof (option)) < 0) {
printf("Could not enable timestamping option %x", (unsigned int)option);
close(sock_fd);
return 0;
}
...
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: [PATCH] net/core/dev.c: enable timestamp static key if CPU isolation is configured
2024-02-22 17:52 ` Marcelo Tosatti
@ 2024-02-22 18:42 ` Willem de Bruijn
0 siblings, 0 replies; 6+ messages in thread
From: Willem de Bruijn @ 2024-02-22 18:42 UTC (permalink / raw)
To: Marcelo Tosatti, Willem de Bruijn
Cc: netdev, linux-kernel, Jakub Kicinski, Eric Dumazet,
Frederic Weisbecker, Valentin Schneider
Marcelo Tosatti wrote:
> On Thu, Feb 22, 2024 at 10:11:08AM -0500, Willem de Bruijn wrote:
> > Marcelo Tosatti wrote:
> > > For systems that use CPU isolation (via nohz_full), creating or destroying
> > > a socket with timestamping (SOF_TIMESTAMPING_OPT_TX_SWHW) might cause a
> > > static key to be enabled/disabled. This in turn causes undesired
> > > IPIs to isolated CPUs.
> >
> > This refers to SOF_TIMESTAMPING_RX_SOFTWARE, not SOF_TIMESTAMPING_OPT_TX_SWHW.
> > See also sock_set_timestamping.
>
> Willem,
>
> This test program does trigger the static key change:
>
> int main (void)
> {
> int option = SOF_TIMESTAMPING_OPT_TX_SWHW;
> int sock_fd;
> int ret;
> int pid_fd;
> pid_t pid;
> char buf[50];
>
> ...
>
> /* set the timestamping option
> * this is to trigger the IPIs that notify all cpus of the change
> */
> if (setsockopt(sock_fd, SOL_SOCKET, SO_TIMESTAMP, &option, sizeof (option)) < 0) {
> printf("Could not enable timestamping option %x", (unsigned int)option);
> close(sock_fd);
> return 0;
> }
> ...
>
That is because you call SO_TIMESTAMP, which interprets option as a
boolean. The SOF_ flags apply to setsockopt SO_TIMESTAMPING.
^ permalink raw reply [flat|nested] 6+ messages in thread
[parent not found: <Zc9493j46rZMRIDv@tpad>]
* Re: [PATCH] net/core/dev.c: enable timestamp static key if CPU isolation is configured
[not found] <Zc9493j46rZMRIDv@tpad>
@ 2024-02-16 15:13 ` Eric Dumazet
0 siblings, 0 replies; 6+ messages in thread
From: Eric Dumazet @ 2024-02-16 15:13 UTC (permalink / raw)
To: Marcelo Tosatti
Cc: linux-kernel, Jakub Kicinski, Frederic Weisbecker,
Valentin Schneider, netdev
On Fri, Feb 16, 2024 at 4:02 PM Marcelo Tosatti <mtosatti@redhat.com> wrote:
>
>
> For systems that use CPU isolation (via nohz_full), creating or destroying
> a socket with timestamping (SOF_TIMESTAMPING_OPT_TX_SWHW) might cause a
> static key to be enabled/disabled. This in turn causes undesired
> IPIs to isolated CPUs.
>
> So enable the static key unconditionally, if CPU isolation is enabled,
> thus avoiding the IPIs.
>
> Signed-off-by: Marcelo Tosatti <mtosatti@redhat.com>
>
> diff --git a/net/core/dev.c b/net/core/dev.c
> index 0d548431f3fa..cc9a77b4aa4e 100644
> --- a/net/core/dev.c
> +++ b/net/core/dev.c
> @@ -153,6 +153,7 @@
> #include <linux/prandom.h>
> #include <linux/once_lite.h>
> #include <net/netdev_rx_queue.h>
> +#include <linux/sched/isolation.h>
>
> #include "dev.h"
> #include "net-sysfs.h"
> @@ -11601,3 +11602,14 @@ static int __init net_dev_init(void)
> }
>
> subsys_initcall(net_dev_init);
> +
> +static int __init net_dev_late_init(void)
> +{
> + /* avoid static key IPIs to isolated CPUs */
> + if (housekeeping_enabled(HK_TYPE_MISC))
> + net_enable_timestamp();
> +
> + return 0;
> +}
> +
> +late_initcall(net_dev_late_init);
>
CC netdev@
SGTM, but could you please add netdev@ when sending patches for network trees ?
Thanks.
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2024-02-22 18:42 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-02-20 10:35 [PATCH] net/core/dev.c: enable timestamp static key if CPU isolation is configured Marcelo Tosatti
2024-02-22 9:34 ` Paolo Abeni
2024-02-22 15:11 ` Willem de Bruijn
2024-02-22 17:52 ` Marcelo Tosatti
2024-02-22 18:42 ` Willem de Bruijn
[not found] <Zc9493j46rZMRIDv@tpad>
2024-02-16 15:13 ` Eric Dumazet
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).