From: "Toke Høiland-Jørgensen" <toke@redhat.com>
To: Alexander Lobakin <alexandr.lobakin@intel.com>,
"David S. Miller" <davem@davemloft.net>,
Jakub Kicinski <kuba@kernel.org>
Cc: Song Liu <songliubraving@fb.com>,
Sergey Ryazanov <ryazanov.s.a@gmail.com>,
"Michael S. Tsirkin" <mst@redhat.com>,
Vladimir Oltean <vladimir.oltean@nxp.com>,
Alexei Starovoitov <ast@kernel.org>,
Russell King <linux@armlinux.org.uk>,
Andrei Vagin <avagin@gmail.com>,
Tony Nguyen <anthony.l.nguyen@intel.com>,
Thomas Petazzoni <thomas.petazzoni@bootlin.com>,
Ioana Ciornei <ioana.ciornei@nxp.com>,
Noam Dagan <ndagan@amazon.com>,
Daniel Borkmann <daniel@iogearbox.net>,
Jonathan Corbet <corbet@lwn.net>,
linux-rdma@vger.kernel.org, linux-doc@vger.kernel.org,
John Fastabend <john.fastabend@gmail.com>,
Arthur Kiyanovski <akiyano@amazon.com>,
Cong Wang <cong.wang@bytedance.com>,
Martin Habets <habetsm.xilinx@gmail.com>,
Lorenzo Bianconi <lorenzo@kernel.org>,
Maciej Fijalkowski <maciej.fijalkowski@intel.com>,
Jesper Dangaard Brouer <hawk@kernel.org>,
Johannes Berg <johannes.berg@intel.com>,
KP Singh <kpsingh@kernel.org>,
Andrii Nakryiko <andrii@kernel.org>,
Claudiu Manoil <claudiu.manoil@nxp.com>,
Alexander Lobakin <alexandr.lobakin@intel.com>,
Yonghong Song <yhs@fb.com>, Shay Agroskin <shayagr@amazon.com>,
Marcin Wojtas <mw@semihalf.com>,
Leon Romanovsky <leon@kernel.org>,
David Arinzon <darinzon@amazon.com>,
David Ahern <dsahern@kernel.org>,
virtualization@lists.linux-foundation.org,
linux-kernel@vger.kernel.org,
Edward Cree <ecree.xilinx@gmail.com>,
Yajun Deng <yajun.deng@linux.dev>,
netdev@vger.kernel.org, Saeed Bishara <saeedb@amazon.com>,
Michal Swiatkowski <michal.swiatkowski@linux.intel.com>,
bpf@vger.kernel.org, Saeed Mahameed <saeedm@nvidia.com>,
Martin KaFai Lau <kafai@fb.com>
Subject: Re: [PATCH v2 net-next 00/26] net: introduce and use generic XDP stats
Date: Tue, 30 Nov 2021 17:17:24 +0100 [thread overview]
Message-ID: <871r2x8vor.fsf@toke.dk> (raw)
In-Reply-To: <20211130155612.594688-1-alexandr.lobakin@intel.com>
Alexander Lobakin <alexandr.lobakin@intel.com> writes:
> From: Alexander Lobakin <alexandr.lobakin@intel.com>
> Date: Tue, 23 Nov 2021 17:39:29 +0100
>
> Ok, open questions:
>
> 1. Channels vs queues vs global.
>
> Jakub: no per-channel.
> David (Ahern): it's worth it to separate as Rx/Tx.
> Toke is fine with globals at the end I think?
Well, I don't like throwing data away, so in that sense I do like
per-queue stats, but it's not a very strong preference (i.e., I can live
with either)...
> My point was that for most of the systems we have 1:1 Rx:Tx
> (usually num_online_cpus()), so asking drivers separately for
> the number of RQs and then SQs would end up asking for the same
> number twice.
> But the main reason TBH was that most of the drivers store stats
> on a per-channel basis and I didn't want them to regress in
> functionality. I'm fine with reporting only netdev-wide if
> everyone are.
>
> In case if we keep per-channel: report per-channel only by request
> and cumulative globals by default to not flood the output?
... however if we do go with per-channel stats I do agree that they
shouldn't be in the default output. I guess netlink could still split
them out and iproute2 could just sum them before display?
> 2. Count all errors as "drops" vs separately.
>
> Daniel: account everything as drops, plus errors should be
> reported as exceptions for tracing sub.
> Jesper: we shouldn't mix drops and errors.
>
> My point: we shouldn't, that's why there are patches for 2 drivers
> to give errors a separate counter.
> I provided an option either to report all errors together ('errors'
> in stats structure) or to provide individual counters for each of
> them (sonamed ctrs), but personally prefer detailed errors. However,
> they might "go detailed" under trace_xdp_exception() only, sound
> fine (OTOH in RTNL stats we have both "general" errors and detailed
> error counters).
I agree it would be nice to have a separate error counter, but a single
counter is enough when combined with the tracepoints.
> 3. XDP and XSK ctrs separately or not.
>
> My PoV is that those are two quite different worlds.
> However, stats for actions on XSK really make a little sense since
> 99% of time we have xskmap redirect. So I think it'd be fine to just
> expand stats structure with xsk_{rx,tx}_{packets,bytes} and count
> the rest (actions, errors) together with XDP.
A whole set of separate counters for XSK is certainly overkill. No
strong preference as to whether they need a separate counter at all...
> Rest:
> - don't create a separate `ip` command and report under `-s`;
> - save some RTNL skb space by skipping zeroed counters.
>
> Also, regarding that I count all on the stack and then add to the
> storage once in a polling cycle -- most drivers don't do that and
> just increment the values in the storage directly, but this can be
> less performant for frequently updated stats (or it's just my
> embedded past).
> Re u64 vs u64_stats_t -- the latter is more universal and
> architecture-friendly, the former is used directly in most of the
> drivers primarily because those drivers and the corresponding HW
> are being run on 64-bit systems in the vast majority of cases, and
> Ethtools stats themselves are not so critical to guard them with
> anti-tearing. Anyways, local64_t is cheap on ARM64/x86_64 I guess?
I'm generally a fan of correctness first, so since you're touching all
the drivers anyway why I'd say go for u64_stats_t :)
-Toke
_______________________________________________
Virtualization mailing list
Virtualization@lists.linux-foundation.org
https://lists.linuxfoundation.org/mailman/listinfo/virtualization
next prev parent reply other threads:[~2021-11-30 16:17 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <20211123163955.154512-1-alexandr.lobakin@intel.com>
[not found] ` <20211123163955.154512-22-alexandr.lobakin@intel.com>
2021-11-24 0:52 ` [PATCH v2 net-next 21/26] ice: add XDP and XSK generic per-channel statistics Daniel Borkmann
2021-11-25 11:56 ` Toke Høiland-Jørgensen
[not found] ` <20211125170708.127323-1-alexandr.lobakin@intel.com>
[not found] ` <20211125094440.6c402d63@kicinski-fedora-pc1c0hjn.dhcp.thefacebook.com>
[not found] ` <20211125204007.133064-1-alexandr.lobakin@intel.com>
2021-11-26 12:30 ` Toke Høiland-Jørgensen
[not found] ` <20211126100611.514df099@kicinski-fedora-pc1c0hjn.dhcp.thefacebook.com>
2021-11-26 18:47 ` Toke Høiland-Jørgensen
[not found] ` <20211126111431.4a2ed007@kicinski-fedora-pc1c0hjn.dhcp.thefacebook.com>
2021-11-28 17:54 ` Ido Schimmel
2021-11-26 22:27 ` Daniel Borkmann
2021-11-29 11:51 ` Toke Høiland-Jørgensen
[not found] ` <20211123163955.154512-9-alexandr.lobakin@intel.com>
2021-11-24 11:33 ` [PATCH v2 net-next 08/26] mvpp2: provide .ndo_get_xdp_stats() callback Russell King (Oracle)
2021-11-24 11:36 ` Russell King (Oracle)
[not found] ` <20211123163955.154512-8-alexandr.lobakin@intel.com>
2021-11-24 11:39 ` [PATCH v2 net-next 07/26] mvneta: add " Russell King (Oracle)
2021-11-28 22:23 ` [PATCH v2 net-next 00/26] net: introduce and use generic XDP stats David Ahern
[not found] ` <20211123163955.154512-2-alexandr.lobakin@intel.com>
2021-11-30 2:36 ` [PATCH v2 net-next 01/26] rtnetlink: introduce generic XDP statistics David Ahern
[not found] ` <20211130155612.594688-1-alexandr.lobakin@intel.com>
2021-11-30 16:17 ` Toke Høiland-Jørgensen [this message]
[not found] ` <20211130090716.4a557036@kicinski-fedora-pc1c0hjn.dhcp.thefacebook.com>
2021-11-30 17:56 ` [PATCH v2 net-next 00/26] net: introduce and use generic XDP stats David Ahern
[not found] ` <20211130081207.228f42ba@kicinski-fedora-pc1c0hjn.dhcp.thefacebook.com>
[not found] ` <20211130163454.595897-1-alexandr.lobakin@intel.com>
[not found] ` <20211130090449.58a8327d@kicinski-fedora-pc1c0hjn.dhcp.thefacebook.com>
2021-11-30 17:38 ` David Ahern
2021-12-01 15:21 ` Jamal Hadi Salim
2021-11-30 17:45 ` David Ahern
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=871r2x8vor.fsf@toke.dk \
--to=toke@redhat.com \
--cc=akiyano@amazon.com \
--cc=alexandr.lobakin@intel.com \
--cc=andrii@kernel.org \
--cc=anthony.l.nguyen@intel.com \
--cc=ast@kernel.org \
--cc=avagin@gmail.com \
--cc=bpf@vger.kernel.org \
--cc=claudiu.manoil@nxp.com \
--cc=cong.wang@bytedance.com \
--cc=corbet@lwn.net \
--cc=daniel@iogearbox.net \
--cc=darinzon@amazon.com \
--cc=davem@davemloft.net \
--cc=dsahern@kernel.org \
--cc=ecree.xilinx@gmail.com \
--cc=habetsm.xilinx@gmail.com \
--cc=hawk@kernel.org \
--cc=ioana.ciornei@nxp.com \
--cc=johannes.berg@intel.com \
--cc=john.fastabend@gmail.com \
--cc=kafai@fb.com \
--cc=kpsingh@kernel.org \
--cc=kuba@kernel.org \
--cc=leon@kernel.org \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-rdma@vger.kernel.org \
--cc=linux@armlinux.org.uk \
--cc=lorenzo@kernel.org \
--cc=maciej.fijalkowski@intel.com \
--cc=michal.swiatkowski@linux.intel.com \
--cc=mst@redhat.com \
--cc=mw@semihalf.com \
--cc=ndagan@amazon.com \
--cc=netdev@vger.kernel.org \
--cc=ryazanov.s.a@gmail.com \
--cc=saeedb@amazon.com \
--cc=saeedm@nvidia.com \
--cc=shayagr@amazon.com \
--cc=songliubraving@fb.com \
--cc=thomas.petazzoni@bootlin.com \
--cc=virtualization@lists.linux-foundation.org \
--cc=vladimir.oltean@nxp.com \
--cc=yajun.deng@linux.dev \
--cc=yhs@fb.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).