From: Jason Gunthorpe <jgg@nvidia.com>
To: Rodrigo Vivi <rodrigo.vivi@intel.com>
Cc: Jiri Pirko <jiri@resnulli.us>,
Konstantin Sinyuk <ksinyuk@kernel.org>,
dri-devel@lists.freedesktop.org,
Maarten Lankhorst <maarten.lankhorst@linux.intel.com>,
Francois Dugast <francois.dugast@intel.com>,
David Airlie <airlied@gmail.com>, Simona Vetter <simona@ffwll.ch>,
Maxime Ripard <mripard@kernel.org>,
Thomas Zimmermann <tzimmermann@suse.de>,
Jonathan Corbet <corbet@lwn.net>,
Shuah Khan <skhan@linuxfoundation.org>,
Donald Hunter <donald.hunter@gmail.com>,
Jakub Kicinski <kuba@kernel.org>,
"David S. Miller" <davem@davemloft.net>,
Eric Dumazet <edumazet@google.com>,
Paolo Abeni <pabeni@redhat.com>, Simon Horman <horms@kernel.org>,
Ilia Levi <ilia.levi@intel.com>,
linux-doc@vger.kernel.org, linux-kselftest@vger.kernel.org,
netdev@vger.kernel.org, linux-kernel@vger.kernel.org,
jhs@mojatatu.com
Subject: Re: [RFC PATCH 0/12] drm/fabric: vendor-neutral topology infrastructure for scale-up accelerator interconnects
Date: Fri, 28 Aug 2026 14:03:01 -0300 [thread overview]
Message-ID: <20260828170301.GA4157646@nvidia.com> (raw)
In-Reply-To: <apG3Gsk1TeMD-oCc@intel.com>
On Fri, Aug 28, 2026 at 12:28:10PM -0400, Rodrigo Vivi wrote:
> On Thu, Aug 27, 2026 at 02:35:16PM +0200, Jiri Pirko wrote:
> > Mon, Aug 24, 2026 at 10:09:28AM +0200, ksinyuk@kernel.org wrote:
> >
> > [..]
> >
> > >Example queries using the in-tree YNL tool are:
> > >
> > > $ ./tools/net/ynl/pyynl/cli.py \
> > > --spec Documentation/netlink/specs/drm_fabric.yaml \
> > > --dump fabric-get
> > > $ ./tools/net/ynl/pyynl/cli.py \
> > > --spec Documentation/netlink/specs/drm_fabric.yaml \
> > > --dump endpoint-get --json '{"fabric-id": <id>}'
> > > $ ./tools/net/ynl/pyynl/cli.py \
> > > --spec Documentation/netlink/specs/drm_fabric.yaml \
> > > --do port-get --json '{"endpoint-id": <id>, "port-index": 0}'
> >
> > Using generic netlink instead of sysfs for this makes a lot of sense,
> > but it may be a bit odd to use it outside the networking area.
> > I've been struggling with the same in another non-networking use-case
> > as well.
>
> Please notice that this bubble was already broken. Netlink design
> always had the dream to replace ioctl everywhere. And there are already
> other usage in place that are not network related.
Yeah, and people have been living with the friction, and some places
don't have quite the same complexity, but that doesn't mean it cannot
be improved. :)
For something complex like this, if you can't concretetly tie the HW
to a net namespace, and follow the net namespace rules for visibility,
then it is going to be a painful choice. I speak from alot of rdma
experiance where net namespaces have been consistently challenging.
> In our case we use the netlink API for GPU RAS error reporting: drm-ras.
>
> Also there are other usages in netlink spec that apparently has nothing
> to do with networking, like energy...
>
> And in this particular case here, the drm-fabric is a 'network' of
> GPU memory... At some point we even wondered if net/ was the right
> place for this common API....
net/ is mainly focused on IP networking, it is where you should be
putting the ethernet layer at the bottom of the ua link over ethernet,
SUE, or whatever. It is hard to imagine having an actual physical
ethernet network and claiming no implementation will ever need to
process ethernet packets or deal with ethernet phy.
There are so many variations of these "scale up" fabrics now, it would
probably be appropriate to have one subsystem that aims to work with
all of them. It is almost rdma but different enough it probably
wouldn't fit well.
Certainly redoing all that ethernet related stuff in drm or, worse, in
amdgpu, is a pretty ugly idea.
Jason
prev parent reply other threads:[~2026-08-28 17:03 UTC|newest]
Thread overview: 20+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-08-24 8:09 [RFC PATCH 0/12] drm/fabric: vendor-neutral topology infrastructure for scale-up accelerator interconnects Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 01/12] drm/fabric: add core object model and provider API Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 02/12] drm/fabric: add query uAPI and generated headers Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 03/12] drm/fabric: implement query netlink operations Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 04/12] drm/fabric: add read-only synthetic provider Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 05/12] drm/fabric: add object-model KUnit tests Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 06/12] drm/fabric: add YNL query and policy selftests Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 07/12] drm/fabric: add topology-provisioning core Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 08/12] drm/fabric: add provisioning netlink uAPI Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 09/12] drm/fabric: implement mutation netlink operations Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 10/12] drm/fabric: make the synthetic provider writable Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 11/12] drm/fabric: add mutation KUnit tests Konstantin Sinyuk
2026-08-24 8:09 ` [RFC PATCH 12/12] drm/fabric: add mutation netlink selftests Konstantin Sinyuk
2026-08-26 9:32 ` [RFC PATCH 0/12] drm/fabric: vendor-neutral topology infrastructure for scale-up accelerator interconnects Leon Romanovsky
2026-08-26 15:38 ` Konstantin Sinyuk
2026-08-27 17:09 ` Leon Romanovsky
2026-08-28 16:13 ` Rodrigo Vivi
2026-08-27 12:35 ` Jiri Pirko
2026-08-28 16:28 ` Rodrigo Vivi
2026-08-28 17:03 ` Jason Gunthorpe [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260828170301.GA4157646@nvidia.com \
--to=jgg@nvidia.com \
--cc=airlied@gmail.com \
--cc=corbet@lwn.net \
--cc=davem@davemloft.net \
--cc=donald.hunter@gmail.com \
--cc=dri-devel@lists.freedesktop.org \
--cc=edumazet@google.com \
--cc=francois.dugast@intel.com \
--cc=horms@kernel.org \
--cc=ilia.levi@intel.com \
--cc=jhs@mojatatu.com \
--cc=jiri@resnulli.us \
--cc=ksinyuk@kernel.org \
--cc=kuba@kernel.org \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-kselftest@vger.kernel.org \
--cc=maarten.lankhorst@linux.intel.com \
--cc=mripard@kernel.org \
--cc=netdev@vger.kernel.org \
--cc=pabeni@redhat.com \
--cc=rodrigo.vivi@intel.com \
--cc=simona@ffwll.ch \
--cc=skhan@linuxfoundation.org \
--cc=tzimmermann@suse.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox