From: Aurelien Aptel <aaptel@nvidia.com>
To: Hannes Reinecke <hare@suse.de>,
linux-nvme@lists.infradead.org, netdev@vger.kernel.org,
sagi@grimberg.me, hch@lst.de, kbusch@kernel.org, axboe@fb.com,
chaitanyak@nvidia.com, davem@davemloft.net, kuba@kernel.org
Cc: Boris Pismenny <borisp@nvidia.com>,
aurelien.aptel@gmail.com, smalin@nvidia.com, malin1024@gmail.com,
ogerlitz@nvidia.com, yorayz@nvidia.com, galshalom@nvidia.com,
mgurtovoy@nvidia.com, tariqt@nvidia.com, gus@collabora.com,
edumazet@google.com, pabeni@redhat.com, dsahern@kernel.org,
ast@kernel.org, jacob.e.keller@intel.com
Subject: Re: [PATCH v29 01/20] net: Introduce direct data placement tcp offload
Date: Tue, 08 Jul 2025 17:15:55 +0300 [thread overview]
Message-ID: <25334b64vl0.fsf@nvidia.com> (raw)
In-Reply-To: <e5b994ce-247c-4bfa-96a5-eb842ef99e20@suse.de>
Hannes Reinecke <hare@suse.de> writes:
> Hmm. One wonders: where is the different between this DDP implementation
> and the existing DDP implementation added with 4d288d5767f8 ("[SCSI]
> net: add FCoE offload support through net_device") ?
On first sight there are some similarities with the FCoE DDP offload but
things work differently.
Device querying:
- FCoE DDP has an operation for retrieving hardcoded attributes from the
device (ndo_fcoe_get_hbainfo)
- ULP DDP has an operation for retrieving protocol generic and
per-protocol info (limits())
Enablement:
- FCoE DDP has operations to enable/disable the feature on the device,
and dedicated netdev feature bits
- ULP DPP uses netlink capability bits instead, as request by Jakub
Payload DDP:
- FCoE DDP works on a per-FCoE-frame basis, on top of ethernet. There
are ddp_setup()/ddp_done() ops.
- ULP DPP works on a per-IO basis, on top of TCP. One IO can be split in
multiple TCP packets. There are setup()/teardown() ops.
But because ULP DDP is per-IO and based on TCP, it requires knowledge
about the ULP header lenghts encoded in the HW/driver. It has to handle
OOO and dropped packets, via the resync() flow which FCoE lacks.
ULP DDP provides operation to enable/disable the offload per-socket,
which FCoE has no concept of.
Another difference is ULP DDP teardown operation is async. The ULP layer
does not have to wait for the HW to free up the resources: the ULP
provides callback to the driver, which the driver calls when it is done
tearing down so that the ULP can free its resources.
ULP DDP API also includes per-protocol stats retrieval. Overall, ULP DDP
was designed to be extended to support multiple protocols.
Thanks
next prev parent reply other threads:[~2025-07-08 14:16 UTC|newest]
Thread overview: 27+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-06-30 14:07 [PATCH v29 00/20] nvme-tcp receive offloads Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 01/20] net: Introduce direct data placement tcp offload Aurelien Aptel
2025-07-01 12:33 ` Simon Horman
2025-07-01 13:23 ` Aurelien Aptel
2025-07-02 11:53 ` Hannes Reinecke
2025-07-08 14:15 ` Aurelien Aptel [this message]
2025-06-30 14:07 ` [PATCH v29 02/20] netlink: add new family to manage ULP_DDP enablement and stats Aurelien Aptel
2025-07-01 12:50 ` Simon Horman
2025-07-01 13:56 ` Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 03/20] iov_iter: skip copy if src == dst for direct data placement Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 04/20] net/tls,core: export get_netdev_for_sock Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 05/20] nvme-tcp: Add DDP offload control path Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 06/20] nvme-tcp: Add DDP data-path Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 07/20] nvme-tcp: RX DDGST offload Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 08/20] nvme-tcp: Deal with netdevice DOWN events Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 09/20] Documentation: add ULP DDP offload documentation Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 10/20] net/mlx5e: Rename from tls to transport static params Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 11/20] net/mlx5e: Refactor ico sq polling to get budget Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 12/20] net/mlx5: Add NVMEoTCP caps, HW bits, 128B CQE and enumerations Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 13/20] net/mlx5e: NVMEoTCP, offload initialization Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 14/20] net/mlx5e: TCP flow steering for nvme-tcp acceleration Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 15/20] net/mlx5e: NVMEoTCP, use KLM UMRs for buffer registration Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 16/20] net/mlx5e: NVMEoTCP, queue init/teardown Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 17/20] net/mlx5e: NVMEoTCP, ddp setup and resync Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 18/20] net/mlx5e: NVMEoTCP, async ddp invalidation Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 19/20] net/mlx5e: NVMEoTCP, data-path for DDP+DDGST offload Aurelien Aptel
2025-06-30 14:07 ` [PATCH v29 20/20] net/mlx5e: NVMEoTCP, statistics Aurelien Aptel
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=25334b64vl0.fsf@nvidia.com \
--to=aaptel@nvidia.com \
--cc=ast@kernel.org \
--cc=aurelien.aptel@gmail.com \
--cc=axboe@fb.com \
--cc=borisp@nvidia.com \
--cc=chaitanyak@nvidia.com \
--cc=davem@davemloft.net \
--cc=dsahern@kernel.org \
--cc=edumazet@google.com \
--cc=galshalom@nvidia.com \
--cc=gus@collabora.com \
--cc=hare@suse.de \
--cc=hch@lst.de \
--cc=jacob.e.keller@intel.com \
--cc=kbusch@kernel.org \
--cc=kuba@kernel.org \
--cc=linux-nvme@lists.infradead.org \
--cc=malin1024@gmail.com \
--cc=mgurtovoy@nvidia.com \
--cc=netdev@vger.kernel.org \
--cc=ogerlitz@nvidia.com \
--cc=pabeni@redhat.com \
--cc=sagi@grimberg.me \
--cc=smalin@nvidia.com \
--cc=tariqt@nvidia.com \
--cc=yorayz@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).