From: Doug Ledford <doug.ledford@hpe.com>
To: Jason Gunthorpe <jgg@nvidia.com>
Cc: Michael Margolin <mrgolin@amazon.com>, <leon@kernel.org>,
<linux-rdma@vger.kernel.org>, <sleybo@amazon.com>,
<matua@amazon.com>, <gal.pressman@linux.dev>,
Yonatan Nachum <ynachum@amazon.com>
Subject: Re: [PATCH for-next v2 1/5] RDMA/core: Add Completion Counters support
Date: Thu, 30 Apr 2026 09:38:54 -0600 [thread overview]
Message-ID: <79f353ff-23a4-4aa4-ac61-9cd7cf276c79@hpe.com> (raw)
In-Reply-To: <20260430014922.GF3225388@nvidia.com>
[-- Attachment #1.1: Type: text/plain, Size: 1581 bytes --]
On 4/29/26 8:49 PM, Jason Gunthorpe wrote:
> On Wed, Apr 29, 2026 at 06:50:54PM -0600, Doug Ledford wrote:
>> 1) Make qp attachment optional
>> 2) Extend create verb to differentiate between on-card counter with umem
>> target and in-umem counter
>> 3) Extend create verb to pass in optional trigger or wait capability to
>> perform limited umem updates based upon passed in option
>> 4) Modify read operation so that it can either return the value directly or
>> just trigger an async update of a buffer backed counter (especially useful
>> if the umem counter is on a GPU, is set for a triggered update, and you just
>> want to force an immediate async update)
>
> After all that is it still a "completion" counter? It seems like it is
> counting something else than a shortcut to polling a CQ?
>
> Jason
>
Depends on your definition of "completion counter". If, by completion,
you define it narrowly as only queue pair ops completed, then no. But,
given that our hardware and the future UET hardware will both be sending
to many, many destinations via a single send Q on a single QP, just
counting the QP completions is almost useless for us. We need
completions counted to a specific other fabric end point, and aggregate
counters won't help us with that. So, from our perspective, yes it's
still a completion counter, it's just tied to a different element for
practical purposes.
--
Doug Ledford <doug.ledford@hpe.com>
GPG KeyID: B826A3330E572FDD
Key fingerprint = AE6B 1BDA 122B 23B4 265B 1274 B826 A333 0E57 2FDD
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]
next prev parent reply other threads:[~2026-04-30 15:39 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-04-16 21:23 [PATCH for-next v2 0/5] Introduce Completion Counters Michael Margolin
2026-04-16 21:23 ` [PATCH for-next v2 1/5] RDMA/core: Add Completion Counters support Michael Margolin
2026-04-30 0:50 ` Doug Ledford
2026-04-30 1:49 ` Jason Gunthorpe
2026-04-30 15:38 ` Doug Ledford [this message]
2026-04-30 12:18 ` Michael Margolin
2026-04-30 19:09 ` Doug Ledford
2026-04-30 22:33 ` Sean Hefty
2026-05-04 12:51 ` Michael Margolin
2026-05-04 15:37 ` Sean Hefty
2026-04-16 21:23 ` [PATCH for-next v2 2/5] RDMA/core: Prevent destroying in-use completion counters Michael Margolin
2026-04-16 21:23 ` [PATCH for-next v2 3/5] RDMA/core: Add Completion Counters to resource tracking Michael Margolin
2026-04-16 21:23 ` [PATCH for-next v2 4/5] RDMA/efa: Update device interface Michael Margolin
2026-04-28 22:36 ` [PATCH for-next v2 0/5] Introduce Completion Counters Doug Ledford
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=79f353ff-23a4-4aa4-ac61-9cd7cf276c79@hpe.com \
--to=doug.ledford@hpe.com \
--cc=gal.pressman@linux.dev \
--cc=jgg@nvidia.com \
--cc=leon@kernel.org \
--cc=linux-rdma@vger.kernel.org \
--cc=matua@amazon.com \
--cc=mrgolin@amazon.com \
--cc=sleybo@amazon.com \
--cc=ynachum@amazon.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox