Linux RDMA and InfiniBand development
 help / color / mirror / Atom feed
From: Doug Ledford <doug.ledford@hpe.com>
To: Jason Gunthorpe <jgg@nvidia.com>
Cc: Michael Margolin <mrgolin@amazon.com>, <leon@kernel.org>,
	<linux-rdma@vger.kernel.org>, <sleybo@amazon.com>,
	<matua@amazon.com>, <gal.pressman@linux.dev>,
	Yonatan Nachum <ynachum@amazon.com>
Subject: Re: [PATCH for-next v2 1/5] RDMA/core: Add Completion Counters support
Date: Thu, 30 Apr 2026 09:38:54 -0600	[thread overview]
Message-ID: <79f353ff-23a4-4aa4-ac61-9cd7cf276c79@hpe.com> (raw)
In-Reply-To: <20260430014922.GF3225388@nvidia.com>


[-- Attachment #1.1: Type: text/plain, Size: 1581 bytes --]

On 4/29/26 8:49 PM, Jason Gunthorpe wrote:
> On Wed, Apr 29, 2026 at 06:50:54PM -0600, Doug Ledford wrote:
>> 1) Make qp attachment optional
>> 2) Extend create verb to differentiate between on-card counter with umem
>> target and in-umem counter
>> 3) Extend create verb to pass in optional trigger or wait capability to
>> perform limited umem updates based upon passed in option
>> 4) Modify read operation so that it can either return the value directly or
>> just trigger an async update of a buffer backed counter (especially useful
>> if the umem counter is on a GPU, is set for a triggered update, and you just
>> want to force an immediate async update)
> 
> After all that is it still a "completion" counter? It seems like it is
> counting something else than a shortcut to polling a CQ?
> 
> Jason
> 

Depends on your definition of "completion counter".  If, by completion, 
you define it narrowly as only queue pair ops completed, then no.  But, 
given that our hardware and the future UET hardware will both be sending 
to many, many destinations via a single send Q on a single QP, just 
counting the QP completions is almost useless for us.  We need 
completions counted to a specific other fabric end point, and aggregate 
counters won't help us with that.  So, from our perspective, yes it's 
still a completion counter, it's just tied to a different element for 
practical purposes.

-- 
Doug Ledford <doug.ledford@hpe.com>
     GPG KeyID: B826A3330E572FDD
     Key fingerprint = AE6B 1BDA 122B 23B4 265B  1274 B826 A333 0E57 2FDD

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 840 bytes --]

  reply	other threads:[~2026-04-30 15:39 UTC|newest]

Thread overview: 14+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-16 21:23 [PATCH for-next v2 0/5] Introduce Completion Counters Michael Margolin
2026-04-16 21:23 ` [PATCH for-next v2 1/5] RDMA/core: Add Completion Counters support Michael Margolin
2026-04-30  0:50   ` Doug Ledford
2026-04-30  1:49     ` Jason Gunthorpe
2026-04-30 15:38       ` Doug Ledford [this message]
2026-04-30 12:18     ` Michael Margolin
2026-04-30 19:09       ` Doug Ledford
2026-04-30 22:33         ` Sean Hefty
2026-05-04 12:51           ` Michael Margolin
2026-05-04 15:37             ` Sean Hefty
2026-04-16 21:23 ` [PATCH for-next v2 2/5] RDMA/core: Prevent destroying in-use completion counters Michael Margolin
2026-04-16 21:23 ` [PATCH for-next v2 3/5] RDMA/core: Add Completion Counters to resource tracking Michael Margolin
2026-04-16 21:23 ` [PATCH for-next v2 4/5] RDMA/efa: Update device interface Michael Margolin
2026-04-28 22:36 ` [PATCH for-next v2 0/5] Introduce Completion Counters Doug Ledford

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=79f353ff-23a4-4aa4-ac61-9cd7cf276c79@hpe.com \
    --to=doug.ledford@hpe.com \
    --cc=gal.pressman@linux.dev \
    --cc=jgg@nvidia.com \
    --cc=leon@kernel.org \
    --cc=linux-rdma@vger.kernel.org \
    --cc=matua@amazon.com \
    --cc=mrgolin@amazon.com \
    --cc=sleybo@amazon.com \
    --cc=ynachum@amazon.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox