Linux-NVME Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: Nilay Shroff <nilay@linux.ibm.com>
To: Marco Elver <elver@google.com>
Cc: Christoph Hellwig <hch@lst.de>,
	linux-nvme@lists.infradead.org, linux-kernel@vger.kernel.org,
	kbusch@kernel.org, sagi@grimberg.me, axboe@fb.com,
	bvanassche@acm.org, gjoyce@linux.ibm.com
Subject: Re: [PATCHv2 12/17] nvme: add Clang context annotations for nvme_queue::cq_poll_lock
Date: Wed, 1 Jul 2026 13:15:57 +0530	[thread overview]
Message-ID: <e6cbe529-8529-4927-8e16-637fb8d9012d@linux.ibm.com> (raw)
In-Reply-To: <CANpmjNMnaxfoT6C5rC_Q8NaEuVANN0-imbYKZ6LNA004_uuMxg@mail.gmail.com>

On 6/30/26 4:26 PM, Marco Elver wrote:
> On Tue, 30 Jun 2026 at 11:26, Nilay Shroff <nilay@linux.ibm.com> wrote:
>>
>> On 6/29/26 6:20 PM, Christoph Hellwig wrote:
>>> On Fri, Jun 26, 2026 at 08:52:36PM +0530, Nilay Shroff wrote:
>>>>
>>>> That's because nvme_poll() and nvme_irq() both reuse nvme_poll_cq() to
>>>> process completions, but they rely on different synchronization mechanisms.
>>>
>>> Well, we could split the function easily, but it still uses the same
>>> data structure and thus annotations.
>>>
>> I see your point. The annotations describe only the polling synchronization model,
>> while the same state is also accessed under interrupt serialization for IRQ queues.
>> Since __guarded_by() cannot express alternative synchronization mechanisms today,
>> the annotations end up requiring __context_unsafe() for the IRQ path.
>>
>> It sounds like your preference would be to leave these fields unannotated rather
>> than partially annotate one synchronization model. Is that the direction you'd
>> recommend until the annotation infrastructure can express multiple valid
>> synchronization schemes?
>>
>>
>> Marco,
>> I know it's not currently supported, but are there any plan to extend the current
>> capability model to support multiple valid synchronization mechanisms for a single
>> object? For example, allowing a guarded field to be protected by either a lock or
>> another abstract capability (such as interrupt serialization), instead of requiring
>> a single __guarded_by() relationship." For instance,
>>
>> __guarded_by_any(&cq_poll_lock, IRQ_CONTEXT)
>>
>> Then irq handler would be annotated with __capability(irq_serialization).
> 
> I had planned to support IRQ context locks, which would be abstract
> but not be backed by a real object (similar to how RCU is handled).
> Just haven't gotten around to it.
> 
>> So now the compiler would know if the code executes in the interrupt/irq context
>> then access to the guarded variable doesn't require any lock otherwise it needs
>> ->cq_poll_lock when accessed. I don't know how easy it'd be to add such support
>> but it may be explored.
> 
> Multi-arg __guarded_by() is supported by Clang, but perhaps not
> exactly the way you imagined above. This has a brief summary:
> https://patch.msgid.link/20260515124426.2227783-1-elver@google.com
> 
> In short, you can hold any lock to get reader access, and must hold
> all for writer access.

That's interesting, and I can see how that would be useful. However, I don't think
it quite addresses this particular use case.
Here we're not choosing between multiple locks protecting the same object. Instead,
the synchronization mechanism depends on the execution context: the polling path
protects the completion queue with ->cq_poll_lock, whereas the IRQ path relies on
interrupt serialization and deliberately does not acquire ->cq_poll_lock.

So the requirement is effectively "hold ->cq_poll_lock or execute in the IRQ
serialization context and thus avoid holding any lock". Unless I'm misunderstanding,
I don't think multi-argument __guarded_by() can express that today.

Thanks,
--Nilay



  reply	other threads:[~2026-07-01  7:46 UTC|newest]

Thread overview: 65+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-06-14 13:15 [PATCHv2 00/17] Support Clang context analysis for NVMe host drivers Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 01/17] nvme: update nvme_passthru_end() signature Nilay Shroff
2026-06-26  6:32   ` Christoph Hellwig
2026-06-14 13:15 ` [PATCHv2 02/17] nvme: add Clang context annotations for nvme_passthru_{start|stop} Nilay Shroff
2026-06-26  6:33   ` Christoph Hellwig
2026-06-26 14:20     ` Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 03/17] nvme: add Clang context annotations for nvme_ns_head::srcu Nilay Shroff
2026-06-26  6:34   ` Christoph Hellwig
2026-06-14 13:15 ` [PATCHv2 04/17] nvme: add Clang context annotations for nvme_ns_head::requeue_list Nilay Shroff
2026-06-26  6:37   ` Christoph Hellwig
2026-06-26 14:24     ` Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 05/17] nvme: add Clang context annotations for nvme_ns_head::current_path Nilay Shroff
2026-06-26  6:40   ` Christoph Hellwig
2026-06-26 15:35     ` Nilay Shroff
2026-06-26 18:36     ` Paul E. McKenney
2026-06-27 15:38       ` Marco Elver
2026-06-27 17:14         ` Paul E. McKenney
2026-06-28  6:00           ` Marco Elver
2026-06-28 16:07             ` Paul E. McKenney
2026-06-29  5:20               ` Nilay Shroff
2026-06-29  8:48                 ` Marco Elver
2026-06-29 15:33                   ` Paul E. McKenney
2026-06-30  9:56                     ` Nilay Shroff
2026-06-30 14:24                       ` Paul E. McKenney
2026-06-29  6:00               ` Marco Elver
2026-06-29  6:04                 ` Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 06/17] nvme: add Clang context annotations for nvme_dev::shutdown_lock Nilay Shroff
2026-06-26  6:41   ` Christoph Hellwig
2026-06-14 13:15 ` [PATCHv2 07/17] nvme: add Clang context annotations for nvme_subsystem::lock Nilay Shroff
2026-06-26  6:43   ` Christoph Hellwig
2026-06-26 14:39     ` Nilay Shroff
2026-06-29 12:47       ` Christoph Hellwig
2026-06-29 23:12         ` Marco Elver
2026-06-30  9:53           ` Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 08/17] nvme: add Clang context annotations for nvme_ctrl::ana_lock Nilay Shroff
2026-06-26  6:43   ` Christoph Hellwig
2026-06-14 13:15 ` [PATCHv2 09/17] nvme: add Clang context annotations for nvme_subsystems_lock Nilay Shroff
2026-06-26  6:45   ` Christoph Hellwig
2026-06-26 14:48     ` Nilay Shroff
2026-06-29 12:47       ` Christoph Hellwig
2026-06-14 13:15 ` [PATCHv2 10/17] nvme: add Clang context annotations in fabric.c Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 11/17] nvme: add Clang context annotations for nvme_queue::sq_lock Nilay Shroff
2026-06-26  6:47   ` Christoph Hellwig
2026-06-26  9:50     ` Marco Elver
2026-06-26 15:12       ` Nilay Shroff
2026-06-29 12:48         ` Christoph Hellwig
2026-06-14 13:15 ` [PATCHv2 12/17] nvme: add Clang context annotations for nvme_queue::cq_poll_lock Nilay Shroff
2026-06-26  6:48   ` Christoph Hellwig
2026-06-26 15:22     ` Nilay Shroff
2026-06-29 12:50       ` Christoph Hellwig
2026-06-30  9:26         ` Nilay Shroff
2026-06-30 10:56           ` Marco Elver
2026-07-01  7:45             ` Nilay Shroff [this message]
2026-06-14 13:15 ` [PATCHv2 13/17] nvme: add Clang context annotations in rdma.c Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 14/17] nvme: fix Clang context analysis warning " Nilay Shroff
2026-06-26  6:49   ` Christoph Hellwig
2026-06-26 15:31     ` Nilay Shroff
2026-06-29 12:50       ` Christoph Hellwig
2026-06-29 22:47         ` Marco Elver
2026-06-30  9:35           ` Nilay Shroff
2026-06-30 10:38             ` Marco Elver
2026-07-01  7:50               ` Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 15/17] nvme: add Clang context annotations in tcp.c Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 16/17] nvme: fix Clang context analysis warning " Nilay Shroff
2026-06-14 13:15 ` [PATCHv2 17/17] nvme: enable Clang context analysis support for nvme host driver Nilay Shroff

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=e6cbe529-8529-4927-8e16-637fb8d9012d@linux.ibm.com \
    --to=nilay@linux.ibm.com \
    --cc=axboe@fb.com \
    --cc=bvanassche@acm.org \
    --cc=elver@google.com \
    --cc=gjoyce@linux.ibm.com \
    --cc=hch@lst.de \
    --cc=kbusch@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-nvme@lists.infradead.org \
    --cc=sagi@grimberg.me \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox