The Linux Kernel Mailing List
 help / color / mirror / Atom feed
From: Usama Arif <usama.arif@linux.dev>
To: Randy Dunlap <rdunlap@infradead.org>,
	Alan Stern <stern@rowland.harvard.edu>,
	paulmck@kernel.org
Cc: lkmm@lists.linux.dev, joelagnelf@nvidia.com,
	linux-kernel@vger.kernel.org, marco.crivellari@suse.com,
	paulmck@kernel.org, rafael.j.wysocki@intel.com, riel@surriel.com,
	sshegde@linux.ibm.com, tglx@kernel.org, ulfh@kernel.org,
	yury.norov@gmail.com, rcu@vger.kernel.org,
	shakeel.butt@linux.dev, hannes@cmpxchg.org, kernel-team@meta.com
Subject: Re: [PATCH] smp: Use release stores for csd_lock_record() state
Date: Thu, 18 Jun 2026 15:44:36 +0100	[thread overview]
Message-ID: <01437928-ff79-4d8e-823b-7f20146946f6@linux.dev> (raw)
In-Reply-To: <2d4034d5-fa7c-463b-89c3-2725e4dbd137@infradead.org>



On 18/06/2026 04:30, Randy Dunlap wrote:
> 
> 
> On 6/17/26 6:44 PM, Alan Stern wrote:
>> On Wed, Jun 17, 2026 at 02:20:01PM -0700, Usama Arif wrote:
>>> __csd_lock_record() publishes per-CPU CSD debug state that is read by
>>> csd_lock_wait_toolong() on another CPU.  The remote side first reads
>>> cur_csd with smp_load_acquire() and, when non-NULL, may then read the
>>> matching cur_csd_func and cur_csd_info fields.
>>>
>>> Use smp_store_release() when publishing cur_csd so that the preceding
>>> cur_csd_func and cur_csd_info stores are ordered before the pointer
>>> that csd_lock_wait_toolong() acquires.  This replaces the open-coded
>>> smp_wmb() plus plain cur_csd store with the release operation that
>>> matches the smp_load_acquire() in csd_lock_wait_toolong().
>>>
>>> For the clear path, use smp_store_release(&cur_csd, NULL) so that
>>> clearing the diagnostic state remains ordered after the preceding
>>> callback/unlock work, without requiring a full barrier before the
>>> store.  On x86 this removes the locked full barrier from the clear
>>> path; on weaker memory models it uses the release operation needed by
>>> the smp_load_acquire() in csd_lock_wait_toolong().
>>>
>>> The old code also had smp_mb() calls around cur_csd updates. Those would
>>> only be needed if cur_csd were treated as an exact live-state marker whose
>>> publication had to be observed before callback execution or CSD unlock.
>>> CSD stall warnings do not currently have RCU-style stall-ended checks, so
>>> they already allow the stall to end while diagnostics are being assembled.
>>> The cur_csd record is therefore best-effort diagnostic context, not a
>>> precise completion/stall boundary.
>>>
>>> Signed-off-by: Usama Arif <usama.arif@linux.dev>
>>> ---
>>>  kernel/smp.c | 8 ++------
>>>  1 file changed, 2 insertions(+), 6 deletions(-)
>>>
>>> diff --git a/kernel/smp.c b/kernel/smp.c
>>> index a0bb56bd8dda..5ba4a20ba77d 100644
>>> --- a/kernel/smp.c
>>> +++ b/kernel/smp.c
>>> @@ -182,16 +182,12 @@ static atomic_t csd_bug_count = ATOMIC_INIT(0);
>>>  static void __csd_lock_record(call_single_data_t *csd)
>>>  {
>>>  	if (!csd) {
>>> -		smp_mb(); /* NULL cur_csd after unlock. */
>>> -		__this_cpu_write(cur_csd, NULL);
>>> +		smp_store_release(this_cpu_ptr(&cur_csd), NULL);
>>>  		return;
>>>  	}
>>>  	__this_cpu_write(cur_csd_func, csd->func);
>>>  	__this_cpu_write(cur_csd_info, csd->info);
>>> -	smp_wmb(); /* func and info before csd. */
>>> -	__this_cpu_write(cur_csd, csd);
>>> -	smp_mb(); /* Update cur_csd before function call. */
>>> -		  /* Or before unlock, as the case may be. */
>>> +	smp_store_release(this_cpu_ptr(&cur_csd), csd);
>>
>> Isn't there a general policy in the kernel that memory barriers should 
>> be accompanied by a comment explaining what other memory barriers they 
>> synchronize with?  Including such comments is a good idea in any case.
> 
> in Documentation/process/submit-checklist.rst:
> 
> 3) All memory barriers {e.g., ``barrier()``, ``rmb()``, ``wmb()``} need a
>    comment in the source code that explains the logic of what they are doing
>    and why.
> 
> in Documentation/process/4.Coding.rst:
> 
> Certain things should always be commented.  Uses of memory barriers should
> be accompanied by a line explaining why the barrier is necessary.
> 
> but looking in the 3000+ lines of Documentation/memory-barriers.txt won't tell
> anyone about that.
> 
> 

Thanks!
I will send a v2 with the below diff if there are no objections?

diff --git a/kernel/smp.c b/kernel/smp.c
index 5ba4a20ba77d..685829875a3e 100644
--- a/kernel/smp.c
+++ b/kernel/smp.c
@@ -182,11 +182,21 @@ static atomic_t csd_bug_count = ATOMIC_INIT(0);
 static void __csd_lock_record(call_single_data_t *csd)
 {
        if (!csd) {
+               /*
+                * Pairs with smp_load_acquire() of cur_csd in
+                * csd_lock_wait_toolong(): orders any preceding CSD
+                * callback/unlock before a remote reader observes NULL.
+                */
                smp_store_release(this_cpu_ptr(&cur_csd), NULL);
                return;
        }
        __this_cpu_write(cur_csd_func, csd->func);
        __this_cpu_write(cur_csd_info, csd->info);
+       /*
+        * Pairs with smp_load_acquire() of cur_csd in
+        * csd_lock_wait_toolong(): publishes cur_csd_func and
+        * cur_csd_info before the non-NULL pointer becomes visible.
+        */
        smp_store_release(this_cpu_ptr(&cur_csd), csd);
 }

  parent reply	other threads:[~2026-06-18 14:44 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-06-17 21:20 [PATCH] smp: Use release stores for csd_lock_record() state Usama Arif
2026-06-18  1:44 ` Alan Stern
2026-06-18  3:30   ` Randy Dunlap
2026-06-18  4:01     ` Paul E. McKenney
2026-06-18 14:44     ` Usama Arif [this message]
2026-06-18 14:57       ` Paul E. McKenney
2026-06-18 15:30         ` Usama Arif

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=01437928-ff79-4d8e-823b-7f20146946f6@linux.dev \
    --to=usama.arif@linux.dev \
    --cc=hannes@cmpxchg.org \
    --cc=joelagnelf@nvidia.com \
    --cc=kernel-team@meta.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=lkmm@lists.linux.dev \
    --cc=marco.crivellari@suse.com \
    --cc=paulmck@kernel.org \
    --cc=rafael.j.wysocki@intel.com \
    --cc=rcu@vger.kernel.org \
    --cc=rdunlap@infradead.org \
    --cc=riel@surriel.com \
    --cc=shakeel.butt@linux.dev \
    --cc=sshegde@linux.ibm.com \
    --cc=stern@rowland.harvard.edu \
    --cc=tglx@kernel.org \
    --cc=ulfh@kernel.org \
    --cc=yury.norov@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox