From: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
To: Peter Zijlstra <peterz@infradead.org>
Cc: Tim Chen <tim.c.chen@linux.intel.com>,
Will Deacon <will.deacon@arm.com>, Ingo Molnar <mingo@elte.hu>,
Andrew Morton <akpm@linux-foundation.org>,
Thomas Gleixner <tglx@linutronix.de>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
linux-mm <linux-mm@kvack.org>,
"linux-arch@vger.kernel.org" <linux-arch@vger.kernel.org>,
Linus Torvalds <torvalds@linux-foundation.org>,
Waiman Long <waiman.long@hp.com>,
Andrea Arcangeli <aarcange@redhat.com>,
Alex Shi <alex.shi@linaro.org>, Andi Kleen <andi@firstfloor.org>,
Michel Lespinasse <walken@google.com>,
Davidlohr Bueso <davidlohr.bueso@hp.com>,
Matthew R Wilcox <matthew.r.wilcox@intel.com>,
Dave Hansen <dave.hansen@intel.com>,
Rik van Riel <riel@redhat.com>,
Peter Hurley <peter@hurleysoftware.com>,
Raghavendra
Subject: Re: [PATCH v2 3/4] MCS Lock: Barrier corrections
Date: Wed, 6 Nov 2013 06:45:20 -0800 [thread overview]
Message-ID: <20131106144520.GK18245@linux.vnet.ibm.com> (raw)
In-Reply-To: <20131105211803.GS28601@twins.programming.kicks-ass.net>
On Tue, Nov 05, 2013 at 10:18:03PM +0100, Peter Zijlstra wrote:
> On Tue, Nov 05, 2013 at 11:21:57AM -0800, Tim Chen wrote:
> > On Tue, 2013-11-05 at 18:37 +0000, Will Deacon wrote:
> > > On Tue, Nov 05, 2013 at 05:42:36PM +0000, Tim Chen wrote:
> > > > This patch corrects the way memory barriers are used in the MCS lock
> > > > and removes ones that are not needed. Also add comments on all barriers.
> > >
> > > Hmm, I see that you're fixing up the barriers, but I still don't completely
> > > understand how what you have is correct. Hopefully you can help me out :)
> > >
> > > > Reviewed-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
> > > > Reviewed-by: Tim Chen <tim.c.chen@linux.intel.com>
> > > > Signed-off-by: Jason Low <jason.low2@hp.com>
> > > > ---
> > > > include/linux/mcs_spinlock.h | 13 +++++++++++--
> > > > 1 files changed, 11 insertions(+), 2 deletions(-)
> > > >
> > > > diff --git a/include/linux/mcs_spinlock.h b/include/linux/mcs_spinlock.h
> > > > index 96f14299..93d445d 100644
> > > > --- a/include/linux/mcs_spinlock.h
> > > > +++ b/include/linux/mcs_spinlock.h
> > > > @@ -36,16 +36,19 @@ void mcs_spin_lock(struct mcs_spinlock **lock, struct mcs_spinlock *node)
> > > > node->locked = 0;
> > > > node->next = NULL;
> > > >
> > > > + /* xchg() provides a memory barrier */
> > > > prev = xchg(lock, node);
> > > > if (likely(prev == NULL)) {
> > > > /* Lock acquired */
> > > > return;
> > > > }
> > > > ACCESS_ONCE(prev->next) = node;
> > > > - smp_wmb();
> > > > /* Wait until the lock holder passes the lock down */
> > > > while (!ACCESS_ONCE(node->locked))
> > > > arch_mutex_cpu_relax();
> > > > +
> > > > + /* Make sure subsequent operations happen after the lock is acquired */
> > > > + smp_rmb();
> > >
> > > Ok, so this is an smp_rmb() because we assume that stores aren't speculated,
> > > right? (i.e. the control dependency above is enough for stores to be ordered
> > > with respect to taking the lock)...
>
> PaulMck completely confused me a few days ago with control dependencies
> etc.. Pretty much saying that C/C++ doesn't do those.
I remember that there was a subtlety here, but don't remember what it was...
And while I do remember reviewing this code, I don't find any evidence
that I gave my "Reviewed-by". Tim/Jason, if I fat-fingered this, please
forward that email back to me.
Thanx, Paul
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
WARNING: multiple messages have this Message-ID (diff)
From: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
To: Peter Zijlstra <peterz@infradead.org>
Cc: Tim Chen <tim.c.chen@linux.intel.com>,
Will Deacon <will.deacon@arm.com>, Ingo Molnar <mingo@elte.hu>,
Andrew Morton <akpm@linux-foundation.org>,
Thomas Gleixner <tglx@linutronix.de>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
linux-mm <linux-mm@kvack.org>,
"linux-arch@vger.kernel.org" <linux-arch@vger.kernel.org>,
Linus Torvalds <torvalds@linux-foundation.org>,
Waiman Long <waiman.long@hp.com>,
Andrea Arcangeli <aarcange@redhat.com>,
Alex Shi <alex.shi@linaro.org>, Andi Kleen <andi@firstfloor.org>,
Michel Lespinasse <walken@google.com>,
Davidlohr Bueso <davidlohr.bueso@hp.com>,
Matthew R Wilcox <matthew.r.wilcox@intel.com>,
Dave Hansen <dave.hansen@intel.com>,
Rik van Riel <riel@redhat.com>,
Peter Hurley <peter@hurleysoftware.com>,
Raghavendra K T <raghavendra.kt@linux.vnet.ibm.com>,
George Spelvin <linux@horizon.com>,
"H. Peter Anvin" <hpa@zytor.com>, Arnd Bergmann <arnd@arndb.de>,
Aswin Chandramouleeswaran <aswin@hp.com>,
Scott J Norton <scott.norton@hp.com>
Subject: Re: [PATCH v2 3/4] MCS Lock: Barrier corrections
Date: Wed, 6 Nov 2013 06:45:20 -0800 [thread overview]
Message-ID: <20131106144520.GK18245@linux.vnet.ibm.com> (raw)
Message-ID: <20131106144520.5ozbbf2eBw28rHrEGqXa6sT-aNN9VxmOgYDQ_XYlsgQ@z> (raw)
In-Reply-To: <20131105211803.GS28601@twins.programming.kicks-ass.net>
On Tue, Nov 05, 2013 at 10:18:03PM +0100, Peter Zijlstra wrote:
> On Tue, Nov 05, 2013 at 11:21:57AM -0800, Tim Chen wrote:
> > On Tue, 2013-11-05 at 18:37 +0000, Will Deacon wrote:
> > > On Tue, Nov 05, 2013 at 05:42:36PM +0000, Tim Chen wrote:
> > > > This patch corrects the way memory barriers are used in the MCS lock
> > > > and removes ones that are not needed. Also add comments on all barriers.
> > >
> > > Hmm, I see that you're fixing up the barriers, but I still don't completely
> > > understand how what you have is correct. Hopefully you can help me out :)
> > >
> > > > Reviewed-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
> > > > Reviewed-by: Tim Chen <tim.c.chen@linux.intel.com>
> > > > Signed-off-by: Jason Low <jason.low2@hp.com>
> > > > ---
> > > > include/linux/mcs_spinlock.h | 13 +++++++++++--
> > > > 1 files changed, 11 insertions(+), 2 deletions(-)
> > > >
> > > > diff --git a/include/linux/mcs_spinlock.h b/include/linux/mcs_spinlock.h
> > > > index 96f14299..93d445d 100644
> > > > --- a/include/linux/mcs_spinlock.h
> > > > +++ b/include/linux/mcs_spinlock.h
> > > > @@ -36,16 +36,19 @@ void mcs_spin_lock(struct mcs_spinlock **lock, struct mcs_spinlock *node)
> > > > node->locked = 0;
> > > > node->next = NULL;
> > > >
> > > > + /* xchg() provides a memory barrier */
> > > > prev = xchg(lock, node);
> > > > if (likely(prev == NULL)) {
> > > > /* Lock acquired */
> > > > return;
> > > > }
> > > > ACCESS_ONCE(prev->next) = node;
> > > > - smp_wmb();
> > > > /* Wait until the lock holder passes the lock down */
> > > > while (!ACCESS_ONCE(node->locked))
> > > > arch_mutex_cpu_relax();
> > > > +
> > > > + /* Make sure subsequent operations happen after the lock is acquired */
> > > > + smp_rmb();
> > >
> > > Ok, so this is an smp_rmb() because we assume that stores aren't speculated,
> > > right? (i.e. the control dependency above is enough for stores to be ordered
> > > with respect to taking the lock)...
>
> PaulMck completely confused me a few days ago with control dependencies
> etc.. Pretty much saying that C/C++ doesn't do those.
I remember that there was a subtlety here, but don't remember what it was...
And while I do remember reviewing this code, I don't find any evidence
that I gave my "Reviewed-by". Tim/Jason, if I fat-fingered this, please
forward that email back to me.
Thanx, Paul
WARNING: multiple messages have this Message-ID (diff)
From: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
To: Peter Zijlstra <peterz@infradead.org>
Cc: Tim Chen <tim.c.chen@linux.intel.com>,
Will Deacon <will.deacon@arm.com>, Ingo Molnar <mingo@elte.hu>,
Andrew Morton <akpm@linux-foundation.org>,
Thomas Gleixner <tglx@linutronix.de>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
linux-mm <linux-mm@kvack.org>,
"linux-arch@vger.kernel.org" <linux-arch@vger.kernel.org>,
Linus Torvalds <torvalds@linux-foundation.org>,
Waiman Long <waiman.long@hp.com>,
Andrea Arcangeli <aarcange@redhat.com>,
Alex Shi <alex.shi@linaro.org>, Andi Kleen <andi@firstfloor.org>,
Michel Lespinasse <walken@google.com>,
Davidlohr Bueso <davidlohr.bueso@hp.com>,
Matthew R Wilcox <matthew.r.wilcox@intel.com>,
Dave Hansen <dave.hansen@intel.com>,
Rik van Riel <riel@redhat.com>,
Peter Hurley <peter@hurleysoftware.com>,
Raghavendra K T <raghavendra.kt@linux.vnet.ibm.com>,
George Spelvin <linux@horizon.com>,
"H. Peter Anvin" <hpa@zytor.com>, Arnd Bergmann <arnd@arndb.de>,
Aswin Chandramouleeswaran <aswin@hp.com>,
Scott J Norton <scott.norton@hp.com>
Subject: Re: [PATCH v2 3/4] MCS Lock: Barrier corrections
Date: Wed, 6 Nov 2013 06:45:20 -0800 [thread overview]
Message-ID: <20131106144520.GK18245@linux.vnet.ibm.com> (raw)
In-Reply-To: <20131105211803.GS28601@twins.programming.kicks-ass.net>
On Tue, Nov 05, 2013 at 10:18:03PM +0100, Peter Zijlstra wrote:
> On Tue, Nov 05, 2013 at 11:21:57AM -0800, Tim Chen wrote:
> > On Tue, 2013-11-05 at 18:37 +0000, Will Deacon wrote:
> > > On Tue, Nov 05, 2013 at 05:42:36PM +0000, Tim Chen wrote:
> > > > This patch corrects the way memory barriers are used in the MCS lock
> > > > and removes ones that are not needed. Also add comments on all barriers.
> > >
> > > Hmm, I see that you're fixing up the barriers, but I still don't completely
> > > understand how what you have is correct. Hopefully you can help me out :)
> > >
> > > > Reviewed-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
> > > > Reviewed-by: Tim Chen <tim.c.chen@linux.intel.com>
> > > > Signed-off-by: Jason Low <jason.low2@hp.com>
> > > > ---
> > > > include/linux/mcs_spinlock.h | 13 +++++++++++--
> > > > 1 files changed, 11 insertions(+), 2 deletions(-)
> > > >
> > > > diff --git a/include/linux/mcs_spinlock.h b/include/linux/mcs_spinlock.h
> > > > index 96f14299..93d445d 100644
> > > > --- a/include/linux/mcs_spinlock.h
> > > > +++ b/include/linux/mcs_spinlock.h
> > > > @@ -36,16 +36,19 @@ void mcs_spin_lock(struct mcs_spinlock **lock, struct mcs_spinlock *node)
> > > > node->locked = 0;
> > > > node->next = NULL;
> > > >
> > > > + /* xchg() provides a memory barrier */
> > > > prev = xchg(lock, node);
> > > > if (likely(prev == NULL)) {
> > > > /* Lock acquired */
> > > > return;
> > > > }
> > > > ACCESS_ONCE(prev->next) = node;
> > > > - smp_wmb();
> > > > /* Wait until the lock holder passes the lock down */
> > > > while (!ACCESS_ONCE(node->locked))
> > > > arch_mutex_cpu_relax();
> > > > +
> > > > + /* Make sure subsequent operations happen after the lock is acquired */
> > > > + smp_rmb();
> > >
> > > Ok, so this is an smp_rmb() because we assume that stores aren't speculated,
> > > right? (i.e. the control dependency above is enough for stores to be ordered
> > > with respect to taking the lock)...
>
> PaulMck completely confused me a few days ago with control dependencies
> etc.. Pretty much saying that C/C++ doesn't do those.
I remember that there was a subtlety here, but don't remember what it was...
And while I do remember reviewing this code, I don't find any evidence
that I gave my "Reviewed-by". Tim/Jason, if I fat-fingered this, please
forward that email back to me.
Thanx, Paul
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2013-11-06 14:45 UTC|newest]
Thread overview: 58+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <cover.1383670202.git.tim.c.chen@linux.intel.com>
2013-11-05 17:42 ` [PATCH v2 0/4] MCS Lock: MCS lock code cleanup and optimizations Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 21:14 ` Michel Lespinasse
2013-11-05 21:14 ` Michel Lespinasse
2013-11-05 21:14 ` Michel Lespinasse
2013-11-05 21:27 ` Tim Chen
2013-11-05 21:27 ` Tim Chen
2013-11-05 21:27 ` Tim Chen
2013-11-05 17:42 ` [PATCH v2 1/4] MCS Lock: Restructure the MCS lock defines and locking code into its own file Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 17:42 ` [PATCH v2 2/4] MCS Lock: optimizations and extra comments Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 17:42 ` [PATCH v2 3/4] MCS Lock: Barrier corrections Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 18:37 ` Will Deacon
2013-11-05 18:37 ` Will Deacon
2013-11-05 19:21 ` Tim Chen
2013-11-05 19:21 ` Tim Chen
2013-11-05 21:18 ` Peter Zijlstra
2013-11-05 21:18 ` Peter Zijlstra
2013-11-06 1:25 ` Tim Chen
2013-11-06 1:25 ` Tim Chen
2013-11-06 11:30 ` Will Deacon
2013-11-06 11:30 ` Will Deacon
2013-11-06 14:45 ` Paul E. McKenney [this message]
2013-11-06 14:45 ` Paul E. McKenney
2013-11-06 14:45 ` Paul E. McKenney
2013-11-06 18:22 ` Tim Chen
2013-11-06 18:22 ` Tim Chen
2013-11-06 18:22 ` Tim Chen
2013-11-06 19:13 ` Waiman Long
2013-11-06 19:13 ` Waiman Long
2013-11-06 19:13 ` Waiman Long
2013-11-06 5:44 ` Figo.zhang
2013-11-06 5:44 ` Figo.zhang
2013-11-06 12:20 ` Will Deacon
2013-11-06 12:20 ` Will Deacon
2013-11-06 17:05 ` Waiman Long
2013-11-06 17:05 ` Waiman Long
2013-11-05 17:42 ` [PATCH v2 4/4] MCS Lock: Make mcs_spinlock.h includable in other files Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 17:42 ` Tim Chen
2013-11-05 18:57 ` Peter Zijlstra
2013-11-05 18:57 ` Peter Zijlstra
2013-11-05 18:57 ` Peter Zijlstra
2013-11-05 19:30 ` Tim Chen
2013-11-05 19:30 ` Tim Chen
2013-11-05 19:30 ` Tim Chen
2013-11-06 15:31 ` Waiman Long
2013-11-06 15:31 ` Waiman Long
2013-11-06 15:31 ` Waiman Long
2013-11-06 16:08 ` Peter Zijlstra
2013-11-06 16:08 ` Peter Zijlstra
2013-11-06 16:08 ` Peter Zijlstra
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20131106144520.GK18245@linux.vnet.ibm.com \
--to=paulmck@linux.vnet.ibm.com \
--cc=aarcange@redhat.com \
--cc=akpm@linux-foundation.org \
--cc=alex.shi@linaro.org \
--cc=andi@firstfloor.org \
--cc=dave.hansen@intel.com \
--cc=davidlohr.bueso@hp.com \
--cc=linux-arch@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=matthew.r.wilcox@intel.com \
--cc=mingo@elte.hu \
--cc=peter@hurleysoftware.com \
--cc=peterz@infradead.org \
--cc=riel@redhat.com \
--cc=tglx@linutronix.de \
--cc=tim.c.chen@linux.intel.com \
--cc=torvalds@linux-foundation.org \
--cc=waiman.long@hp.com \
--cc=walken@google.com \
--cc=will.deacon@arm.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.