From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Paul E. McKenney" Subject: Re: [RFC] Make need_resched() return true when rcu_urgent_qs requested Date: Wed, 18 Jul 2018 13:17:00 -0700 Message-ID: <20180718201700.GN12945@linux.vnet.ibm.com> References: <1531396842.8759.125.camel@infradead.org> <20180712125351.GP3593@linux.vnet.ibm.com> <20180712161704.GA20726@linux.vnet.ibm.com> <20180716154015.GA21419@linux.vnet.ibm.com> <1531815548.19223.23.camel@infradead.org> <20180717125653.GH12945@linux.vnet.ibm.com> <20180718153628.GA24359@linux.vnet.ibm.com> <1531929711.3414.29.camel@infradead.org> <20180718163712.GB12945@linux.vnet.ibm.com> <1531942865.3414.35.camel@infradead.org> Reply-To: paulmck@linux.vnet.ibm.com Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Christian Borntraeger , Peter Zijlstra , mhillenb@amazon.de, linux-kernel , kvm , Frederic Weisbecker To: David Woodhouse Return-path: Content-Disposition: inline In-Reply-To: <1531942865.3414.35.camel@infradead.org> Sender: linux-kernel-owner@vger.kernel.org List-Id: kvm.vger.kernel.org On Wed, Jul 18, 2018 at 09:41:05PM +0200, David Woodhouse wrote: > > > On Wed, 2018-07-18 at 09:37 -0700, Paul E. McKenney wrote: > > On Wed, Jul 18, 2018 at 06:01:51PM +0200, David Woodhouse wrote: > > > > > > On Wed, 2018-07-18 at 08:36 -0700, Paul E. McKenney wrote: > > > > > > > > And I finally did get some near misses from an earlier commit, so we > > > > should consider your patch to be officially off the hook. > > > > > > Yay, I like it when it's not my fault. I'll redo it with the ifdef > > > CONFIG_NO_HZ_FULL. > > > > Hey, I didn't say it wasn't your fault, only that it -officially- wasn't > > your fault.  ;-) > > I can live with being innocent until proven guilty. > > > > > > > What should it do for the !CONFIG_NO_HZ_FULL case? The existing call in > > > guest_enter_irqoff() clearly wasn't actually doing the right thing > > > anyway, hence the need for the need_resched() patch in $SUBJECT... so > > > should I just leave it doing nothing in guest_enter_irqoff()?  > > > > One starting point would be the combination of your patch and my > > patch, with -rcu commit IDs and diff below.  But yes, it needs to be > > !CONFIG_NO_HZ_FULL.  And no, I am not at all confident that I actually > > found all the places needing change in the core code, so this needs some > > serious review both by the KVM guys and the NO_HZ_FULL guys. > > Right, that looks fairly much like the version I'd ended up with. So my > question was... > > > --- a/include/linux/context_tracking.h > > +++ b/include/linux/context_tracking.h > > @@ -118,12 +118,12 @@ static inline void guest_enter_irqoff(void) > >    * one time slice). Lets treat guest mode as quiescent state, just like > >    * we do with user-mode execution. > >    */ > > ...if we change this to something like... > > #ifdef CONFIG_NO_HZ_FULL > > + rcu_kvm_enter(); > #else > > if (!context_tracking_cpu_is_enabled()) > > rcu_virt_note_context_switch(smp_processor_id()); > #endif > > ... do you actually want me to keep the #else case there? It blatantly > wasn't working anyway for us, perhaps because the condition was false? > That's why I started fixing need_resched() in the first place, and that > fix ought to cover whatever this call to rcu_virt_note_context_switch() > was supposed to be doing? My thought would be something like this: if (context_tracking_cpu_is_enabled()) rcu_kvm_enter(); else rcu_virt_note_context_switch(smp_processor_id()); The reason I believe that this is the right approach is that even when you have CONFIG_NO_HZ_FULL=y, some CPUs will still be nohz_full=n CPUs, so you don't want to take the extra overhead on those CPUs. But I could easily be confused here, so I am adding Frederic for his thoughts. Thanx, Paul