From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751942AbbJCIwk (ORCPT ); Sat, 3 Oct 2015 04:52:40 -0400 Received: from mail-wi0-f170.google.com ([209.85.212.170]:35327 "EHLO mail-wi0-f170.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751728AbbJCIwg (ORCPT ); Sat, 3 Oct 2015 04:52:36 -0400 Date: Sat, 3 Oct 2015 10:52:32 +0200 From: Ingo Molnar To: Mike Galbraith Cc: Peter Zijlstra , =?iso-8859-1?Q?Fr=E9d=E9ric?= Weisbecker , Andrew Morton , Alexey Dobriyan , linux-kernel@vger.kernel.org, Ingo Molnar Subject: Re: 4.2.2: NR_CPUS effectively being 1 bug Message-ID: <20151003085232.GA27214@gmail.com> References: <20151002204658.GA1970@p183.telecom.by> <20151002140033.ef62cd83936263311eb210d8@linux-foundation.org> <20151003065320.GE3816@twins.programming.kicks-ass.net> <20151003073812.GA24548@gmail.com> <1443860148.3786.5.camel@gmail.com> <20151003081801.GA26114@gmail.com> <1443860671.3786.8.camel@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1443860671.3786.8.camel@gmail.com> User-Agent: Mutt/1.5.23 (2014-03-12) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org * Mike Galbraith wrote: > On Sat, 2015-10-03 at 10:18 +0200, Ingo Molnar wrote: > > * Mike Galbraith wrote: > > > > > On Sat, 2015-10-03 at 09:38 +0200, Ingo Molnar wrote: > > > > * Peter Zijlstra wrote: > > > > > > > > > On Fri, Oct 02, 2015 at 02:00:33PM -0700, Andrew Morton wrote: > > > > > > On Fri, 2 Oct 2015 23:46:59 +0300 Alexey Dobriyan wrote: > > > > > > > > > > > > > FYI, I've upgraded from 4.1.7 to 4.2.1 (and retested with 4.2.2) and > > > > > > > everything is scheduled on 1 CPU out of 4 (i5 760). > > > > > > > > > > > > > > $ sudo cat /proc/1/status | grep cpu -i > > > > > > > Cpus_allowed: 1 > > > > > > > Cpus_allowed_list: 0 > > > > > > > > > > > > > > Every process inherits this tiny cpumask. > > > > > > > > > > > > Sell the other CPUs on ebay? > > > > > > > > > > > > I haven't seen such a report before - maybe it rings a bell with Peter > > > > > > & Ingo? > > > > > > > > > > I think this is related to some NO_HZ_FULL quackery. People seem to have > > > > > enabled stuff they've really no sane reason for. > > > > > > > > So the question is, is CONFIG_NO_HZ_FULL_ALL=y enabled? If yes then please disable > > > > it. > > > > > > > > Frederic, is there a fix for that? The Kconfig help text for CONFIG_NO_HZ_FULL_ALL > > > > says:: > > > > > > > > CONFIG_NO_HZ_FULL_ALL: > > > > > > > > If the user doesn't pass the nohz_full boot option to > > > > define the range of full dynticks CPUs, consider that all > > > > CPUs in the system are full dynticks by default. > > > > Note the boot CPU will still be kept outside the range to > > > > handle the timekeeping duty. > > > > > > > > I can see people enabling that. Why are all CPUs lost if it's done? > > > > > > Simple. Rik made it such that cpu_isolated_map is immune to cpusets, > > > and Chris made tick_nohz_full_mask automatically set cpu_isolated_map, > > > so now if nohz_full is ever turned on, that CPU is gone from the generic > > > pool forever, with obvious consequences for CONFIG_NO_HZ_FULL_ALL. > > > > > > Lovely eh? > > > > Which commit is that? Needs to be reverted... > > 8cb9764f nohz: Set isolcpus when nohz_full is set > > That's the one that makes them all automatically go away. Ok, looks like a patch with good intentions but bad effects. Mind sending a revert patch, changelogged, signed off? Thanks, Ingo