From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 60E66C433EF for ; Wed, 16 Feb 2022 19:08:20 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:Reply-To:List-Subscribe:List-Help: List-Post:List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=YmNybbt8tbY9+5u38JWBTfOriVuid/39AJwbKvE0r40=; b=k1/KLqZKvN8TCE /jnIw2LivzdfKPgdfKWZl6tjMMO71fy6JY0WygvL7cZLhNh1Wjd7iGm+U3sTAjbJquep09G+qEi3C /hnpvofcreswtAhKTD9H4dOMpghmNdDZLqxbg61yEb3hLG/aM40FHElD2NcJA9eJobN4azTkmAf+v 2Fioz5kXEC4+poVSD3Uwp6bcrsjS1en10BJ/vNIcyDkdTEflfOdod8TqvI455cQcQraHp7dUo6+6J gN1MlZTPIR/CRpo6g/PxYKa/3BlsOcJmDdQKJB8yPRKu0QIbiNJhnkbzTwgRM5EoYMX2i9h+iYT4G xPLs1kDMHoYu87Y3K+Zw==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1nKPdq-008BY9-AY; Wed, 16 Feb 2022 19:07:06 +0000 Received: from dfw.source.kernel.org ([139.178.84.217]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1nKPdm-008BX7-0h; Wed, 16 Feb 2022 19:07:03 +0000 Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 0E62F616AE; Wed, 16 Feb 2022 19:07:01 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 6EE32C004E1; Wed, 16 Feb 2022 19:07:00 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1645038420; bh=O6rg2EA0mmSpBoicY2+Pis/uzSG9J5E6UibqILOjyKw=; h=Date:From:To:Cc:Subject:Reply-To:References:In-Reply-To:From; b=LOf5dpqk49yNupWbhM4D9S7tOGpeM38BEzumCRrduLE79xfb93b/4OpN4bMO3T9fj SIKBTAWJEez+QFt2krProHGJPtVLZy8+vfg/M4Ll6JEc5UZawZ1N8USk6Ko5qBcXae TvSwSfJTko/mQdZHuicQnnGN3pM1+VlbVNm2DRpOOMm6KmNVEyTDJwRniCi6kP9nXC nNO9R4pgVHJaYKf8uEa/dW/H5DaQEPUs7RNhvcWeXjLMpWuAMacFSNrq8719AfbuJd 4xIsmr6bcuexOQZJDk2Dzb61DpCID4xMhmZ8ydIKGpiNj43A813e2naZPGRgYGptqU zHjsk43fRadVg== Received: by paulmck-ThinkPad-P17-Gen-1.home (Postfix, from userid 1000) id 33F275C064D; Wed, 16 Feb 2022 11:07:00 -0800 (PST) Date: Wed, 16 Feb 2022 11:07:00 -0800 From: "Paul E. McKenney" To: Padmanabha Srinivasaiah Cc: Tejun Heo , jiangshanlai@gmail.com, linux-kernel@vger.kernel.org, linux-rpi-kernel@lists.infradead.org, linux-arm-kernel@lists.infradead.org Subject: Re: [PATCH] workqueue: Fix race in schedule and flush work Message-ID: <20220216190700.GL4285@paulmck-ThinkPad-P17-Gen-1> References: <20220210184319.25009-1-treasure4paddy@gmail.com> <20220216184939.GA3868@pswork> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20220216184939.GA3868@pswork> X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20220216_110702_184661_3C8123D9 X-CRM114-Status: GOOD ( 24.99 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: paulmck@kernel.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Wed, Feb 16, 2022 at 07:49:39PM +0100, Padmanabha Srinivasaiah wrote: > On Mon, Feb 14, 2022 at 09:43:52AM -1000, Tejun Heo wrote: > > Hello, > > > > > diff --git a/kernel/workqueue.c b/kernel/workqueue.c > > > index 33f1106b4f99..a3f53f859e9d 100644 > > > --- a/kernel/workqueue.c > > > +++ b/kernel/workqueue.c > > > @@ -3326,28 +3326,38 @@ EXPORT_SYMBOL(cancel_delayed_work_sync); > > > */ > > > int schedule_on_each_cpu(work_func_t func) > > > { > > > - int cpu; > > > struct work_struct __percpu *works; > > > + cpumask_var_t sched_cpumask; > > > + int cpu, ret = 0; > > > > > > - works = alloc_percpu(struct work_struct); > > > - if (!works) > > > + if (!alloc_cpumask_var(&sched_cpumask, GFP_KERNEL)) > > > return -ENOMEM; > > > > > > + works = alloc_percpu(struct work_struct); > > > + if (!works) { > > > + ret = -ENOMEM; > > > + goto free_cpumask; > > > + } > > > + > > > cpus_read_lock(); > > > > > > - for_each_online_cpu(cpu) { > > > + cpumask_copy(sched_cpumask, cpu_online_mask); > > > + for_each_cpu_and(cpu, sched_cpumask, cpu_online_mask) { > > > > This definitely would need a comment explaining what's going on cuz it looks > > weird to be copying the cpumask which is supposed to stay stable due to the > > cpus_read_lock().Given that it can only happen during early boot and the > > online cpus can only be expanding, maybe just add sth like: > > > > if (early_during_boot) { > > for_each_possible_cpu(cpu) > > INIT_WORK(per_cpu_ptr(works, cpu), func); > > } > > > > Thanks tejun for the reply and suggestions. > > Yes, unfortunately cpus_read_lock not keeping cpumask stable at > secondary boot. Not sure, may be it only gurantee 'cpu' dont go down > under cpus_read_[lock/unlock]. > > As suggested will tryout something like: > if (system_state != RUNNING) { > : > } > > BTW, who's calling schedule_on_each_cpu() that early during boot. It makes > > no sense to do this while the cpumasks can't be stabilized. > > > It is implemenation of CONFIG_TASKS_RUDE_RCU. Another option would be to adjust CONFIG_TASKS_RUDE_RCU based on where things are in the boot process. For example: // Wait for one rude RCU-tasks grace period. static void rcu_tasks_rude_wait_gp(struct rcu_tasks *rtp) { if (num_online_cpus() <= 1) return; // Fastpath for only one CPU. rtp->n_ipis += cpumask_weight(cpu_online_mask); schedule_on_each_cpu(rcu_tasks_be_rude); } Easy enough either way! Thanx, Paul _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel