From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-10.0 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 02713C433E0 for ; Wed, 29 Jul 2020 05:05:18 +0000 (UTC) Received: from merlin.infradead.org (merlin.infradead.org [205.233.59.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id C36342074B for ; Wed, 29 Jul 2020 05:05:17 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="KNWmCBHe"; dkim=fail reason="signature verification failed" (1024-bit key) header.d=mg.codeaurora.org header.i=@mg.codeaurora.org header.b="MUyQDBHu" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C36342074B Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=codeaurora.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Type: Content-Transfer-Encoding:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:Message-ID:References:In-Reply-To:Subject:To:From: Date:MIME-Version:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=dxARw+UkgWxHPp9py3Xttr46a/5FV15yWpOFqGJzyHI=; b=KNWmCBHecHR6Psu+/O+bBErKp Wo08C3Qd+P9/nOcIVoOvlgzDdkMYTchJRFfDqZ+w9DMaIe/5m301Xk0uPI6rrYUrcvV+w72LHoRSi XJ92TDVTq7Zs+nXJEjMAXlxBoPmCEceAW+ztB4GKAbl5ZgvrBVDluYA3r7UPM3gCq8mErky9X2DXM vrjAioGu9UAZHitJnY3pPHf26IDO+1eVCwwDC5vQW0H8piDVry5EbdnSe5VaTnYmzEycOJLnVYycA /qZwL02AYWpqZ7UnlWO7m9zpFwWOVxQyBINa6rddP2SIZhO/+5a/0N6bV9lXLUBHlx+AKpccku1ql cr59zhc4g==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1k0eG6-0002yz-3k; Wed, 29 Jul 2020 05:04:06 +0000 Received: from m43-7.mailgun.net ([69.72.43.7]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1k0eG3-0002yV-6X for linux-arm-kernel@lists.infradead.org; Wed, 29 Jul 2020 05:04:04 +0000 DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mg.codeaurora.org; q=dns/txt; s=smtp; t=1595999042; h=Message-ID: References: In-Reply-To: Subject: Cc: To: From: Date: Content-Transfer-Encoding: Content-Type: MIME-Version: Sender; bh=uy1CHEEp/QDUXfLSRvgW4cSL35sMtji9dnF2rf/Lqn0=; b=MUyQDBHukt2Bt1pQ4Nr2QnAKAHxq0Q2Uz+Oc7f/Mnfcn2NZ/6cPLS+E28CzqXUS0XmySxpFJ pc7BUWPWf5Qk2HiCTsfXg5haAaeohVa1ZHxF/VkyJlOLaONQeHk9o5uc0JDAfZqZyQ8P/dKN y0YC038UiNcqgnjHf9Hlk7lEFyk= X-Mailgun-Sending-Ip: 69.72.43.7 X-Mailgun-Sid: WyJiYzAxZiIsICJsaW51eC1hcm0ta2VybmVsQGxpc3RzLmluZnJhZGVhZC5vcmciLCAiYmU5ZTRhIl0= Received: from smtp.codeaurora.org (ec2-35-166-182-171.us-west-2.compute.amazonaws.com [35.166.182.171]) by smtp-out-n08.prod.us-east-1.postgun.com with SMTP id 5f210341a61bb9e3f53ef71e (version=TLS1.2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256); Wed, 29 Jul 2020 05:04:01 GMT Received: by smtp.codeaurora.org (Postfix, from userid 1001) id 9A2A7C433CB; Wed, 29 Jul 2020 05:04:00 +0000 (UTC) Received: from mail.codeaurora.org (localhost.localdomain [127.0.0.1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: saiprakash.ranjan) by smtp.codeaurora.org (Postfix) with ESMTPSA id B2026C433C6; Wed, 29 Jul 2020 05:03:58 +0000 (UTC) MIME-Version: 1.0 Date: Wed, 29 Jul 2020 10:33:58 +0530 From: Sai Prakash Ranjan To: Mike Leach Subject: Re: [PATCHv2] coresight: etm4x: Fix etm4_count race by moving cpuhp callbacks to init In-Reply-To: References: <20200728075102.30807-1-saiprakash.ranjan@codeaurora.org> Message-ID: <08767949db1c9e142d29e8d3ab16bd1f@codeaurora.org> X-Sender: saiprakash.ranjan@codeaurora.org User-Agent: Roundcube Webmail/1.3.9 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20200729_010403_749469_7EE2BC47 X-CRM114-Status: GOOD ( 28.68 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Mathieu Poirier , Suzuki K Poulose , linux-arm-msm@vger.kernel.org, Coresight ML , Linux Kernel Mailing List , Stephen Boyd , linux-arm-kernel Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Hi Mike, On 2020-07-29 01:46, Mike Leach wrote: > Hi Sai, > > On Tue, 28 Jul 2020 at 08:51, Sai Prakash Ranjan > wrote: >> >> etm4_count keeps track of number of ETMv4 registered and on some >> systems, >> a race is observed on etm4_count variable which can lead to multiple >> calls >> to cpuhp_setup_state_nocalls_cpuslocked(). This function internally >> calls >> cpuhp_store_callbacks() which prevents multiple registrations of >> callbacks >> for a given state and due to this race, it returns -EBUSY leading to >> ETM >> probe failures like below. >> >> coresight-etm4x: probe of 7040000.etm failed with error -16 >> >> This race can easily be triggered with async probe by setting probe >> type >> as PROBE_PREFER_ASYNCHRONOUS and with ETM power management property >> "arm,coresight-loses-context-with-cpu". >> >> Prevent this race by moving cpuhp callbacks to etm driver init since >> the >> cpuhp callbacks doesn't have to depend on the etm4_count and can be >> once >> setup during driver init. Similarly we move cpu_pm notifier >> registration >> to driver init and completely remove etm4_count usage. >> >> Fixes: 9b6a3f3633a5 ("coresight: etmv4: Fix CPU power management setup >> in probe() function") >> Fixes: 58eb457be028 ("hwtracing/coresight-etm4x: Convert to hotplug >> state machine") >> Suggested-by: Suzuki K Poulose >> Signed-off-by: Sai Prakash Ranjan >> --- >> >> Changes in v2: >> * Rearrange cpuhp callbacks and move them to driver init (Suzuki K >> Poulose) >> >> --- >> drivers/hwtracing/coresight/coresight-etm4x.c | 51 >> ++++++++++--------- >> 1 file changed, 27 insertions(+), 24 deletions(-) >> >> diff --git a/drivers/hwtracing/coresight/coresight-etm4x.c >> b/drivers/hwtracing/coresight/coresight-etm4x.c >> index 6d7d2169bfb2..adb71987a1e3 100644 >> --- a/drivers/hwtracing/coresight/coresight-etm4x.c >> +++ b/drivers/hwtracing/coresight/coresight-etm4x.c >> @@ -48,8 +48,6 @@ module_param(pm_save_enable, int, 0444); >> MODULE_PARM_DESC(pm_save_enable, >> "Save/restore state on power down: 1 = never, 2 = >> self-hosted"); >> >> -/* The number of ETMv4 currently registered */ >> -static int etm4_count; >> static struct etmv4_drvdata *etmdrvdata[NR_CPUS]; >> static void etm4_set_default_config(struct etmv4_config *config); >> static int etm4_set_event_filters(struct etmv4_drvdata *drvdata, >> @@ -1403,12 +1401,9 @@ static int etm4_pm_setup_cpuslocked(void) >> { > > consider renaming this to etm4_pm_setup() and handing any cpu locking > inside the function. > In the circumstances - as part of the driver init rather than probe it > may be sufficient to call the cpuhp_setup functions without the > _cpuslocked suffix and allow the calls to lock the cpus as they are > made. > i.e. cpuhp_setup_state_nocalls_cpuslocked() => > cpuhp_setup_state_nocalls() Sure, will make this change. > >> int ret; >> >> - if (etm4_count++) >> - return 0; >> - >> ret = cpu_pm_register_notifier(&etm4_cpu_pm_nb); >> if (ret) >> - goto reduce_count; >> + return ret; >> >> ret = >> cpuhp_setup_state_nocalls_cpuslocked(CPUHP_AP_ARM_CORESIGHT_STARTING, >> >> "arm/coresight4:starting", >> @@ -1432,17 +1427,11 @@ static int etm4_pm_setup_cpuslocked(void) >> >> unregister_notifier: >> cpu_pm_unregister_notifier(&etm4_cpu_pm_nb); >> - >> -reduce_count: >> - --etm4_count; >> return ret; >> } >> >> static void etm4_pm_clear(void) >> { >> - if (--etm4_count != 0) >> - return; >> - >> cpu_pm_unregister_notifier(&etm4_cpu_pm_nb); >> cpuhp_remove_state_nocalls(CPUHP_AP_ARM_CORESIGHT_STARTING); >> if (hp_online) { >> @@ -1498,22 +1487,12 @@ static int etm4_probe(struct amba_device >> *adev, const struct amba_id *id) >> if (!desc.name) >> return -ENOMEM; >> >> - cpus_read_lock(); >> etmdrvdata[drvdata->cpu] = drvdata; >> >> if (smp_call_function_single(drvdata->cpu, >> etm4_init_arch_data, drvdata, 1)) >> dev_err(dev, "ETM arch init failed\n"); >> >> - ret = etm4_pm_setup_cpuslocked(); >> - cpus_read_unlock(); >> - >> - /* etm4_pm_setup_cpuslocked() does its own cleanup - exit on >> error */ >> - if (ret) { >> - etmdrvdata[drvdata->cpu] = NULL; >> - return ret; >> - } >> - >> if (etm4_arch_supported(drvdata->arch) == false) { >> ret = -EINVAL; >> goto err_arch_supported; >> @@ -1560,7 +1539,6 @@ static int etm4_probe(struct amba_device *adev, >> const struct amba_id *id) >> >> err_arch_supported: >> etmdrvdata[drvdata->cpu] = NULL; >> - etm4_pm_clear(); >> return ret; >> } >> >> @@ -1598,4 +1576,29 @@ static struct amba_driver etm4x_driver = { >> .probe = etm4_probe, >> .id_table = etm4_ids, >> }; >> -builtin_amba_driver(etm4x_driver); >> + >> +static int __init etm4x_init(void) >> +{ >> + int ret; >> + >> + cpus_read_lock(); >> + ret = etm4_pm_setup_cpuslocked(); >> + cpus_read_unlock(); > > See my comment above about rename and use of cpus_read_lock > Yes, thanks for the review Mike. Thanks, Sai -- QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, hosted by The Linux Foundation _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel