From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.5 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 32D65C433E1 for ; Tue, 28 Jul 2020 01:09:31 +0000 (UTC) Received: from merlin.infradead.org (merlin.infradead.org [205.233.59.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id E0DAE20714 for ; Tue, 28 Jul 2020 01:09:30 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="U54GGFaV"; dkim=fail reason="signature verification failed" (1024-bit key) header.d=mg.codeaurora.org header.i=@mg.codeaurora.org header.b="JV3AhiEw" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org E0DAE20714 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=codeaurora.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References:Message-ID: Subject:To:From:Date:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=VJOfelBQNKaAnaxSas2CX5h/e2uPDtkPYzBPf+qoozc=; b=U54GGFaVZSZWogB51d1A0Dcpk BRZOvspoSgPTRYQlsIvwCkH9jB26nYLgh36zZZEvRqGuoha3f71KbHtjzd0+7QOLg8u24KRHej/S2 Q0qKWQB48/jJixJwvS5JBvqVimCxYL6GvJw/4hXjJ+PvxzlecaOJgy6GbcojJhSH6Wu4T3lja7dJf oVvvqB6yRopmOKuCWsjO8+llOcIWP97llHom1jmsbRo0TR4b4YhhzmF+XzsycfUppX7R84+tCV5LQ v+EF+mwvOWhAfQ+q/YK010bjCRitDx6EVgzAl5VcX39p3deqYFzAyamzsv5S3CZR1C9lrJKq7Cvy9 oXg1pbnrA==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1k0E5b-0001g6-I4; Tue, 28 Jul 2020 01:07:31 +0000 Received: from mail29.static.mailgun.info ([104.130.122.29]) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1k0E5Y-0001ff-Kv for linux-arm-kernel@lists.infradead.org; Tue, 28 Jul 2020 01:07:30 +0000 DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mg.codeaurora.org; q=dns/txt; s=smtp; t=1595898448; h=In-Reply-To: Content-Type: MIME-Version: References: Message-ID: Subject: Cc: To: From: Date: Sender; bh=vuBMVFJUy98CLSfIgRcsiLjCZcmcU2w7R6X5g4r2O8c=; b=JV3AhiEwYgWu/rg60kDz71MrG8LxOwYwyHwAf9u7B4QGsxvFCuVPw73OoqV/5RN5ZiX1ctaA TTCDZlvJucMwe1NtR9681dU9mJdOJUJRdV2ikqfmbAjTAp9LzkD2vGnz0bhsI/rzgB/Cqgjl vhNSnSM1EfCRbZgI8SpKXyt5lMw= X-Mailgun-Sending-Ip: 104.130.122.29 X-Mailgun-Sid: WyJiYzAxZiIsICJsaW51eC1hcm0ta2VybmVsQGxpc3RzLmluZnJhZGVhZC5vcmciLCAiYmU5ZTRhIl0= Received: from smtp.codeaurora.org (ec2-35-166-182-171.us-west-2.compute.amazonaws.com [35.166.182.171]) by smtp-out-n16.prod.us-east-1.postgun.com with SMTP id 5f1f7a4f8db7256a95424c59 (version=TLS1.2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256); Tue, 28 Jul 2020 01:07:27 GMT Received: by smtp.codeaurora.org (Postfix, from userid 1001) id 8A74CC433AD; Tue, 28 Jul 2020 01:07:26 +0000 (UTC) Received: from codeaurora.org (unknown [180.166.53.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: tingwei) by smtp.codeaurora.org (Postfix) with ESMTPSA id 87845C433C6; Tue, 28 Jul 2020 01:07:19 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 smtp.codeaurora.org 87845C433C6 Authentication-Results: aws-us-west-2-caf-mail-1.web.codeaurora.org; dmarc=none (p=none dis=none) header.from=codeaurora.org Authentication-Results: aws-us-west-2-caf-mail-1.web.codeaurora.org; spf=none smtp.mailfrom=tingweiz@codeaurora.org Date: Tue, 28 Jul 2020 09:07:11 +0800 From: Tingwei Zhang To: Mike Leach Subject: Re: [PATCH v4 06/20] coresight: add try_get_module() in coresight_grab_device() Message-ID: <20200728010711.GA12572@codeaurora.org> References: <20200723042802.22511-1-tingwei@codeaurora.org> <20200723042802.22511-7-tingwei@codeaurora.org> <20200725100516.GA18120@codeaurora.org> <20200726013205.GA23391@codeaurora.org> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20200727_210729_172193_5EFAC0B4 X-CRM114-Status: GOOD ( 62.33 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: tsoni@codeaurora.org, Sai Prakash Ranjan , Kim Phillips , Mathieu Poirier , Suzuki K Poulose , Alexander Shishkin , Greg Kroah-Hartman , Coresight ML , Randy Dunlap , Mian Yousaf Kaukab , Russell King , Mao Jinlong , Tingwei Zhang , Leo Yan , linux-arm-kernel Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Hi Mike, On Tue, Jul 28, 2020 at 01:04:21AM +0800, Mike Leach wrote: > Hi Tingwei, > > On Sun, 26 Jul 2020 at 02:32, Tingwei Zhang > wrote: > > > > Hi Mike, > > On Sat, Jul 25, 2020 at 09:51:31PM +0800, Mike Leach wrote: > > > Hi Tingwei, > > > > > > On Sat, 25 Jul 2020 at 11:05, Tingwei Zhang > > > wrote: > > > > > > > > Hi Mike, > > > > > > > > Thu, Jul 23, 2020 at 06:55:47PM +0800, Mike Leach wrote: > > > > > Hi Tingwei, > > > > > > > > > > On Thu, 23 Jul 2020 at 05:28, Tingwei Zhang > > > > > > wrote: > > > > > > > > > > > > When coresight device is in an active session, driver module of > > > > > > that device should not be removed. Use try_get_module() in > > > > > > coresight_grab_device() to prevent module to be unloaded. > > > > > > > > > > > > Signed-off-by: Tingwei Zhang > > > > > > --- > > > > > > drivers/hwtracing/coresight/coresight.c | 27 > > > +++++++++++++++++++++---- > > > > > > 1 file changed, 23 insertions(+), 4 deletions(-) > > > > > > > > > > > > diff --git a/drivers/hwtracing/coresight/coresight.c > > > > > b/drivers/hwtracing/coresight/coresight.c > > > > > > index b7151c5f81b1..17bc76ea86ae 100644 > > > > > > --- a/drivers/hwtracing/coresight/coresight.c > > > > > > +++ b/drivers/hwtracing/coresight/coresight.c > > > > > > @@ -640,7 +640,7 @@ struct coresight_device > > > > > *coresight_get_sink_by_id(u32 id) > > > > > > * don't appear on the trace path, they should be handled along > > > with > > > > > the > > > > > > * the master device. > > > > > > */ > > > > > > -static void coresight_grab_device(struct coresight_device > *csdev) > > > > > > +static int coresight_grab_device(struct coresight_device > *csdev) > > > > > > { > > > > > > int i; > > > > > > > > > > > > @@ -648,10 +648,25 @@ static void coresight_grab_device(struct > > > > > coresight_device *csdev) > > > > > > struct coresight_device *child; > > > > > > > > > > > > child = csdev->pdata->conns[i].child_dev; > > > > > > - if (child && child->type == > > > CORESIGHT_DEV_TYPE_HELPER) > > > > > > + if (child && child->type == > > > CORESIGHT_DEV_TYPE_HELPER) { > > > > > > + if > > > > > (!try_module_get(child->dev.parent->driver->owner)) > > > > > > + goto err; > > > > > > pm_runtime_get_sync(child->dev.parent); > > > > > > + } > > > > > > } > > > > > > + if (!try_module_get(csdev->dev.parent->driver->owner)) > > > > > > + goto err; > > > > > > pm_runtime_get_sync(csdev->dev.parent); > > > > > > + return 0; > > > > > > +err: > > > > > > + for (i--; i >= 0; i--) { > > > > > > + struct coresight_device *child; > > > > > > + > > > > > > + child = csdev->pdata->conns[i].child_dev; > > > > > > + if (child && child->type == > > > CORESIGHT_DEV_TYPE_HELPER) > > > > > > + pm_runtime_put(child->dev.parent); > > > > > > + } > > > > > > + return -ENODEV; > > > > > > } > > > > > > > > > > > > /* > > > > > > @@ -663,12 +678,15 @@ static void coresight_drop_device(struct > > > > > coresight_device *csdev) > > > > > > int i; > > > > > > > > > > > > pm_runtime_put(csdev->dev.parent); > > > > > > + module_put(csdev->dev.parent->driver->owner); > > > > > > for (i = 0; i < csdev->pdata->nr_outport; i++) { > > > > > > struct coresight_device *child; > > > > > > > > > > > > child = csdev->pdata->conns[i].child_dev; > > > > > > - if (child && child->type == > > > CORESIGHT_DEV_TYPE_HELPER) > > > > > > + if (child && child->type == > > > CORESIGHT_DEV_TYPE_HELPER) { > > > > > > pm_runtime_put(child->dev.parent); > > > > > > + > > > module_put(child->dev.parent->driver->owner); > > > > > > + } > > > > > > } > > > > > > } > > > > > > > > > > > > @@ -721,7 +739,8 @@ static int _coresight_build_path(struct > > > > > coresight_device *csdev, > > > > > > if (!node) > > > > > > return -ENOMEM; > > > > > > > > > > > > - coresight_grab_device(csdev); > > > > > > + if (coresight_grab_device(csdev)) > > > > > > + return -ENODEV; > > > > > > node->csdev = csdev; > > > > > > list_add(&node->link, path); > > > > > > > > > > > > -- > > > > > > The Qualcomm Innovation Center, Inc. is a member of the Code > Aurora > > > > > Forum, > > > > > > a Linux Foundation Collaborative Project > > > > > > > > > > > > > > > > The CTI devices are associated with other coresight components > using > > > > > csdev->ect_dev; These are not handled in the main linear trace > path as > > > > > these have a star topology interlinking all components. > > > > > However, when a component has an associated ect_dev then is > enabled at > > > > > the same time as the other component is enabled. > > > > > > > > > > So a module_get/put will be needed for this association to prevent > the > > > > > CTI being removed while a trace session is active. > > > > > I suggest in coresight.c : coresight_control_assoc_ectdev() > > > > > > > > > > > > > In module unload process, devices of that module will be removed. In > > > > this case, cti_remove() is called on all cti device when unloading > > > > cti module. All cti connections is cleaned at that time. > > > > csdev->ect_dev is set to NULL. coresight_control_assoc_ectdev() > > > > will return since since ect_csdev is NULL. > > > > > > > > I think we are safe without holding module reference since cti > > > > driver has done a pretty good job on clean up. > > > > > > > > > > The issue here is not about clean up. We need to keep all the > > > programmed coresight modules loaded and operational while a coresight > > > trace session is in progress. The CTI can be used to control the > > > generation of trace, trigger trace related events etc. > > > If the module is removed while a session is in progress then this > > > programming is lost and the trace data collected may not be what is > > > expected. > > > > > > > Got your point now. In my opinion, CTI is kinda different to other > > coresight components since it's optional. > > > > For other components, they have to been there when path is built or > > the enablement fails. Use can either get a successfully return which > > means it's good and all devices/modules are there until path is > > released, or a failed return which means trace session can't be > > setup. > > > > The module get/put do more than ensure that the system can be enabled. > They ensure that no components in the coresight path can be unloaded > until all paths in use are released. This ensures that clients do not > get the trace system pulled out from underneath - corrupting trace > data, and possibly affecting the client program. > I agree. > > In CTI case, there's no garrantee that CTI related to the trace > > session is there even the enablement is successful. > > And there is no guarantee that it is not programmed to perform a key > task in controlling the generation of trace. > > The entire programmed coresight system must be protected when in use. > That includes CTI devices. Otherwise the integrity of the captured > trace could be compromised, and indeed there may be no trace captured > if this is relying on CTI triggers. > That's correct. If CTI is not there, the trace may be wrong or no trace as all. > >For example, > > One cti is required for ETM tracing session. If cti module is > > unloaded before enable that trace session. The enablement will > > still be successfully done since there's no ect_dev connected > > at all. > > > > My point is holding cti module reference in enable path won't > > fix all the problem. Altenatively, user should be aware that > > unload cti module leads to all cti functioniol failure. > > With current design, the behavior is consistant on cti. User > > can unload cti module whenever he wants but it will break > > the function. > > Precisely - and this is what should never be allowed - why can the CTI > be used to break the trace system but not other components? > We can't prevent user to unload CTI module when there's no active trace session. If we don't allow CTI to be not available, we need to check whether CTI is there in build_path routine or coresight enable routine. We need return failure if CTI is not there when user enables the trace session. Currently, coresight framework check associate CTI device, but if CTI deivce is not probed due to probe failure or module unload, coresight framework assume there's no assocaite CTI device and just continue the enablement. It won't return failure. If we have plan to change CTI check to be mandatory, make the coresight enablement fail if CTI is not there like other trace components. I'm perfect fine to add module_get/module_put for CTI. > Moving forwards we will see users who simply use pre-programmed > settings from client programs such as perf. It may be that some users > do not have the credentials to add and remove modules - this could be > an admin function where larger systems with multiple sessions are in > use. > > > Regards > > Mike > > > > > > Thanks, Tingwei > > > > > Regards > > > > > > Mike > > > > > > > Let me know if you still think we need hold the module reference. > > > > > > > > Thanks, Tingwei > > > > > Regards > > > > > > > > > > Mike > > > > > > > > > > > > > > > -- > > > > > Mike Leach > > > > > Principal Engineer, ARM Ltd. > > > > > Manchester Design Centre. UK > > > > > > > > > > _______________________________________________ > > > > > linux-arm-kernel mailing list > > > > > linux-arm-kernel@lists.infradead.org > > > > > http://lists.infradead.org/mailman/listinfo/linux-arm-kernel > > > > > > > > > > > > -- > > > Mike Leach > > > Principal Engineer, ARM Ltd. > > > Manchester Design Centre. UK > > > > > > _______________________________________________ > > > linux-arm-kernel mailing list > > > linux-arm-kernel@lists.infradead.org > > > http://lists.infradead.org/mailman/listinfo/linux-arm-kernel > > > > -- > Mike Leach > Principal Engineer, ARM Ltd. > Manchester Design Centre. UK > > _______________________________________________ > linux-arm-kernel mailing list > linux-arm-kernel@lists.infradead.org > http://lists.infradead.org/mailman/listinfo/linux-arm-kernel _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel