From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 50342C433FE for ; Fri, 18 Nov 2022 12:35:00 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=/cXX4t+zXQ0wT6kA4AZ4JFqPOipk55W94SKbbTKAMy4=; b=sLucGQnkAMeXWJ 7FbRm3MdtfMvKhoaPVPGYvkNTaJBKnkUG0oGxV4P7FCAfYM1pSzUljhqF/necboiz5BDZrAJOaaXg 0MwxeZJ9R+J1fC4sitOJChs65XjFoIuBV2iIa+a+eAuyyzDMdBJfcAWr6PpBQDlKjrPhZkmsPs5Co ghQSFzR6FoGw4yNBmjse5qjRwNHStU01RLcjiEyieuMmlyeHLLuVdqUekzg4S8XG0/N8VugTexZg5 JaXvSE1m/HOyp2hrdJb/KAuF1P/b+5KikGVGwCbpIZGZ57xXVWu5k1gn4ox66uhdLEjsIMilq4Slz HybRtt94BnbD86NlQlow==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1ow0ZG-003uC9-6l; Fri, 18 Nov 2022 12:34:02 +0000 Received: from dfw.source.kernel.org ([139.178.84.217]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1ow0ZD-003uAa-Dc for linux-arm-kernel@lists.infradead.org; Fri, 18 Nov 2022 12:34:00 +0000 Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id DE30A624CC; Fri, 18 Nov 2022 12:33:55 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 88EF0C433C1; Fri, 18 Nov 2022 12:33:53 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1668774835; bh=Z2fM/T11X1JbB9QleHXKH+hbS5Bk9HGFuktcfgKbH8A=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=T3iPjRBNF2ZfqPaqUr6W4k0+iNaLxUOY8QUNc6W9c8v3VCztTphdYJuloJRAzvBJG E7AJEScYrW7G0Of/D1PzDVOt4Hq+dsxEbFr4I/LY5z8gwrOk5DxMbxK0pmReey+qMO D8dAqS629neXU5HMu98AKDTXnIvB1iQWyIlaNSULIfJ8mPf43G+YTLwAvsLqzqXHed ltLDl/TzHS4u6+wPqRDPpayfu9Zw0hdW/96V+KIE0SmnuiB8qtPnTTOD6GCMx3fUYn znegCqRe2NvbhDS3QnYQ36vNX5t8d6nCR20XBTwrpBd/9ktBGg+whKLnXDL0jKdRIR EpVKwnkmjzAxw== Date: Fri, 18 Nov 2022 12:33:49 +0000 From: Will Deacon To: Manivannan Sadhasivam Cc: Catalin Marinas , Robin Murphy , amit.pundir@linaro.org, andersson@kernel.org, quic_sibis@quicinc.com, sumit.semwal@linaro.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH] Revert "arm64: dma: Drop cache invalidation from arch_dma_prep_coherent()" Message-ID: <20221118123349.GC3697@willie-the-truck> References: <20221114110329.68413-1-manivannan.sadhasivam@linaro.org> <20221114141109.GG30263@willie-the-truck> <1659929b-1372-cea6-5840-c58369a4252d@arm.com> <20221118105402.GA184726@thinkpad> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20221118105402.GA184726@thinkpad> User-Agent: Mutt/1.10.1 (2018-07-13) X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20221118_043359_566205_C7383E8F X-CRM114-Status: GOOD ( 33.57 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Fri, Nov 18, 2022 at 04:24:02PM +0530, Manivannan Sadhasivam wrote: > On Mon, Nov 14, 2022 at 05:38:00PM +0000, Catalin Marinas wrote: > > On Mon, Nov 14, 2022 at 03:14:21PM +0000, Robin Murphy wrote: > > > On 2022-11-14 14:11, Will Deacon wrote: > > > > On Mon, Nov 14, 2022 at 04:33:29PM +0530, Manivannan Sadhasivam wrote: > > > > > This reverts commit c44094eee32f32f175aadc0efcac449d99b1bbf7. > > > > > > > > > > As reported by Amit [1], dropping cache invalidation from > > > > > arch_dma_prep_coherent() triggers a crash on the Qualcomm SM8250 platform > > > > > (most probably on other Qcom platforms too). The reason is, Qcom > > > > > qcom_q6v5_mss driver copies the firmware metadata and shares it with modem > > > > > for validation. The modem has a secure block (XPU) that will trigger a > > > > > whole system crash if the shared memory is accessed by the CPU while modem > > > > > is poking at it. > > > > > > > > > > To avoid this issue, the qcom_q6v5_mss driver allocates a chunk of memory > > > > > with no kernel mapping, vmap's it, copies the firmware metadata and > > > > > unvmap's it. Finally the address is then shared with modem for metadata > > > > > validation [2]. > > > > > > > > > > Now because of the removal of cache invalidation from > > > > > arch_dma_prep_coherent(), there will be cache lines associated with this > > > > > memory even after sharing with modem. So when the CPU accesses it, the XPU > > > > > violation gets triggered. > > > > > > > > This last past is a non-sequitur: the buffer is no longer mapped on the CPU > > > > side, so how would the CPU access it? > > > > > > Right, for the previous change to have made a difference the offending part > > > of this buffer must be present in some cache somewhere *before* the DMA > > > buffer allocation completes. > > > > > > Clearly that driver is completely broken though. If the DMA allocation came > > > from a no-map carveout vma_dma_alloc_from_dev_coherent() then the vmap() > > > shenanigans wouldn't work, so if it backed by struct pages then the whole > > > dance is still pointless because *a cacheable linear mapping exists*, and > > > it's just relying on the reduced chance that anything's going to re-fetch > > > the linear map address after those pages have been allocated, exactly as I > > > called out previously[1]. > > > > So I guess a DMA pool that's not mapped in the linear map, together with > > memremap() instead of vmap(), would work around the issue. But the > > driver needs fixing, not the arch code. > > > > Okay, thanks for the hint. Can you share how to allocate the dma-pool that's > not part of the kernel's linear map? I looked into it but couldn't find a way. The no-map property should take care of this iirc Will _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel