From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id CBB6CC433EF for ; Tue, 2 Nov 2021 03:21:28 +0000 (UTC) Received: from smtp3.osuosl.org (smtp3.osuosl.org [140.211.166.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 5AC6F60E08 for ; Tue, 2 Nov 2021 03:21:28 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 5AC6F60E08 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=mediatek.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=lists.linux-foundation.org Received: from localhost (localhost [127.0.0.1]) by smtp3.osuosl.org (Postfix) with ESMTP id 088576059D; Tue, 2 Nov 2021 03:21:28 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp3.osuosl.org ([127.0.0.1]) by localhost (smtp3.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GK13ko_wHo9V; Tue, 2 Nov 2021 03:21:27 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [IPv6:2605:bc80:3010:104::8cd3:938]) by smtp3.osuosl.org (Postfix) with ESMTPS id A301160655; Tue, 2 Nov 2021 03:21:26 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id 7912EC0012; Tue, 2 Nov 2021 03:21:26 +0000 (UTC) Received: from smtp2.osuosl.org (smtp2.osuosl.org [140.211.166.133]) by lists.linuxfoundation.org (Postfix) with ESMTP id C36FCC000E for ; Tue, 2 Nov 2021 03:21:24 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp2.osuosl.org (Postfix) with ESMTP id A9309401CA for ; Tue, 2 Nov 2021 03:21:24 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp2.osuosl.org ([127.0.0.1]) by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id cDJhrMaYn2A8 for ; Tue, 2 Nov 2021 03:21:20 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.8.0 Received: from mailgw01.mediatek.com (unknown [60.244.123.138]) by smtp2.osuosl.org (Postfix) with ESMTPS id EB991400C7 for ; Tue, 2 Nov 2021 03:21:19 +0000 (UTC) X-UUID: 98af482b8778443ca1aa8da941edd2f1-20211102 X-UUID: 98af482b8778443ca1aa8da941edd2f1-20211102 Received: from mtkcas10.mediatek.inc [(172.21.101.39)] by mailgw01.mediatek.com (envelope-from ) (Generic MTA with TLSv1.2 ECDHE-RSA-AES256-SHA384 256/256) with ESMTP id 571906133; Tue, 02 Nov 2021 11:21:16 +0800 Received: from mtkmbs10n1.mediatek.inc (172.21.101.34) by mtkmbs10n2.mediatek.inc (172.21.101.183) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.792.3; Tue, 2 Nov 2021 11:21:16 +0800 Received: from mtksdccf07 (172.21.84.99) by mtkmbs10n1.mediatek.inc (172.21.101.73) with Microsoft SMTP Server id 15.2.792.15 via Frontend Transport; Tue, 2 Nov 2021 11:21:16 +0800 Message-ID: Subject: Re: [PATCH] dma-direct: fix DMA_ATTR_NO_KERNEL_MAPPING From: Walter Wu To: Ard Biesheuvel Date: Tue, 2 Nov 2021 11:21:16 +0800 In-Reply-To: References: <20211101031558.7184-1-walter-zh.wu@mediatek.com> <76840b40fcf26a65467931a73f236982ad39989c.camel@mediatek.com> X-Mailer: Evolution 3.28.5-0ubuntu0.18.04.2 MIME-Version: 1.0 X-MTK: N Cc: wsd_upstream , Linux Kernel Mailing List , Linux IOMMU , linux-mediatek@lists.infradead.org, Matthias Brugger , Andrew Morton , Robin Murphy , Christoph Hellwig , Linux ARM X-BeenThere: iommu@lists.linux-foundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Development issues for Linux IOMMU support List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: iommu-bounces@lists.linux-foundation.org Sender: "iommu" On Mon, 2021-11-01 at 15:17 +0100, Ard Biesheuvel wrote: > On Mon, 1 Nov 2021 at 13:21, Walter Wu > wrote: > > > > Hi Ard, > > > > On Mon, 2021-11-01 at 09:34 +0100, Ard Biesheuvel wrote: > > > On Mon, 1 Nov 2021 at 04:17, Walter Wu > > > > > > wrote: > > > > > > > > DMA_ATTR_NO_KERNEL_MAPPING is to avoid creating a kernel > > > > mapping > > > > for the allocated buffer, but current implementation is that > > > > PTE of allocated buffer in kernel page table is valid. So we > > > > should set invalid for PTE of allocate buffer so that there are > > > > no kernel mapping for the allocated buffer. > > > > > > > > In some cases, we don't hope the allocated buffer to be read > > > > by cpu or speculative execution, so we use > > > > DMA_ATTR_NO_KERNEL_MAPPING > > > > to get no kernel mapping in order to achieve this goal. > > > > > > > > Signed-off-by: Walter Wu > > > > Cc: Christoph Hellwig > > > > Cc: Marek Szyprowski > > > > Cc: Robin Murphy > > > > Cc: Matthias Brugger > > > > Cc: Andrew Morton > > > > --- > > > > kernel/dma/direct.c | 8 ++++++++ > > > > 1 file changed, 8 insertions(+) > > > > > > > > diff --git a/kernel/dma/direct.c b/kernel/dma/direct.c > > > > index 4c6c5e0635e3..aa10b4c5d762 100644 > > > > --- a/kernel/dma/direct.c > > > > +++ b/kernel/dma/direct.c > > > > @@ -13,6 +13,7 @@ > > > > #include > > > > #include > > > > #include > > > > +#include > > > > #include "direct.h" > > > > > > > > /* > > > > @@ -169,6 +170,9 @@ void *dma_direct_alloc(struct device *dev, > > > > size_t size, > > > > if (!PageHighMem(page)) > > > > arch_dma_prep_coherent(page, size); > > > > *dma_handle = phys_to_dma_direct(dev, > > > > page_to_phys(page)); > > > > + /* remove kernel mapping for pages */ > > > > + set_memory_valid((unsigned > > > > long)phys_to_virt(dma_to_phys(dev, *dma_handle)), > > > > + size >> PAGE_SHIFT, 0); > > > > > > This only works if the memory is mapped at page granularity in > > > the > > > linear region, and you cannot rely on that. Many architectures > > > prefer > > > block mappings for the linear region, and arm64 will only use > > > page > > > mappings if rodata=full is set (which is set by default but can > > > be > > > overridden on the kernel command line) > > > > > > > We mainly want to solve arm64 arch. > > Solve what? Our platform is arch64. We need a dynamic allocated buffer from CMA is not to read by CPU peculative execution, so we need to remove its kernel mapping. > > RODATA_FULL_DEFAULT_ENABLED should > > be the arm64 config. If we use CONFIG_RODATA_FULL_DEFAULT_ENABLED > > to > > check whether it call set_memory_valid(). It should avoid other > > architectures. Do you think this method is work? > > > > No. Try it with rodata=off (or rodata=on for that matter) and see > what happens. > I try with rodata=[off/on] on qemu, it looks like boot pass. see below. [ 0.000000] Kernel command line: root=/dev/ram0 rw rootfstype=ext4 rodata=off console=ttyAMA0 rdinit=qemu/ramdisk.img earlyprintk=serial I also try with rodata=off on our platform and do stress test, it looks like pass. Thanks. Walter > > Thanks for your explaination and suggestion. > > > > YW > > > > > > > > > > /* return the page pointer as the opaque cookie > > > > */ > > > > return page; > > > > } > > > > @@ -278,6 +282,10 @@ void dma_direct_free(struct device *dev, > > > > size_t size, > > > > > > > > if ((attrs & DMA_ATTR_NO_KERNEL_MAPPING) && > > > > !force_dma_unencrypted(dev) && > > > > !is_swiotlb_for_alloc(dev)) { > > > > + size = PAGE_ALIGN(size); > > > > + /* create kernel mapping for pages */ > > > > + set_memory_valid((unsigned > > > > long)phys_to_virt(dma_to_phys(dev, dma_addr)), > > > > + size >> PAGE_SHIFT, 1); > > > > /* cpu_addr is a struct page cookie, not a > > > > kernel > > > > address */ > > > > dma_free_contiguous(dev, cpu_addr, size); > > > > return; > > > > -- > > > > 2.18.0 > > > > > > > > > > > > _______________________________________________ > > > > linux-arm-kernel mailing list > > > > linux-arm-kernel@lists.infradead.org > > > > > > > > https://urldefense.com/v3/__http://lists.infradead.org/mailman/listinfo/linux-arm-kernel__;!!CTRNKA9wMg0ARbw!16dLCjnvtRkaRLeCO9AQ7Fund5XL0FicZmeVaU3-WkFymr-0lbITfzwrvoJpiHlqnqIu-g$ > > > > _______________________________________________ iommu mailing list iommu@lists.linux-foundation.org https://lists.linuxfoundation.org/mailman/listinfo/iommu