From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 67411C3A5A0 for ; Mon, 20 Apr 2020 12:36:41 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 15CD120735 for ; Mon, 20 Apr 2020 12:36:41 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="KM7PsxqH" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 15CD120735 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=arm.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+infradead-linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20170209; h=Sender: Content-Transfer-Encoding:Content-Type:Cc:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=Lv+TPU51dO1E8JR+o/xyyZlWyUiFIGDbTjCaN6XwK30=; b=KM7PsxqHrvGaCt KrCZi/KcInTF6+Z8sd7YQkpPE9eWctc7V7WL3ayMX5CqeQXFSuX6oKdQXcnFWpgNwaFrasSEiAddj 6eE9OMrBX2rtHlt9sSVj4kn/g5b6V5yXUNZpKCpyEFQ+6q4IRWQ1GUKbnNyNTfNy0sFECIz2CUBA4 d4RugUNpVdSV5tEqEMQ0KUFM3e+IdK5VpcV/ZvhkmAkjZnuH3aYLTFlCziq6WtRnMX2Wqnt67M5ck n9aZL9Lnz8moNcZPuKwk3D5JNp1d4vxchNeiCFudgVsUx3s/h0sxJD4L2S8ZB2nwj+QyoceFN5GZ5 LiMs1MO99rpiziwM+New==; Received: from localhost ([127.0.0.1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1jQVfE-00054e-BS; Mon, 20 Apr 2020 12:36:40 +0000 Received: from foss.arm.com ([217.140.110.172]) by bombadil.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1jQVfB-00052R-Co for linux-arm-kernel@lists.infradead.org; Mon, 20 Apr 2020 12:36:38 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id DAF211FB; Mon, 20 Apr 2020 05:36:34 -0700 (PDT) Received: from C02TD0UTHF1T.local (unknown [10.57.30.55]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 5F1423F237; Mon, 20 Apr 2020 05:36:31 -0700 (PDT) Date: Mon, 20 Apr 2020 13:36:28 +0100 From: Mark Rutland To: Will Deacon Subject: Re: [EXT] Re: [PATCH v3 03/13] task_isolation: add instruction synchronization memory barrier Message-ID: <20200420123628.GB69441@C02TD0UTHF1T.local> References: <4473787e1b6bc3cc226067e8d122092a678b63de.camel@marvell.com> <07c25c246c55012981ec0296eee23e68c719333a.camel@marvell.com> <20200415124427.GB28304@C02TD0UTHF1T.local> <20200420122350.GB12889@willie-the-truck> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20200420122350.GB12889@willie-the-truck> X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20200420_053637_530733_495B8278 X-CRM114-Status: GOOD ( 29.07 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "linux-arch@vger.kernel.org" , "catalin.marinas@arm.com" , "peterz@infradead.org" , Alex Belits , "frederic@kernel.org" , "linux-kernel@vger.kernel.org" , "rostedt@goodmis.org" , "davem@davemloft.net" , "netdev@vger.kernel.org" , "linux-api@vger.kernel.org" , Prasun Kapoor , "tglx@linutronix.de" , "mingo@kernel.org" , "linux-arm-kernel@lists.infradead.org" Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+infradead-linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Mon, Apr 20, 2020 at 01:23:51PM +0100, Will Deacon wrote: > On Sun, Apr 19, 2020 at 05:02:01AM +0000, Alex Belits wrote: > > On Wed, 2020-04-15 at 13:44 +0100, Mark Rutland wrote: > > > On Thu, Apr 09, 2020 at 03:17:40PM +0000, Alex Belits wrote: > > > > Some architectures implement memory synchronization instructions > > > > for > > > > instruction cache. Make a separate kind of barrier that calls them. > > > > > > Modifying the instruction caches requries more than an ISB, and the > > > 'IMB' naming implies you're trying to order against memory accesses, > > > which isn't what ISB (generally) does. > > > > > > What exactly do you want to use this for? > > > > I guess, there should be different explanation and naming. > > > > The intention is to have a separate barrier that causes cache > > synchronization event, for use in architecture-independent code. I am > > not sure, what exactly it should do to be implemented in architecture- > > independent manner, so it probably only makes sense along with a > > regular memory barrier. > > > > The particular place where I had to use is the code that has to run > > after isolated task returns to the kernel. In the model that I propose > > for task isolation, remote context synchronization is skipped while > > task is in isolated in userspace (it doesn't run kernel, and kernel > > does not modify its userspace code, so it's harmless until entering the > > kernel). > > > So it will skip the results of kick_all_cpus_sync() that was > > that was called from flush_icache_range() and other similar places. > > This means that once it's out of userspace, it should only run > > some "safe" kernel entry code, and then synchronize in some manner that > > avoids race conditions with possible IPIs intended for context > > synchronization that may happen at the same time. My next patch in the > > series uses it in that one place. > > > > Synchronization will have to be implemented without a mandatory > > interrupt because it may be triggered locally, on the same CPU. On ARM, > > ISB is definitely necessary there, however I am not sure, how this > > should look like on x86 and other architectures. On ARM this probably > > still should be combined with a real memory barrier and cache > > synchronization, however I am not entirely sure about details. Would > > it make more sense to run DMB, IC and ISB? > > IIUC, we don't need to do anything on arm64 because taking an exception acts > as a context synchronization event, so I don't think you should try to > expose this as a new barrier macro. Instead, just make it a pre-requisite > that architectures need to ensure this behaviour when entering the kernel > from userspace if they are to select HAVE_ARCH_TASK_ISOLATION. The CSE from the exception isn't sufficient here, because it needs to occur after the CPU has re-registered to receive IPIs for kick_all_cpus_sync(). Otherwise there's a window between taking the exception and re-registering where a necessary context synchronization event can be missed. e.g. CPU A CPU B [ Modifies some code ] [ enters exception ] [ D cache maintenance ] [ I cache maintenance ] [ IPI ] // IPI not taken ... [ register for IPI ] [ IPI completes ] [ execute stale code here ] However, I think 'IMB' is far too generic, and we should have an arch hook specific to task isolation, as it's far less likely to be abused as IMB will. Thanks, Mark. _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel