From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.3 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_2 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 936FAC433E1 for ; Tue, 18 Aug 2020 12:29:36 +0000 (UTC) Received: from merlin.infradead.org (merlin.infradead.org [205.233.59.134]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 5DB4A2076D for ; Tue, 18 Aug 2020 12:29:36 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.b="2VeRjoZq" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5DB4A2076D Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=Huawei.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=merlin.20170209; h=Sender:Content-Transfer-Encoding: Content-Type:Cc:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To:Message-ID: Subject:To:From:Date:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=VtMpQ4mvzt1nn+SrQVca38oZfTALwMZFj07Xi2MX9og=; b=2VeRjoZq41LRVlNe8RjennNTg w+iFxKyBnADN9+7bwQKnDhb24+mdximiw0m0bBstAk5UrqnY0NYzpwHjNlu0RHXu/9RKjl92ZAhOS eEKkFXauOC9SdNCRZvTIQmL4H80yO66/CJL6pcJVT/pgCvCwdF8okeOHy6fWecj96+TumtGmi7bXC V/9fKa3W11kw+pET069oO+I+2oo9lNhhgHC3Ylumbrhg8qektGArWVGFf6dUqqN0XOZ9jdAElpcEf 0fSdT7CRns+F7/8hFXJsTl4jv1VRR/h2Qbtr9rFOb3SV26IKYG1phNRA0La5f23PF2haqkDlIO93V F+419+eeQ==; Received: from localhost ([::1] helo=merlin.infradead.org) by merlin.infradead.org with esmtp (Exim 4.92.3 #3 (Red Hat Linux)) id 1k80ij-00082C-Or; Tue, 18 Aug 2020 12:28:05 +0000 Received: from lhrrgout.huawei.com ([185.176.76.210] helo=huawei.com) by merlin.infradead.org with esmtps (Exim 4.92.3 #3 (Red Hat Linux)) id 1k80ig-00081J-5L for linux-arm-kernel@lists.infradead.org; Tue, 18 Aug 2020 12:28:03 +0000 Received: from lhreml710-chm.china.huawei.com (unknown [172.18.7.107]) by Forcepoint Email with ESMTP id DD78C3F249352D8EDAFF; Tue, 18 Aug 2020 13:27:56 +0100 (IST) Received: from localhost (10.52.121.15) by lhreml710-chm.china.huawei.com (10.201.108.61) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1913.5; Tue, 18 Aug 2020 13:27:56 +0100 Date: Tue, 18 Aug 2020 13:26:25 +0100 From: Jonathan Cameron To: Anshuman Khandual Subject: Re: [PATCH 1/2] arm64/mm: Change THP helpers to comply with generic MM semantics Message-ID: <20200818132625.00003d05@Huawei.com> In-Reply-To: <8db455b6-8fe5-b552-119f-4abab0cc8501@arm.com> References: <1597655984-15428-1-git-send-email-anshuman.khandual@arm.com> <1597655984-15428-2-git-send-email-anshuman.khandual@arm.com> <20200818101301.000027ef@Huawei.com> <8db455b6-8fe5-b552-119f-4abab0cc8501@arm.com> Organization: Huawei Technologies Research and Development (UK) Ltd. X-Mailer: Claws Mail 3.17.4 (GTK+ 2.24.32; i686-w64-mingw32) MIME-Version: 1.0 X-Originating-IP: [10.52.121.15] X-ClientProxiedBy: lhreml723-chm.china.huawei.com (10.201.108.74) To lhreml710-chm.china.huawei.com (10.201.108.61) X-CFilter-Loop: Reflected X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20200818_082802_317995_10CCBCA0 X-CRM114-Status: GOOD ( 24.36 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Mark Rutland , Suzuki Poulose , catalin.marinas@arm.com, linux-kernel@vger.kernel.org, linux-mm@kvack.org, Marc Zyngier , akpm@linux-foundation.org, will@kernel.org, linux-arm-kernel@lists.infradead.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Tue, 18 Aug 2020 15:11:58 +0530 Anshuman Khandual wrote: > On 08/18/2020 02:43 PM, Jonathan Cameron wrote: > > On Mon, 17 Aug 2020 14:49:43 +0530 > > Anshuman Khandual wrote: > > > >> pmd_present() and pmd_trans_huge() are expected to behave in the following > >> manner during various phases of a given PMD. It is derived from a previous > >> detailed discussion on this topic [1] and present THP documentation [2]. > >> > >> pmd_present(pmd): > >> > >> - Returns true if pmd refers to system RAM with a valid pmd_page(pmd) > >> - Returns false if pmd does not refer to system RAM - Invalid pmd_page(pmd) > >> > >> pmd_trans_huge(pmd): > >> > >> - Returns true if pmd refers to system RAM and is a trans huge mapping > >> > >> ------------------------------------------------------------------------- > >> | PMD states | pmd_present | pmd_trans_huge | > >> ------------------------------------------------------------------------- > >> | Mapped | Yes | Yes | > >> ------------------------------------------------------------------------- > >> | Splitting | Yes | Yes | > >> ------------------------------------------------------------------------- > >> | Migration/Swap | No | No | > >> ------------------------------------------------------------------------- > >> > >> The problem: > >> > >> PMD is first invalidated with pmdp_invalidate() before it's splitting. This > >> invalidation clears PMD_SECT_VALID as below. > >> > >> PMD Split -> pmdp_invalidate() -> pmd_mkinvalid -> Clears PMD_SECT_VALID > >> > >> Once PMD_SECT_VALID gets cleared, it results in pmd_present() return false > >> on the PMD entry. It will need another bit apart from PMD_SECT_VALID to re- > >> affirm pmd_present() as true during the THP split process. To comply with > >> above mentioned semantics, pmd_trans_huge() should also check pmd_present() > >> first before testing presence of an actual transparent huge mapping. > >> > >> The solution: > >> > >> Ideally PMD_TYPE_SECT should have been used here instead. But it shares the > >> bit position with PMD_SECT_VALID which is used for THP invalidation. Hence > >> it will not be there for pmd_present() check after pmdp_invalidate(). > >> > >> A new software defined PMD_PRESENT_INVALID (bit 59) can be set on the PMD > >> entry during invalidation which can help pmd_present() return true and in > >> recognizing the fact that it still points to memory. > >> > >> This bit is transient. During the split process it will be overridden by a > >> page table page representing normal pages in place of erstwhile huge page. > >> Other pmdp_invalidate() callers always write a fresh PMD value on the entry > >> overriding this transient PMD_PRESENT_INVALID bit, which makes it safe. > >> > >> [1]: https://lkml.org/lkml/2018/10/17/231 > >> [2]: https://www.kernel.org/doc/Documentation/vm/transhuge.txt > > > > Hi Anshuman, > > > > One query on this. From my reading of the ARM ARM, bit 59 is not > > an ignored bit. The exact requirements for hardware to be using > > it are a bit complex though. > > > > It 'might' be safe to use it for this, but if so can we have a comment > > explaining why. Also more than possible I'm misunderstanding things! > > We are using this bit 59 only when the entry is not active from MMU > perspective i.e PMD_SECT_VALID is clear. > Understood. I guess we ran out of bits that were always ignored so had to start using ones that are ignored in this particular state. Jonathan _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel