From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from NAM12-DM6-obe.outbound.protection.outlook.com (mail-dm6nam12on2061.outbound.protection.outlook.com [40.107.243.61]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id D991614000 for ; Thu, 7 Sep 2023 18:15:11 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=S/p7M6mLopwFc5BWOvgORByYdGkjRK4wWv4SPGQA8MAialtFaKPjCi0CJ+tBu1UtBmd/a2epCz5O8Nm3A0Ql0hRC60QXE+khHlhqbNrdUrArN67yMg+TKS0WVGvh6xnFIwFFNiDqEH9STnvl7FG96ytwoS4Q/9RKDyK3i2FpTyzLcM4vHqLm8HfglRDeyphB0fPrYApkdGJw5k5xgt2W/bHPH5gkxe7t++4H2D+s9A7ekLQn1JIQbIIQDm6S2UMvkmm8coL2cj79WKcavrgFInzKH+F9glAAEmrNlpNz86D6pU/9HI4wvPHLMOu7N25o+nr0grUjNAjP5wtchQuriA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=ntxOXAzag4KmsXPbY2xOEHwIZsNihmZ+5XcVn3QEkg4=; b=lkeKx5Fk4EPv4y4GlyJ8qX8CDNlKobG9jp1sLdG3mABaDJ6wCScgPtgiE/9XG8XEJnu3a7VpBaRq2bGJKTIkPjnN08H3BqFYUsQLmFcQ1G+PVoGow266O40QoyzOZAoAPSyOLa4udG+Um53Es2BDmeuEL0+0bUCn4Jb2zP7OYkzts1S+NJZ/0ctzTIsjC8oVUZSyCw22jjvmzrX6kDEbnMDeZBLvgOQfTJ/O2zIb0JW/sG7biP8cU5oeSGFjlUqFAXFk+UgtqpwP196NFC5PPAykjHPtuDaQcq7JD+4Q45/dcP9THwfXu8/prHA3N0SOpxRUPBNhJCRLkLoMb1Jm9w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=lists.infradead.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ntxOXAzag4KmsXPbY2xOEHwIZsNihmZ+5XcVn3QEkg4=; b=fDzpwk30DkpnrP0jOKSLxPNaZNpaVpQlj40bO2T/ecURZimK4+T18LvbTT+n6akdIND1I1AQB51AluXcrKqK8PDl71/BHtk9fE7uv2xN6yfKyld+1eTeyqh5DmiymFSkvQ6XkXYnHACwyHH1Vm2lcw7OHz0uIUvou15CfNjULMYPKDdafvHZj1kthoaW6BWeS0AdZUgstyYxiUSBLHfhhPvJ3cUv9UNp7ANwxSTAiZsdLOnbyZ8sRKhXxJtB1GlosUh2I+M3Q7hSZC1WkzQRKN34GwcO0czdVjv0ysIZY5A+Y+Q4MaRhf7ccE3TlBRKqAvR+8LtQQ5delXeRabPYZg== Received: from DM6PR08CA0046.namprd08.prod.outlook.com (2603:10b6:5:1e0::20) by DM4PR12MB6469.namprd12.prod.outlook.com (2603:10b6:8:b6::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6745.34; Thu, 7 Sep 2023 18:15:09 +0000 Received: from CY4PEPF0000FCC5.namprd03.prod.outlook.com (2603:10b6:5:1e0:cafe::29) by DM6PR08CA0046.outlook.office365.com (2603:10b6:5:1e0::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6745.36 via Frontend Transport; Thu, 7 Sep 2023 18:15:09 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by CY4PEPF0000FCC5.mail.protection.outlook.com (10.167.242.107) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6768.25 via Frontend Transport; Thu, 7 Sep 2023 18:15:09 +0000 Received: from rnnvmail205.nvidia.com (10.129.68.10) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.5; Thu, 7 Sep 2023 11:15:01 -0700 Received: from rnnvmail201.nvidia.com (10.129.68.8) by rnnvmail205.nvidia.com (10.129.68.10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.37; Thu, 7 Sep 2023 11:15:01 -0700 Received: from ankita-dt2.nvidia.com (10.127.8.14) by mail.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.37 via Frontend Transport; Thu, 7 Sep 2023 11:15:00 -0700 From: To: , , , , , CC: , , , , , , , , , , , Subject: [PATCH v1 2/2] KVM: arm64: allow the VM to select DEVICE_* and NORMAL_NC for IO memory Date: Thu, 7 Sep 2023 11:14:59 -0700 Message-ID: <20230907181459.18145-3-ankita@nvidia.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20230907181459.18145-1-ankita@nvidia.com> References: <20230907181459.18145-1-ankita@nvidia.com> Precedence: bulk X-Mailing-List: kvmarm@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CY4PEPF0000FCC5:EE_|DM4PR12MB6469:EE_ X-MS-Office365-Filtering-Correlation-Id: 567b9141-f874-4537-7f10-08dbafce5f1e X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 4mnDT81U7AQITPoNCJSezBIzT2LzZ9NvGswTaOTfb6GXMPMpsLP5uKFlR/Aa/oZZ38GmlYPayg3KgRD6DZGZUmznJI6v1RoOcMIqVkqK0UScwNx77s7uLypKMjBxPPBQytdVrC9zPxmEceGcW+EZy6zFFgWHiojtZdstp3oIwu74flGzddJORKY/KK7Fse5MyMWc0McW1B266zNy3tSbBOB93cODj89avZfIXDvHqPp1kM6MdU5Ht4TRWmySL0Fm1zGbYhMO6r2Nsx7/vzzdNHdcFyg0kSsoIPMerA5oAwvjgMwFoC3+sqhZaQ8jOE5vruhmRrhesv5zAAmUJwNomnBxe5QPlBu8ac11gPRo8kY5UNu/aYf9sVOSufkH309CnRlRozvg92WUtT/QEZodvLQNJpjJ5DKivdP//I1gq/OJsyhuY+cPRHE40xxCKLj4LqYvR9SwKin8D8C4MGGHxLoXUM5fYTw9++8AhVt6MeJQzvafaev9TunHuFl/Dzwho0tDB6h+ZMJiIuDm402AVUGBc2QepiuUceNtyFQNbAO8XVLfLFVG/9B23vuTQGFeULYlXufdyvjNFmS1/p5YJFv4XhomzkGDBButXe4uAA2OBJUYvzF/x54NgTTG3dAYIA3sk+sFm2z6vwOFlOYVf23BHdu2wDKBsvJpbYS+nH2X/JOybGPBAAion3P3S1SaCWHANob0SnzIkcVkr3+FRPrxfjDoUpZx9xo/sygVYTR9VVskmZbfSBM2jCuWnZqn X-Forefront-Antispam-Report: CIP:216.228.117.161;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge2.nvidia.com;CAT:NONE;SFS:(13230031)(4636009)(396003)(376002)(346002)(136003)(39860400002)(451199024)(1800799009)(186009)(82310400011)(46966006)(36840700001)(40470700004)(54906003)(316002)(2616005)(82740400003)(1076003)(36860700001)(86362001)(110136005)(70586007)(2876002)(70206006)(2906002)(41300700001)(8676002)(4326008)(8936002)(47076005)(5660300002)(19627235002)(336012)(426003)(478600001)(40480700001)(7636003)(26005)(356005)(7696005)(40460700003)(83380400001)(36756003);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Sep 2023 18:15:09.5608 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 567b9141-f874-4537-7f10-08dbafce5f1e X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.161];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CY4PEPF0000FCC5.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR12MB6469 From: Ankit Agrawal Linux allows device drivers to map IO memory on a per-page basis using "write combining" or WC. This is often done using pgprot_writecombing(). The driver knows which pages can support WC access and the proper programming model to generate this IO. Generally the use case is to boost performance by using write combining to generate larger PCIe MemWr TLPs. Allow VMs to select DEVICE_* or NORMAL_NC on a page by page basis for all IO memory. This puts the VM in charge of the memory attributes, and removes the KVM override to DEVICE_nGnRE. Ultimately this makes pgprot_writecombing() work correctly in VMs and allows drivers like mlx5 to fully operate their HW. After some discussions with ARM and CPU architects we reached the conclusion there was no need for KVM to prevent the VM from selecting between DEVICE_* and NORMAL_NC for IO memory in VMs. There was a fear that NORMAL_NC could result in uncontained failures, but upon deeper analysis it turns out there are already possible cases for uncontained failures with DEVICE types too. Ultimately the platform must be implemented in a way that ensures that all DEVICE_* and NORMAL_NC accesses have no uncontained failures. Fortunately real platforms do tend to implement this. This patch makes the VM's memory attributes behave as follows:  S1           |   S2          |  Result  NORMAL-WB    |  NORMAL-NC    |  NORMAL-NC  NORMAL-WT    |  NORMAL-NC    |  NORMAL-NC  NORMAL-NC    |  NORMAL-NC    |  NORMAL-NC  DEVICE |  NORMAL-NC    |  DEVICE See section D8.5.5 of DDI0487_I_a_a-profile_architecture_reference_manual.pdf for details. Signed-off-by: Ankit Agrawal --- arch/arm64/include/asm/memory.h | 2 ++ arch/arm64/kvm/hyp/pgtable.c | 2 +- 2 files changed, 3 insertions(+), 1 deletion(-) diff --git a/arch/arm64/include/asm/memory.h b/arch/arm64/include/asm/memory.h index fde4186cc387..c247e5f29d5a 100644 --- a/arch/arm64/include/asm/memory.h +++ b/arch/arm64/include/asm/memory.h @@ -147,6 +147,7 @@ * Memory types for Stage-2 translation */ #define MT_S2_NORMAL 0xf +#define MT_S2_NORMAL_NC 0x5 #define MT_S2_DEVICE_nGnRE 0x1 /* @@ -154,6 +155,7 @@ * Stage-2 enforces Normal-WB and Device-nGnRE */ #define MT_S2_FWB_NORMAL 6 +#define MT_S2_FWB_NORMAL_NC 5 #define MT_S2_FWB_DEVICE_nGnRE 1 #ifdef CONFIG_ARM64_4K_PAGES diff --git a/arch/arm64/kvm/hyp/pgtable.c b/arch/arm64/kvm/hyp/pgtable.c index ccd291b6893d..a80949002191 100644 --- a/arch/arm64/kvm/hyp/pgtable.c +++ b/arch/arm64/kvm/hyp/pgtable.c @@ -696,7 +696,7 @@ static int stage2_set_prot_attr(struct kvm_pgtable *pgt, enum kvm_pgtable_prot p kvm_pte_t *ptep) { bool device = prot & KVM_PGTABLE_PROT_DEVICE; - kvm_pte_t attr = device ? KVM_S2_MEMATTR(pgt, DEVICE_nGnRE) : + kvm_pte_t attr = device ? KVM_S2_MEMATTR(pgt, NORMAL_NC) : KVM_S2_MEMATTR(pgt, NORMAL); u32 sh = KVM_PTE_LEAF_ATTR_LO_S2_SH_IS; -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 4F15DEC874B for ; Thu, 7 Sep 2023 18:15:43 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To: Message-ID:Date:Subject:CC:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=xPqNFYnFUcMg/mV85va6HaHC0wgnMVe1N/rtF+w2g90=; b=FVkLuTbw22OeeO BgPjPDdPW+z1RgCRSaXA6L9F9g3VRpIQIpI13axTjtf4kafm9tjos9MZFF9aeO7yLGYQREPMijcs9 fWJLkS/EZ76Q//W04hcl8qKDBvn60dka5DTXfr8B3nFUlWQCNX+qrXpwLlJm8zyE58QwisE+Zy7Gg kaBX/k39M4yjavHkHHrxPQIAyOZ+5OmaxF5D/FKK6NMDYK1JU9woi5aLjW+dZatJKZVEckEtPyqOq oLWDC/MqW5EOVB6tMGaEp0vyjfB3x6vmU95oeSkcOP2GcB8ek6hK1hIYjn8HZ9uv6kx1EAykkI1N1 kZ2L0uN7Kk4pMQx6p4UA==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.96 #2 (Red Hat Linux)) id 1qeJXD-00CXGg-2d; Thu, 07 Sep 2023 18:15:19 +0000 Received: from mail-bn8nam11on20601.outbound.protection.outlook.com ([2a01:111:f400:7eae::601] helo=NAM11-BN8-obe.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.96 #2 (Red Hat Linux)) id 1qeJX9-00CXEf-2p for linux-arm-kernel@lists.infradead.org; Thu, 07 Sep 2023 18:15:17 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=S/p7M6mLopwFc5BWOvgORByYdGkjRK4wWv4SPGQA8MAialtFaKPjCi0CJ+tBu1UtBmd/a2epCz5O8Nm3A0Ql0hRC60QXE+khHlhqbNrdUrArN67yMg+TKS0WVGvh6xnFIwFFNiDqEH9STnvl7FG96ytwoS4Q/9RKDyK3i2FpTyzLcM4vHqLm8HfglRDeyphB0fPrYApkdGJw5k5xgt2W/bHPH5gkxe7t++4H2D+s9A7ekLQn1JIQbIIQDm6S2UMvkmm8coL2cj79WKcavrgFInzKH+F9glAAEmrNlpNz86D6pU/9HI4wvPHLMOu7N25o+nr0grUjNAjP5wtchQuriA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=ntxOXAzag4KmsXPbY2xOEHwIZsNihmZ+5XcVn3QEkg4=; b=lkeKx5Fk4EPv4y4GlyJ8qX8CDNlKobG9jp1sLdG3mABaDJ6wCScgPtgiE/9XG8XEJnu3a7VpBaRq2bGJKTIkPjnN08H3BqFYUsQLmFcQ1G+PVoGow266O40QoyzOZAoAPSyOLa4udG+Um53Es2BDmeuEL0+0bUCn4Jb2zP7OYkzts1S+NJZ/0ctzTIsjC8oVUZSyCw22jjvmzrX6kDEbnMDeZBLvgOQfTJ/O2zIb0JW/sG7biP8cU5oeSGFjlUqFAXFk+UgtqpwP196NFC5PPAykjHPtuDaQcq7JD+4Q45/dcP9THwfXu8/prHA3N0SOpxRUPBNhJCRLkLoMb1Jm9w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=lists.infradead.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ntxOXAzag4KmsXPbY2xOEHwIZsNihmZ+5XcVn3QEkg4=; b=fDzpwk30DkpnrP0jOKSLxPNaZNpaVpQlj40bO2T/ecURZimK4+T18LvbTT+n6akdIND1I1AQB51AluXcrKqK8PDl71/BHtk9fE7uv2xN6yfKyld+1eTeyqh5DmiymFSkvQ6XkXYnHACwyHH1Vm2lcw7OHz0uIUvou15CfNjULMYPKDdafvHZj1kthoaW6BWeS0AdZUgstyYxiUSBLHfhhPvJ3cUv9UNp7ANwxSTAiZsdLOnbyZ8sRKhXxJtB1GlosUh2I+M3Q7hSZC1WkzQRKN34GwcO0czdVjv0ysIZY5A+Y+Q4MaRhf7ccE3TlBRKqAvR+8LtQQ5delXeRabPYZg== Received: from DM6PR08CA0046.namprd08.prod.outlook.com (2603:10b6:5:1e0::20) by DM4PR12MB6469.namprd12.prod.outlook.com (2603:10b6:8:b6::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6745.34; Thu, 7 Sep 2023 18:15:09 +0000 Received: from CY4PEPF0000FCC5.namprd03.prod.outlook.com (2603:10b6:5:1e0:cafe::29) by DM6PR08CA0046.outlook.office365.com (2603:10b6:5:1e0::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6745.36 via Frontend Transport; Thu, 7 Sep 2023 18:15:09 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by CY4PEPF0000FCC5.mail.protection.outlook.com (10.167.242.107) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6768.25 via Frontend Transport; Thu, 7 Sep 2023 18:15:09 +0000 Received: from rnnvmail205.nvidia.com (10.129.68.10) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.5; Thu, 7 Sep 2023 11:15:01 -0700 Received: from rnnvmail201.nvidia.com (10.129.68.8) by rnnvmail205.nvidia.com (10.129.68.10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.37; Thu, 7 Sep 2023 11:15:01 -0700 Received: from ankita-dt2.nvidia.com (10.127.8.14) by mail.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.37 via Frontend Transport; Thu, 7 Sep 2023 11:15:00 -0700 From: To: , , , , , CC: , , , , , , , , , , , Subject: [PATCH v1 2/2] KVM: arm64: allow the VM to select DEVICE_* and NORMAL_NC for IO memory Date: Thu, 7 Sep 2023 11:14:59 -0700 Message-ID: <20230907181459.18145-3-ankita@nvidia.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20230907181459.18145-1-ankita@nvidia.com> References: <20230907181459.18145-1-ankita@nvidia.com> MIME-Version: 1.0 X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CY4PEPF0000FCC5:EE_|DM4PR12MB6469:EE_ X-MS-Office365-Filtering-Correlation-Id: 567b9141-f874-4537-7f10-08dbafce5f1e X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 4mnDT81U7AQITPoNCJSezBIzT2LzZ9NvGswTaOTfb6GXMPMpsLP5uKFlR/Aa/oZZ38GmlYPayg3KgRD6DZGZUmznJI6v1RoOcMIqVkqK0UScwNx77s7uLypKMjBxPPBQytdVrC9zPxmEceGcW+EZy6zFFgWHiojtZdstp3oIwu74flGzddJORKY/KK7Fse5MyMWc0McW1B266zNy3tSbBOB93cODj89avZfIXDvHqPp1kM6MdU5Ht4TRWmySL0Fm1zGbYhMO6r2Nsx7/vzzdNHdcFyg0kSsoIPMerA5oAwvjgMwFoC3+sqhZaQ8jOE5vruhmRrhesv5zAAmUJwNomnBxe5QPlBu8ac11gPRo8kY5UNu/aYf9sVOSufkH309CnRlRozvg92WUtT/QEZodvLQNJpjJ5DKivdP//I1gq/OJsyhuY+cPRHE40xxCKLj4LqYvR9SwKin8D8C4MGGHxLoXUM5fYTw9++8AhVt6MeJQzvafaev9TunHuFl/Dzwho0tDB6h+ZMJiIuDm402AVUGBc2QepiuUceNtyFQNbAO8XVLfLFVG/9B23vuTQGFeULYlXufdyvjNFmS1/p5YJFv4XhomzkGDBButXe4uAA2OBJUYvzF/x54NgTTG3dAYIA3sk+sFm2z6vwOFlOYVf23BHdu2wDKBsvJpbYS+nH2X/JOybGPBAAion3P3S1SaCWHANob0SnzIkcVkr3+FRPrxfjDoUpZx9xo/sygVYTR9VVskmZbfSBM2jCuWnZqn X-Forefront-Antispam-Report: CIP:216.228.117.161;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge2.nvidia.com;CAT:NONE;SFS:(13230031)(4636009)(396003)(376002)(346002)(136003)(39860400002)(451199024)(1800799009)(186009)(82310400011)(46966006)(36840700001)(40470700004)(54906003)(316002)(2616005)(82740400003)(1076003)(36860700001)(86362001)(110136005)(70586007)(2876002)(70206006)(2906002)(41300700001)(8676002)(4326008)(8936002)(47076005)(5660300002)(19627235002)(336012)(426003)(478600001)(40480700001)(7636003)(26005)(356005)(7696005)(40460700003)(83380400001)(36756003);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Sep 2023 18:15:09.5608 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 567b9141-f874-4537-7f10-08dbafce5f1e X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.161];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CY4PEPF0000FCC5.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR12MB6469 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20230907_111515_934750_E497FA3E X-CRM114-Status: GOOD ( 16.87 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org RnJvbTogQW5raXQgQWdyYXdhbCA8YW5raXRhQG52aWRpYS5jb20+CgpMaW51eCBhbGxvd3MgZGV2 aWNlIGRyaXZlcnMgdG8gbWFwIElPIG1lbW9yeSBvbiBhIHBlci1wYWdlIGJhc2lzIHVzaW5nCiJ3 cml0ZSBjb21iaW5pbmciIG9yIFdDLiBUaGlzIGlzIG9mdGVuIGRvbmUgdXNpbmcKcGdwcm90X3dy aXRlY29tYmluZygpLiBUaGUgZHJpdmVyIGtub3dzIHdoaWNoIHBhZ2VzIGNhbiBzdXBwb3J0IFdD CmFjY2VzcyBhbmQgdGhlIHByb3BlciBwcm9ncmFtbWluZyBtb2RlbCB0byBnZW5lcmF0ZSB0aGlz IElPLiBHZW5lcmFsbHkKdGhlIHVzZSBjYXNlIGlzIHRvIGJvb3N0IHBlcmZvcm1hbmNlIGJ5IHVz aW5nIHdyaXRlIGNvbWJpbmluZyB0bwpnZW5lcmF0ZSBsYXJnZXIgUENJZSBNZW1XciBUTFBzLgoK QWxsb3cgVk1zIHRvIHNlbGVjdCBERVZJQ0VfKiBvciBOT1JNQUxfTkMgb24gYSBwYWdlIGJ5IHBh Z2UgYmFzaXMgZm9yCmFsbCBJTyBtZW1vcnkuIFRoaXMgcHV0cyB0aGUgVk0gaW4gY2hhcmdlIG9m IHRoZSBtZW1vcnkgYXR0cmlidXRlcywKYW5kIHJlbW92ZXMgdGhlIEtWTSBvdmVycmlkZSB0byBE RVZJQ0VfbkduUkUuCgpVbHRpbWF0ZWx5IHRoaXMgbWFrZXMgcGdwcm90X3dyaXRlY29tYmluZygp IHdvcmsgY29ycmVjdGx5IGluIFZNcyBhbmQKYWxsb3dzIGRyaXZlcnMgbGlrZSBtbHg1IHRvIGZ1 bGx5IG9wZXJhdGUgdGhlaXIgSFcuCgpBZnRlciBzb21lIGRpc2N1c3Npb25zIHdpdGggQVJNIGFu ZCBDUFUgYXJjaGl0ZWN0cyB3ZSByZWFjaGVkIHRoZQpjb25jbHVzaW9uIHRoZXJlIHdhcyBubyBu ZWVkIGZvciBLVk0gdG8gcHJldmVudCB0aGUgVk0gZnJvbSBzZWxlY3RpbmcKYmV0d2VlbiBERVZJ Q0VfKiBhbmQgTk9STUFMX05DIGZvciBJTyBtZW1vcnkgaW4gVk1zLiBUaGVyZSB3YXMgYSBmZWFy CnRoYXQgTk9STUFMX05DIGNvdWxkIHJlc3VsdCBpbiB1bmNvbnRhaW5lZCBmYWlsdXJlcywgYnV0 IHVwb24gZGVlcGVyCmFuYWx5c2lzIGl0IHR1cm5zIG91dCB0aGVyZSBhcmUgYWxyZWFkeSBwb3Nz aWJsZSBjYXNlcyBmb3IgdW5jb250YWluZWQKZmFpbHVyZXMgd2l0aCBERVZJQ0UgdHlwZXMgdG9v LiBVbHRpbWF0ZWx5IHRoZSBwbGF0Zm9ybSBtdXN0IGJlCmltcGxlbWVudGVkIGluIGEgd2F5IHRo YXQgZW5zdXJlcyB0aGF0IGFsbCBERVZJQ0VfKiBhbmQgTk9STUFMX05DCmFjY2Vzc2VzIGhhdmUg bm8gdW5jb250YWluZWQgZmFpbHVyZXMuCgpGb3J0dW5hdGVseSByZWFsIHBsYXRmb3JtcyBkbyB0 ZW5kIHRvIGltcGxlbWVudCB0aGlzLgoKVGhpcyBwYXRjaCBtYWtlcyB0aGUgVk0ncyBtZW1vcnkg YXR0cmlidXRlcyBiZWhhdmUgYXMgZm9sbG93czoKCsKgUzHCoMKgwqDCoMKgwqDCoMKgwqDCoCB8 wqDCoCBTMsKgwqDCoMKgwqDCoMKgwqDCoCB8wqAgUmVzdWx0CsKgTk9STUFMLVdCwqDCoMKgwqB8 wqAgTk9STUFMLU5DwqDCoMKgwqB8wqAgTk9STUFMLU5DCsKgTk9STUFMLVdUwqDCoMKgwqB8wqAg Tk9STUFMLU5DwqDCoMKgwqB8wqAgTk9STUFMLU5DCsKgTk9STUFMLU5DwqDCoMKgwqB8wqAgTk9S TUFMLU5DwqDCoMKgwqB8wqAgTk9STUFMLU5DCsKgREVWSUNFPGF0dHI+wqB8wqAgTk9STUFMLU5D wqDCoMKgwqB8wqAgREVWSUNFPGF0dHI+CgpTZWUgc2VjdGlvbiBEOC41LjUgb2YgRERJMDQ4N19J X2FfYS1wcm9maWxlX2FyY2hpdGVjdHVyZV9yZWZlcmVuY2VfbWFudWFsLnBkZgpmb3IgZGV0YWls cy4KClNpZ25lZC1vZmYtYnk6IEFua2l0IEFncmF3YWwgPGFua2l0YUBudmlkaWEuY29tPgotLS0K IGFyY2gvYXJtNjQvaW5jbHVkZS9hc20vbWVtb3J5LmggfCAyICsrCiBhcmNoL2FybTY0L2t2bS9o eXAvcGd0YWJsZS5jICAgIHwgMiArLQogMiBmaWxlcyBjaGFuZ2VkLCAzIGluc2VydGlvbnMoKyks IDEgZGVsZXRpb24oLSkKCmRpZmYgLS1naXQgYS9hcmNoL2FybTY0L2luY2x1ZGUvYXNtL21lbW9y eS5oIGIvYXJjaC9hcm02NC9pbmNsdWRlL2FzbS9tZW1vcnkuaAppbmRleCBmZGU0MTg2Y2MzODcu LmMyNDdlNWYyOWQ1YSAxMDA2NDQKLS0tIGEvYXJjaC9hcm02NC9pbmNsdWRlL2FzbS9tZW1vcnku aAorKysgYi9hcmNoL2FybTY0L2luY2x1ZGUvYXNtL21lbW9yeS5oCkBAIC0xNDcsNiArMTQ3LDcg QEAKICAqIE1lbW9yeSB0eXBlcyBmb3IgU3RhZ2UtMiB0cmFuc2xhdGlvbgogICovCiAjZGVmaW5l IE1UX1MyX05PUk1BTAkJMHhmCisjZGVmaW5lIE1UX1MyX05PUk1BTF9OQwkweDUKICNkZWZpbmUg TVRfUzJfREVWSUNFX25HblJFCTB4MQogCiAvKgpAQCAtMTU0LDYgKzE1NSw3IEBACiAgKiBTdGFn ZS0yIGVuZm9yY2VzIE5vcm1hbC1XQiBhbmQgRGV2aWNlLW5HblJFCiAgKi8KICNkZWZpbmUgTVRf UzJfRldCX05PUk1BTAk2CisjZGVmaW5lIE1UX1MyX0ZXQl9OT1JNQUxfTkMJNQogI2RlZmluZSBN VF9TMl9GV0JfREVWSUNFX25HblJFCTEKIAogI2lmZGVmIENPTkZJR19BUk02NF80S19QQUdFUwpk aWZmIC0tZ2l0IGEvYXJjaC9hcm02NC9rdm0vaHlwL3BndGFibGUuYyBiL2FyY2gvYXJtNjQva3Zt L2h5cC9wZ3RhYmxlLmMKaW5kZXggY2NkMjkxYjY4OTNkLi5hODA5NDkwMDIxOTEgMTAwNjQ0Ci0t LSBhL2FyY2gvYXJtNjQva3ZtL2h5cC9wZ3RhYmxlLmMKKysrIGIvYXJjaC9hcm02NC9rdm0vaHlw L3BndGFibGUuYwpAQCAtNjk2LDcgKzY5Niw3IEBAIHN0YXRpYyBpbnQgc3RhZ2UyX3NldF9wcm90 X2F0dHIoc3RydWN0IGt2bV9wZ3RhYmxlICpwZ3QsIGVudW0ga3ZtX3BndGFibGVfcHJvdCBwCiAJ CQkJa3ZtX3B0ZV90ICpwdGVwKQogewogCWJvb2wgZGV2aWNlID0gcHJvdCAmIEtWTV9QR1RBQkxF X1BST1RfREVWSUNFOwotCWt2bV9wdGVfdCBhdHRyID0gZGV2aWNlID8gS1ZNX1MyX01FTUFUVFIo cGd0LCBERVZJQ0VfbkduUkUpIDoKKwlrdm1fcHRlX3QgYXR0ciA9IGRldmljZSA/IEtWTV9TMl9N RU1BVFRSKHBndCwgTk9STUFMX05DKSA6CiAJCQkgICAgS1ZNX1MyX01FTUFUVFIocGd0LCBOT1JN QUwpOwogCXUzMiBzaCA9IEtWTV9QVEVfTEVBRl9BVFRSX0xPX1MyX1NIX0lTOwogCi0tIAoyLjE3 LjEKCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpsaW51 eC1hcm0ta2VybmVsIG1haWxpbmcgbGlzdApsaW51eC1hcm0ta2VybmVsQGxpc3RzLmluZnJhZGVh ZC5vcmcKaHR0cDovL2xpc3RzLmluZnJhZGVhZC5vcmcvbWFpbG1hbi9saXN0aW5mby9saW51eC1h cm0ta2VybmVsCg==