From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.2 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 34351C2D0DE for ; Thu, 2 Jan 2020 02:33:21 +0000 (UTC) Received: from silver.osuosl.org (smtp3.osuosl.org [140.211.166.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id C2BCC215A4 for ; Thu, 2 Jan 2020 02:33:20 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C2BCC215A4 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.intel.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=iommu-bounces@lists.linux-foundation.org Received: from localhost (localhost [127.0.0.1]) by silver.osuosl.org (Postfix) with ESMTP id 97E152050E; Thu, 2 Jan 2020 02:33:20 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from silver.osuosl.org ([127.0.0.1]) by localhost (.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id dkLfEiHThELM; Thu, 2 Jan 2020 02:33:19 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [140.211.9.56]) by silver.osuosl.org (Postfix) with ESMTP id 44A77203F1; Thu, 2 Jan 2020 02:33:19 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id 26243C18DC; Thu, 2 Jan 2020 02:33:19 +0000 (UTC) Received: from silver.osuosl.org (smtp3.osuosl.org [140.211.166.136]) by lists.linuxfoundation.org (Postfix) with ESMTP id 1DF55C077D for ; Thu, 2 Jan 2020 02:33:18 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by silver.osuosl.org (Postfix) with ESMTP id E7E1A203F1 for ; Thu, 2 Jan 2020 02:33:17 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from silver.osuosl.org ([127.0.0.1]) by localhost (.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 53jEQMrp4-YE for ; Thu, 2 Jan 2020 02:33:15 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mga17.intel.com (mga17.intel.com [192.55.52.151]) by silver.osuosl.org (Postfix) with ESMTPS id AD5EE20349 for ; Thu, 2 Jan 2020 02:33:15 +0000 (UTC) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga004.fm.intel.com ([10.253.24.48]) by fmsmga107.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 01 Jan 2020 18:33:15 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.69,385,1571727600"; d="scan'208";a="244494271" Received: from allen-box.sh.intel.com (HELO [10.239.159.136]) ([10.239.159.136]) by fmsmga004.fm.intel.com with ESMTP; 01 Jan 2020 18:33:13 -0800 Subject: Re: [PATCH v5 0/9] Use 1st-level for IOVA translation To: "Liu, Yi L" , Joerg Roedel , David Woodhouse , Alex Williamson References: <20191224074502.5545-1-baolu.lu@linux.intel.com> <8b40dd00-3bec-1fd9-9ba7-0db9fd727e52@linux.intel.com> From: Lu Baolu Message-ID: Date: Thu, 2 Jan 2020 10:32:05 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US Cc: "Tian, Kevin" , "Raj, Ashok" , "kvm@vger.kernel.org" , "Kumar, Sanjay K" , "iommu@lists.linux-foundation.org" , "linux-kernel@vger.kernel.org" , "Sun, Yi Y" X-BeenThere: iommu@lists.linux-foundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Development issues for Linux IOMMU support List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Errors-To: iommu-bounces@lists.linux-foundation.org Sender: "iommu" Hi Yi, On 1/2/20 10:31 AM, Liu, Yi L wrote: >> From: Lu Baolu [mailto:baolu.lu@linux.intel.com] >> Sent: Thursday, January 2, 2020 7:38 AM >> To: Joerg Roedel ; David Woodhouse ; >> Alex Williamson >> Subject: Re: [PATCH v5 0/9] Use 1st-level for IOVA translation >> >> On 12/24/19 3:44 PM, Lu Baolu wrote: >>> Intel VT-d in scalable mode supports two types of page tables for DMA >>> translation: the first level page table and the second level page >>> table. The first level page table uses the same format as the CPU page >>> table, while the second level page table keeps compatible with >>> previous formats. The software is able to choose any one of them for >>> DMA remapping according to the use case. >>> >>> This patchset aims to move IOVA (I/O Virtual Address) translation to >>> 1st-level page table in scalable mode. This will simplify vIOMMU >>> (IOMMU simulated by VM hypervisor) design by using the two-stage >>> translation, a.k.a. nested mode translation. >>> >>> As Intel VT-d architecture offers caching mode, guest IOVA (GIOVA) >>> support is currently implemented in a shadow page manner. The device >>> simulation software, like QEMU, has to figure out GIOVA->GPA mappings >>> and write them to a shadowed page table, which will be used by the >>> physical IOMMU. Each time when mappings are created or destroyed in >>> vIOMMU, the simulation software has to intervene. Hence, the changes >>> on GIOVA->GPA could be shadowed to host. >>> >>> >>> .-----------. >>> | vIOMMU | >>> |-----------| .--------------------. >>> | |IOTLB flush trap | QEMU | >>> .-----------. (map/unmap) |--------------------| >>> |GIOVA->GPA |---------------->| .------------. | >>> '-----------' | | GIOVA->HPA | | >>> | | | '------------' | >>> '-----------' | | >>> | | >>> '--------------------' >>> | >>> <------------------------------------ >>> | >>> v VFIO/IOMMU API >>> .-----------. >>> | pIOMMU | >>> |-----------| >>> | | >>> .-----------. >>> |GIOVA->HPA | >>> '-----------' >>> | | >>> '-----------' >>> >>> In VT-d 3.0, scalable mode is introduced, which offers two-level >>> translation page tables and nested translation mode. Regards to GIOVA >>> support, it can be simplified by 1) moving the GIOVA support over >>> 1st-level page table to store GIOVA->GPA mapping in vIOMMU, >>> 2) binding vIOMMU 1st level page table to the pIOMMU, 3) using pIOMMU >>> second level for GPA->HPA translation, and 4) enable nested (a.k.a. >>> dual-stage) translation in host. Compared with current shadow GIOVA >>> support, the new approach makes the vIOMMU design simpler and more >>> efficient as we only need to flush the pIOMMU IOTLB and possible >>> device-IOTLB when an IOVA mapping in vIOMMU is torn down. >>> >>> .-----------. >>> | vIOMMU | >>> |-----------| .-----------. >>> | |IOTLB flush trap | QEMU | >>> .-----------. (unmap) |-----------| >>> |GIOVA->GPA |---------------->| | >>> '-----------' '-----------' >>> | | | >>> '-----------' | >>> <------------------------------ >>> | VFIO/IOMMU >>> | cache invalidation and >>> | guest gpd bind interfaces >>> v >>> .-----------. >>> | pIOMMU | >>> |-----------| >>> .-----------. >>> |GIOVA->GPA |<---First level >>> '-----------' >>> | GPA->HPA |<---Scond level >>> '-----------' >>> '-----------' >>> >>> This patch applies the first level page table for IOVA translation >>> unless the DOMAIN_ATTR_NESTING domain attribution has been set. >>> Setting of this attribution means the second level will be used to map >>> gPA (guest physical address) to hPA (host physical address), and the >>> mappings between gVA (guest virtual address) and gPA will be >>> maintained by the guest with the page table address binding to host's >>> first level. >>> >>> Based-on-idea-by: Ashok Raj >>> Based-on-idea-by: Kevin Tian >>> Based-on-idea-by: Liu Yi L >>> Based-on-idea-by: Jacob Pan >>> Based-on-idea-by: Sanjay Kumar >>> Based-on-idea-by: Lu Baolu >> >> Queued all patches for v5.6. > > Reviewed-by: Liu Yi L > > Aha, looks like I forgot to give my Reviewed-by after offline review.. > Yeah, this patchset looks good to me. Thank you, Yi. Very appreciated for your time. Best regards, -baolu _______________________________________________ iommu mailing list iommu@lists.linux-foundation.org https://lists.linuxfoundation.org/mailman/listinfo/iommu