From: Samiullah Khawaja <skhawaja@google.com>
To: Baolu Lu <baolu.lu@linux.intel.com>
Cc: David Woodhouse <dwmw2@infradead.org>,
Joerg Roedel <joro@8bytes.org>, Will Deacon <will@kernel.org>,
Jason Gunthorpe <jgg@ziepe.ca>,
Robin Murphy <robin.murphy@arm.com>,
Kevin Tian <kevin.tian@intel.com>,
Alex Williamson <alex@shazbot.org>,
Shuah Khan <shuah@kernel.org>,
iommu@lists.linux.dev, linux-kernel@vger.kernel.org,
kvm@vger.kernel.org, Saeed Mahameed <saeedm@nvidia.com>,
Adithya Jayachandran <ajayachandra@nvidia.com>,
Parav Pandit <parav@nvidia.com>,
Leon Romanovsky <leonro@nvidia.com>,
William Tu <witu@nvidia.com>,
Pratyush Yadav <pratyush@kernel.org>,
Pasha Tatashin <pasha.tatashin@soleen.com>,
David Matlack <dmatlack@google.com>,
Andrew Morton <akpm@linux-foundation.org>,
Chris Li <chrisl@kernel.org>,
Pranjal Shrivastava <praan@google.com>,
Vipin Sharma <vipinsh@google.com>,
YiFei Zhu <zhuyifei@google.com>
Subject: Re: [PATCH v2 11/16] iommu/vt-d: preserve PASID table of preserved device
Date: Mon, 11 May 2026 18:45:26 +0000 [thread overview]
Message-ID: <agIGEyL12Djj2clV@google.com> (raw)
In-Reply-To: <666d749e-c1fd-44e1-bfe8-681ba04862e0@linux.intel.com>
On Fri, May 08, 2026 at 02:05:58PM +0800, Baolu Lu wrote:
>On 4/28/26 01:56, Samiullah Khawaja wrote:
>>In scalable mode the PASID table is used to fetch the io page tables.
>>Preserve and restore the PASID table of the preserved devices.
>>
>>Signed-off-by: Samiullah Khawaja<skhawaja@google.com>
>>---
>> drivers/iommu/intel/iommu.c | 5 +-
>> drivers/iommu/intel/iommu.h | 12 +++
>> drivers/iommu/intel/liveupdate.c | 141 +++++++++++++++++++++++++++++++
>> drivers/iommu/intel/pasid.c | 7 +-
>> drivers/iommu/intel/pasid.h | 9 ++
>> include/linux/kho/abi/iommu.h | 13 +++
>> 6 files changed, 184 insertions(+), 3 deletions(-)
>>
[snip]
>>+
>>+void pasid_cleanup_preserved_table(struct device *dev)
>>+{
>>+ struct pasid_table *pasid_table;
>>+ struct pasid_dir_entry *dir;
>>+ struct pasid_entry *table;
>>+ size_t dir_size;
>>+
>>+ pasid_table = intel_pasid_get_table(dev);
>>+ if (!pasid_table)
>>+ return;
>>+
>>+ dir = pasid_table->table;
>>+ table = get_pasid_table_from_pde(&dir[0]);
>>+ if (!table)
>>+ return;
>>+
>>+ /* Clear everything except the first entry in table. */
>>+ memset(&table[1], 0, SZ_4K - sizeof(*table));
>>+
>>+ /* Use the folio order to calculate the size of Pasid Directory */
>>+ dir_size = (1 << (folio_order(virt_to_folio(dir)) + PAGE_SHIFT));
>>+
>>+ /* Clear everything except the first entry in directory */
>>+ memset(&dir[1], 0, dir_size - sizeof(struct pasid_dir_entry));
>>+
>>+ clflush_cache_range(&table[0], SZ_4K);
>>+ clflush_cache_range(&dir[0], dir_size);
>>+}
>
>The PASID table is currently active and in use by the hardware. Clearing
>the entries without the necessary hardware cache invalidation is buggy.
>
>It seems this manual clearing is a workaround because PASID domain
>preservation isn't supported yet. If so, rather than clearing the table
>blindly, the code should verify if any PASIDs (other than
>IOMMU_NO_PASID) are actually in use. If there are, the preserve callback
>should return an error.
Thanks for looking into this, I agree and will remove the clearing logic
here.
Yes, we do this check in iommufd, as it is the dma owner of the device,
and only DMA owned devices are allowed to be preserved.
During preservation iommufd returns an error if the device has PASID
(non NO_PASID) attachments. And once the device is preserved, any PASID
attachments are not allowed until the device is unpreserved.
I think I will make this check robust by moving it into core and use
pasid_array. It will require some plumbing as pasid_array exists in
iommu.c file.
>
>Or anything I overlooked here?
>
>Thanks,
>baolu
Thanks,
Sami
prev parent reply other threads:[~2026-05-11 18:45 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <20260427175633.1978233-1-skhawaja@google.com>
[not found] ` <20260427175633.1978233-4-skhawaja@google.com>
[not found] ` <afUkbz0IQh98siYn@google.com>
2026-05-04 18:33 ` [PATCH v2 03/16] iommu: Implement IOMMU domain preservation Samiullah Khawaja
[not found] ` <20260427175633.1978233-5-skhawaja@google.com>
[not found] ` <afUscSeXKnNAJ0ZF@google.com>
2026-05-04 19:06 ` [PATCH v2 04/16] iommu: Implement device and IOMMU HW preservation Samiullah Khawaja
2026-05-07 2:07 ` Baolu Lu
2026-05-07 18:47 ` Samiullah Khawaja
[not found] ` <20260427175633.1978233-7-skhawaja@google.com>
2026-05-07 2:55 ` [PATCH v2 06/16] iommupt: Implement preserve/unpreserve/restore callbacks Baolu Lu
2026-05-07 18:40 ` Samiullah Khawaja
[not found] ` <20260427175633.1978233-8-skhawaja@google.com>
2026-05-07 6:25 ` [PATCH v2 07/16] iommu/vt-d: Implement device and iommu preserve/unpreserve ops Baolu Lu
2026-05-08 2:36 ` Samiullah Khawaja
[not found] ` <20260427175633.1978233-10-skhawaja@google.com>
2026-05-07 9:05 ` [PATCH v2 09/16] iommu/vt-d: Restore IOMMU state and reclaimed domain ids Baolu Lu
2026-05-07 17:35 ` Samiullah Khawaja
[not found] ` <20260427175633.1978233-11-skhawaja@google.com>
2026-05-07 13:54 ` [PATCH v2 10/16] iommu: Restore and reattach preserved domains to devices Baolu Lu
2026-05-07 16:52 ` Samiullah Khawaja
[not found] ` <20260427175633.1978233-12-skhawaja@google.com>
2026-05-08 6:05 ` [PATCH v2 11/16] iommu/vt-d: preserve PASID table of preserved device Baolu Lu
2026-05-11 18:45 ` Samiullah Khawaja [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=agIGEyL12Djj2clV@google.com \
--to=skhawaja@google.com \
--cc=ajayachandra@nvidia.com \
--cc=akpm@linux-foundation.org \
--cc=alex@shazbot.org \
--cc=baolu.lu@linux.intel.com \
--cc=chrisl@kernel.org \
--cc=dmatlack@google.com \
--cc=dwmw2@infradead.org \
--cc=iommu@lists.linux.dev \
--cc=jgg@ziepe.ca \
--cc=joro@8bytes.org \
--cc=kevin.tian@intel.com \
--cc=kvm@vger.kernel.org \
--cc=leonro@nvidia.com \
--cc=linux-kernel@vger.kernel.org \
--cc=parav@nvidia.com \
--cc=pasha.tatashin@soleen.com \
--cc=praan@google.com \
--cc=pratyush@kernel.org \
--cc=robin.murphy@arm.com \
--cc=saeedm@nvidia.com \
--cc=shuah@kernel.org \
--cc=vipinsh@google.com \
--cc=will@kernel.org \
--cc=witu@nvidia.com \
--cc=zhuyifei@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox