The Linux Kernel Mailing List
 help / color / mirror / Atom feed
From: Mostafa Saleh <smostafa@google.com>
To: Vincent Donnefort <vdonnefort@google.com>
Cc: linux-arm-kernel@lists.infradead.org,
	linux-kernel@vger.kernel.org, kvmarm@lists.linux.dev,
	iommu@lists.linux.dev, catalin.marinas@arm.com, will@kernel.org,
	maz@kernel.org, oliver.upton@linux.dev, joey.gouly@arm.com,
	suzuki.poulose@arm.com, yuzenghui@huawei.com, joro@8bytes.org,
	jean-philippe@linaro.org, jgg@ziepe.ca, mark.rutland@arm.com,
	qperret@google.com, tabba@google.com, sebastianene@google.com,
	keirf@google.com
Subject: Re: [PATCH v6 08/25] KVM: arm64: iommu: Shadow host stage-2 page table
Date: Mon, 13 Jul 2026 14:00:31 +0000	[thread overview]
Message-ID: <alTvf7iiOWn4PKE8@google.com> (raw)
In-Reply-To: <alTnAy7jvjUamwUA@google.com>

On Mon, Jul 13, 2026 at 02:24:19PM +0100, Vincent Donnefort wrote:
> On Fri, May 01, 2026 at 11:19:10AM +0000, Mostafa Saleh wrote:
> > Create a page-table for the IOMMU that shadows the host CPU stage-2
> > to establish DMA isolation.
> > 
> > An initial snapshot is created after the driver init, then
> > on every permission change a callback would be called for
> > the IOMMU driver to update the page table.
> > 

[...]

> > +	 */
> > +	if (pte && !kvm_pte_valid(pte))
> > +		return 0;
> > +
> > +	if (kvm_pte_valid(pte)) {
> > +		prot = pkvm_to_iommu_prot(kvm_pgtable_stage2_pte_prot(pte));
> > +		/* If the range is mapped in a single PTE, it must be the same type.*/
> > +		if (!addr_is_memory(start))
> > +			prot |= IOMMU_MMIO;
> > +
> > +		return kvm_iommu_ops->host_stage2_idmap(start, end, prot);
> 
> Do we really need to do that when is_memory()? 
> 
> fix_host_ownership_walker() by calling host_stage2_idmap_locked() and
> host_stage2_set_owner_locked() should already handle the memory region. That
> would also get rid of kvm_idmap_initialized.
> 
> So this one here could only take care of the MMIO?
> 
> Overall we would have a common point of synchro which is
> fix_host_ownership_walker() after which the host ownership is ready for both
> CPU stage-2 and the IOMMU?
> 

I am not sure I understand, this is another empty page table, so we
have to walk all of the host CPU stage-2 page table to shadow it in the
IOMMU. if you are refering to the case where it handle zero ptes for
memory, I can drop that but it will not change much in this logic.

> > +	}
> > +
> > +	/* In case of invalid PTE, we need to figure out which part of it is MMIO */

[...]

> >  #include <nvhe/mm.h>
> > @@ -481,6 +482,14 @@ static int check_range_allowed_memory(u64 start, u64 end)
> >  	return 0;
> >  }
> >  
> > +u64 find_mem_range_from(u64 start, bool *is_memory)
> > +{
> > +	struct kvm_mem_range r;
> > +
> > +	*is_memory = !!find_mem_range(start, &r);
> > +	return r.end;
> > +}
> > +
> >  static bool range_is_memory(u64 start, u64 end)
> >  {
> >  	struct kvm_mem_range r;
> > @@ -577,8 +586,34 @@ int host_stage2_idmap_locked(phys_addr_t addr, u64 size,
> >  
> >  static void __host_update_page_state(phys_addr_t addr, u64 size, enum pkvm_page_state state)
> 
> I would really split this. I know that this is convinient, but as the function
> says, it only update the page state so it shouldn't hide an update to the IOMMU.

I mention a couple of alternatives in the commit message, I tried to
implement it differently which was harder to reason about as the calls
was scattered everywhere and any small refactor will possibly break it.

Did you have a split in my mind? I open to rework it.

> 
> Beside, we have examples already in Android where we want to update the
> page-state but not the IOMMU, so it doesn't feel future-proof...
> 
> >  {
> > +	enum pkvm_page_state old = get_host_state(hyp_phys_to_page(addr));
> > +	enum kvm_pgtable_prot prot = 0;
> > +
> >  	for_each_hyp_page(page, addr, size)
> >  		set_host_state(page, state);
> > +
> > +	/*
> > +	 * Any transition to PKVM_NOPAGE, unmaps the page from the host
> > +	 * Any transition to PKVM_PAGE_SHARED_BORROWED, maps the page in the host
> > +	 * Any transition to PKVM_PAGE_SHARED_OWNED is ignored as page is already mapped.
> > +	 * Transitions to PKVM_PAGE_OWNED from anything but PKVM_NOPAGE are ignored.
> > +	 * Transitions to PKVM_PAGE_OWNED from PKVM_NOPAGE will map the page.
> > +	 */
> > +	if ((state == PKVM_PAGE_SHARED_OWNED) ||
> > +		((state == PKVM_PAGE_OWNED) && (old != PKVM_NOPAGE)))
> > +		return;
> > +
> > +	if ((state == PKVM_PAGE_SHARED_BORROWED) ||
> > +		(state == PKVM_PAGE_OWNED))
> > +		prot = PKVM_HOST_MEM_PROT;
> 
> ... and that would avoid that sort of things here. The caller decides if the IOMMU
> is updated or not.

Typically, the IOMMU is updated if the CPU is.

> 
> And as the patch says, we "shadow" the host stage2. So probably modifying
> host_stage2_idmap and host_stage2_set_owner_metdata() sounds really a better
> approach.

Initially, before the pKVM merge upstream I was doing something similar
as that only required one hook [1]. However, after rebasing I found that
would be too complicated and I have to add many more (as mentioned in
the commit message). But I can re-visit this approach in v7.

[1] https://lore.kernel.org/all/20250819215156.2494305-11-smostafa@google.com/

Thanks,
Mostafa


  reply	other threads:[~2026-07-13 14:00 UTC|newest]

Thread overview: 80+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-05-01 11:19 [PATCH v6 00/25] KVM: arm64: SMMUv3 driver for pKVM (trap and emulate) Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 01/25] KVM: arm64: Generalize trace clock Mostafa Saleh
2026-07-10 14:19   ` Vincent Donnefort
2026-07-10 14:24     ` Vincent Donnefort
2026-07-12 13:44     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 02/25] KVM: arm64: Donate MMIO to the hypervisor Mostafa Saleh
2026-07-10 17:08   ` Vincent Donnefort
2026-07-12 15:29     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 03/25] iommu/arm-smmu-v3: Split code with hyp Mostafa Saleh
2026-05-01 12:44   ` Jason Gunthorpe
2026-05-04 12:13     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 04/25] iommu/arm-smmu-v3: Move TLB range invalidation into common code Mostafa Saleh
2026-05-01 12:41   ` Jason Gunthorpe
2026-05-04 12:15     ` Mostafa Saleh
2026-05-05 16:17       ` Jason Gunthorpe
2026-05-05 16:43         ` Mostafa Saleh
2026-05-06  9:53           ` Jason Gunthorpe
2026-05-07  9:40             ` Mostafa Saleh
2026-05-09 23:29               ` Jason Gunthorpe
2026-05-11 11:45                 ` Mostafa Saleh
2026-05-11 14:24                   ` Jason Gunthorpe
2026-05-01 11:19 ` [PATCH v6 05/25] iommu/arm-smmu-v3: Move IDR parsing to common functions Mostafa Saleh
2026-05-01 12:47   ` Jason Gunthorpe
2026-05-04 12:16     ` Mostafa Saleh
2026-05-05 16:27       ` Jason Gunthorpe
2026-05-05 16:48         ` Mostafa Saleh
2026-05-06  9:56           ` Jason Gunthorpe
2026-05-07 10:13             ` Mostafa Saleh
2026-05-09 23:34               ` Jason Gunthorpe
2026-05-11 11:53                 ` Mostafa Saleh
2026-05-11 14:30                   ` Jason Gunthorpe
2026-05-01 11:19 ` [PATCH v6 06/25] iommu/io-pgtable-arm: Rework to use the iommu-pages API Mostafa Saleh
2026-05-01 12:24   ` Jason Gunthorpe
2026-05-04 12:19     ` Mostafa Saleh
2026-05-09 23:21       ` Jason Gunthorpe
2026-05-11 11:16         ` Mostafa Saleh
2026-05-11 14:18           ` Jason Gunthorpe
2026-05-13 21:54             ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 07/25] KVM: arm64: iommu: Introduce IOMMU driver infrastructure Mostafa Saleh
2026-07-10 16:17   ` Vincent Donnefort
2026-07-13 10:13     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 08/25] KVM: arm64: iommu: Shadow host stage-2 page table Mostafa Saleh
2026-05-01 13:00   ` Jason Gunthorpe
2026-05-04 12:28     ` Mostafa Saleh
2026-05-09 23:27       ` Jason Gunthorpe
2026-05-11 11:24         ` Mostafa Saleh
2026-05-11 14:22           ` Jason Gunthorpe
2026-05-12 10:42             ` Mostafa Saleh
2026-05-12 12:36               ` Jason Gunthorpe
2026-07-13 13:24   ` Vincent Donnefort
2026-07-13 14:00     ` Mostafa Saleh [this message]
2026-07-13 15:14       ` Vincent Donnefort
2026-07-13 15:27         ` Vincent Donnefort
2026-07-13 15:58           ` Mostafa Saleh
2026-07-13 15:51         ` Mostafa Saleh
2026-07-13 16:03           ` Vincent Donnefort
2026-07-13 18:19             ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 09/25] KVM: arm64: iommu: Add memory pool Mostafa Saleh
2026-07-10 16:33   ` Vincent Donnefort
2026-07-13 10:35     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 10/25] KVM: arm64: iommu: Support DABT for IOMMU Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 11/25] iommu/arm-smmu-v3-kvm: Add SMMUv3 driver Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 12/25] iommu/arm-smmu-v3-kvm: Add the kernel driver Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 13/25] iommu/arm-smmu-v3-kvm: Probe SMMU HW Mostafa Saleh
2026-05-01 12:51   ` Jason Gunthorpe
2026-05-04 12:30     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 14/25] iommu/arm-smmu-v3-kvm: Add MMIO emulation Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 15/25] iommu/arm-smmu-v3-kvm: Shadow the command queue Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 16/25] iommu/arm-smmu-v3-kvm: Add CMDQ functions Mostafa Saleh
2026-07-10 16:01   ` Vincent Donnefort
2026-07-13 11:07     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 17/25] iommu/arm-smmu-v3-kvm: Emulate CMDQ for host Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 18/25] iommu/arm-smmu-v3-kvm: Shadow stream table Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 19/25] iommu/arm-smmu-v3-kvm: Shadow STEs Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 20/25] iommu/arm-smmu-v3-kvm: Share other queues Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 21/25] iommu/arm-smmu-v3-kvm: Emulate GBPA Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 22/25] iommu/io-pgtable-arm: Support io-pgtable-arm in the hypervisor Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 23/25] iommu/arm-smmu-v3-kvm: Shadow the CPU stage-2 page table Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 24/25] iommu/arm-smmu-v3-kvm: Enable nesting Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 25/25] KVM: arm64: Add documentation for pKVM DMA isolation Mostafa Saleh

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=alTvf7iiOWn4PKE8@google.com \
    --to=smostafa@google.com \
    --cc=catalin.marinas@arm.com \
    --cc=iommu@lists.linux.dev \
    --cc=jean-philippe@linaro.org \
    --cc=jgg@ziepe.ca \
    --cc=joey.gouly@arm.com \
    --cc=joro@8bytes.org \
    --cc=keirf@google.com \
    --cc=kvmarm@lists.linux.dev \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mark.rutland@arm.com \
    --cc=maz@kernel.org \
    --cc=oliver.upton@linux.dev \
    --cc=qperret@google.com \
    --cc=sebastianene@google.com \
    --cc=suzuki.poulose@arm.com \
    --cc=tabba@google.com \
    --cc=vdonnefort@google.com \
    --cc=will@kernel.org \
    --cc=yuzenghui@huawei.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox