The Linux Kernel Mailing List
 help / color / mirror / Atom feed
From: Mostafa Saleh <smostafa@google.com>
To: Vincent Donnefort <vdonnefort@google.com>
Cc: linux-arm-kernel@lists.infradead.org,
	linux-kernel@vger.kernel.org, kvmarm@lists.linux.dev,
	iommu@lists.linux.dev, catalin.marinas@arm.com, will@kernel.org,
	maz@kernel.org, oliver.upton@linux.dev, joey.gouly@arm.com,
	suzuki.poulose@arm.com, yuzenghui@huawei.com, joro@8bytes.org,
	jean-philippe@linaro.org, jgg@ziepe.ca, mark.rutland@arm.com,
	qperret@google.com, tabba@google.com, sebastianene@google.com,
	keirf@google.com
Subject: Re: [PATCH v6 08/25] KVM: arm64: iommu: Shadow host stage-2 page table
Date: Mon, 13 Jul 2026 18:19:24 +0000	[thread overview]
Message-ID: <alUsLFBQ5qKFOgwQ@google.com> (raw)
In-Reply-To: <alUMVU7DYcrvgAYi@google.com>

On Mon, Jul 13, 2026 at 05:03:33PM +0100, Vincent Donnefort wrote:
> On Mon, Jul 13, 2026 at 03:51:07PM +0000, Mostafa Saleh wrote:
> > On Mon, Jul 13, 2026 at 04:14:55PM +0100, Vincent Donnefort wrote:
> > > On Mon, Jul 13, 2026 at 02:00:31PM +0000, Mostafa Saleh wrote:
> > > > On Mon, Jul 13, 2026 at 02:24:19PM +0100, Vincent Donnefort wrote:
> > > > > On Fri, May 01, 2026 at 11:19:10AM +0000, Mostafa Saleh wrote:
> > > > > > Create a page-table for the IOMMU that shadows the host CPU stage-2
> > > > > > to establish DMA isolation.
> > > > > > 
> > > > > > An initial snapshot is created after the driver init, then
> > > > > > on every permission change a callback would be called for
> > > > > > the IOMMU driver to update the page table.
> > > > > > 
> > > > 
> > > > [...]
> > > > 
> > > > > > +	 */
> > > > > > +	if (pte && !kvm_pte_valid(pte))
> > > > > > +		return 0;
> > > > > > +
> > > > > > +	if (kvm_pte_valid(pte)) {
> > > > > > +		prot = pkvm_to_iommu_prot(kvm_pgtable_stage2_pte_prot(pte));
> > > > > > +		/* If the range is mapped in a single PTE, it must be the same type.*/
> > > > > > +		if (!addr_is_memory(start))
> > > > > > +			prot |= IOMMU_MMIO;
> > > > > > +
> > > > > > +		return kvm_iommu_ops->host_stage2_idmap(start, end, prot);
> > > > > 
> > > > > Do we really need to do that when is_memory()? 
> > > > > 
> > > > > fix_host_ownership_walker() by calling host_stage2_idmap_locked() and
> > > > > host_stage2_set_owner_locked() should already handle the memory region. That
> > > > > would also get rid of kvm_idmap_initialized.
> > > > > 
> > > > > So this one here could only take care of the MMIO?
> > > > > 
> > > > > Overall we would have a common point of synchro which is
> > > > > fix_host_ownership_walker() after which the host ownership is ready for both
> > > > > CPU stage-2 and the IOMMU?
> > > > > 
> > > > 
> > > > I am not sure I understand, this is another empty page table, so we
> > > > have to walk all of the host CPU stage-2 page table to shadow it in the
> > > > IOMMU. if you are refering to the case where it handle zero ptes for
> > > > memory, I can drop that but it will not change much in this logic.
> > > 
> > > In fixup_host_ownership() we already walk the hyp pgtable to know what needs to be
> > > map/unmapped from the host stage-2. Can't we rely on that for the IOMMU
> > > page-table as well?
> > > 
> > > As of, fix_host_ownership() could handle the host stage-2 __and__ the iommu? 
> > 
> > fix_host_ownership() only walks the hypervisor page table, and fixes the
> > hypervisor pages in the host.
> 
> Yeah, Looking closer I don't think my proposal simplify things so much in the
> end.
> 
> > That means that the IOMMU page table has
> > to  be fully populated first, then we unmap the donated pages.
> > That seems more complicated and it feels that decoupling the IOMMU
> > logic outside of this would be better.
> 
> Why more complicated? That's actually another solution I was thinking about, to
> just map everything as soon as possible and let host_stage2_idmap_locked() and
> host_stage2_set_owner_locked() unmap what is needed here. (and also in
> __pkvm_host_donate_hyp_mmio())
> 
> We wouldn't need any specific setup walker for the iommu at all.

That would walk the table twice, first time with a massive map, then
to unmap the pages that was just mapped, issuing TLB invalidations
for all of those, also as the IOMMU page table code never frees tables
that means we would immediately exahust the IOMMU pool.

Also, I believe that it is better to isolate the IOMMU page table
shadowing logic from the core hypervisor page table setup, specially
AFAICT, that was not what fix_host_ownership() was designed for, and
seems the IOMMU will just piggyback on a existing walker.

> 
> > 
> > Also, I rely on the IOMMU init to be done at the end of setup, so we
> > do not have to clean the IOMMU init if any other part of KVM fails.
> 
> We could just leak those pages if it fails?

It is not just about pages, the hypervisor will also configure the SMMU
registers. Ideally, we would need a remove() driver ops for such cases
but I added the IOMMU init call at the end to avoid making this series
any bigger.

Thanks,
Mostafa


  reply	other threads:[~2026-07-13 18:19 UTC|newest]

Thread overview: 80+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-05-01 11:19 [PATCH v6 00/25] KVM: arm64: SMMUv3 driver for pKVM (trap and emulate) Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 01/25] KVM: arm64: Generalize trace clock Mostafa Saleh
2026-07-10 14:19   ` Vincent Donnefort
2026-07-10 14:24     ` Vincent Donnefort
2026-07-12 13:44     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 02/25] KVM: arm64: Donate MMIO to the hypervisor Mostafa Saleh
2026-07-10 17:08   ` Vincent Donnefort
2026-07-12 15:29     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 03/25] iommu/arm-smmu-v3: Split code with hyp Mostafa Saleh
2026-05-01 12:44   ` Jason Gunthorpe
2026-05-04 12:13     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 04/25] iommu/arm-smmu-v3: Move TLB range invalidation into common code Mostafa Saleh
2026-05-01 12:41   ` Jason Gunthorpe
2026-05-04 12:15     ` Mostafa Saleh
2026-05-05 16:17       ` Jason Gunthorpe
2026-05-05 16:43         ` Mostafa Saleh
2026-05-06  9:53           ` Jason Gunthorpe
2026-05-07  9:40             ` Mostafa Saleh
2026-05-09 23:29               ` Jason Gunthorpe
2026-05-11 11:45                 ` Mostafa Saleh
2026-05-11 14:24                   ` Jason Gunthorpe
2026-05-01 11:19 ` [PATCH v6 05/25] iommu/arm-smmu-v3: Move IDR parsing to common functions Mostafa Saleh
2026-05-01 12:47   ` Jason Gunthorpe
2026-05-04 12:16     ` Mostafa Saleh
2026-05-05 16:27       ` Jason Gunthorpe
2026-05-05 16:48         ` Mostafa Saleh
2026-05-06  9:56           ` Jason Gunthorpe
2026-05-07 10:13             ` Mostafa Saleh
2026-05-09 23:34               ` Jason Gunthorpe
2026-05-11 11:53                 ` Mostafa Saleh
2026-05-11 14:30                   ` Jason Gunthorpe
2026-05-01 11:19 ` [PATCH v6 06/25] iommu/io-pgtable-arm: Rework to use the iommu-pages API Mostafa Saleh
2026-05-01 12:24   ` Jason Gunthorpe
2026-05-04 12:19     ` Mostafa Saleh
2026-05-09 23:21       ` Jason Gunthorpe
2026-05-11 11:16         ` Mostafa Saleh
2026-05-11 14:18           ` Jason Gunthorpe
2026-05-13 21:54             ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 07/25] KVM: arm64: iommu: Introduce IOMMU driver infrastructure Mostafa Saleh
2026-07-10 16:17   ` Vincent Donnefort
2026-07-13 10:13     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 08/25] KVM: arm64: iommu: Shadow host stage-2 page table Mostafa Saleh
2026-05-01 13:00   ` Jason Gunthorpe
2026-05-04 12:28     ` Mostafa Saleh
2026-05-09 23:27       ` Jason Gunthorpe
2026-05-11 11:24         ` Mostafa Saleh
2026-05-11 14:22           ` Jason Gunthorpe
2026-05-12 10:42             ` Mostafa Saleh
2026-05-12 12:36               ` Jason Gunthorpe
2026-07-13 13:24   ` Vincent Donnefort
2026-07-13 14:00     ` Mostafa Saleh
2026-07-13 15:14       ` Vincent Donnefort
2026-07-13 15:27         ` Vincent Donnefort
2026-07-13 15:58           ` Mostafa Saleh
2026-07-13 15:51         ` Mostafa Saleh
2026-07-13 16:03           ` Vincent Donnefort
2026-07-13 18:19             ` Mostafa Saleh [this message]
2026-05-01 11:19 ` [PATCH v6 09/25] KVM: arm64: iommu: Add memory pool Mostafa Saleh
2026-07-10 16:33   ` Vincent Donnefort
2026-07-13 10:35     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 10/25] KVM: arm64: iommu: Support DABT for IOMMU Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 11/25] iommu/arm-smmu-v3-kvm: Add SMMUv3 driver Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 12/25] iommu/arm-smmu-v3-kvm: Add the kernel driver Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 13/25] iommu/arm-smmu-v3-kvm: Probe SMMU HW Mostafa Saleh
2026-05-01 12:51   ` Jason Gunthorpe
2026-05-04 12:30     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 14/25] iommu/arm-smmu-v3-kvm: Add MMIO emulation Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 15/25] iommu/arm-smmu-v3-kvm: Shadow the command queue Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 16/25] iommu/arm-smmu-v3-kvm: Add CMDQ functions Mostafa Saleh
2026-07-10 16:01   ` Vincent Donnefort
2026-07-13 11:07     ` Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 17/25] iommu/arm-smmu-v3-kvm: Emulate CMDQ for host Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 18/25] iommu/arm-smmu-v3-kvm: Shadow stream table Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 19/25] iommu/arm-smmu-v3-kvm: Shadow STEs Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 20/25] iommu/arm-smmu-v3-kvm: Share other queues Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 21/25] iommu/arm-smmu-v3-kvm: Emulate GBPA Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 22/25] iommu/io-pgtable-arm: Support io-pgtable-arm in the hypervisor Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 23/25] iommu/arm-smmu-v3-kvm: Shadow the CPU stage-2 page table Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 24/25] iommu/arm-smmu-v3-kvm: Enable nesting Mostafa Saleh
2026-05-01 11:19 ` [PATCH v6 25/25] KVM: arm64: Add documentation for pKVM DMA isolation Mostafa Saleh

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=alUsLFBQ5qKFOgwQ@google.com \
    --to=smostafa@google.com \
    --cc=catalin.marinas@arm.com \
    --cc=iommu@lists.linux.dev \
    --cc=jean-philippe@linaro.org \
    --cc=jgg@ziepe.ca \
    --cc=joey.gouly@arm.com \
    --cc=joro@8bytes.org \
    --cc=keirf@google.com \
    --cc=kvmarm@lists.linux.dev \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mark.rutland@arm.com \
    --cc=maz@kernel.org \
    --cc=oliver.upton@linux.dev \
    --cc=qperret@google.com \
    --cc=sebastianene@google.com \
    --cc=suzuki.poulose@arm.com \
    --cc=tabba@google.com \
    --cc=vdonnefort@google.com \
    --cc=will@kernel.org \
    --cc=yuzenghui@huawei.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox