From: "Edgecombe, Rick P" <rick.p.edgecombe@intel.com>
To: "Zhao, Yan Y" <yan.y.zhao@intel.com>
Cc: "kvm@vger.kernel.org" <kvm@vger.kernel.org>,
"linux-coco@lists.linux.dev" <linux-coco@lists.linux.dev>,
"Huang, Kai" <kai.huang@intel.com>,
"Hansen, Dave" <dave.hansen@intel.com>,
"kas@kernel.org" <kas@kernel.org>,
"seanjc@google.com" <seanjc@google.com>,
"mingo@redhat.com" <mingo@redhat.com>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"pbonzini@redhat.com" <pbonzini@redhat.com>,
"nik.borisov@suse.com" <nik.borisov@suse.com>,
"linux-doc@vger.kernel.org" <linux-doc@vger.kernel.org>,
"hpa@zytor.com" <hpa@zytor.com>,
"tglx@kernel.org" <tglx@kernel.org>,
"Annapurve, Vishal" <vannapurve@google.com>,
"bp@alien8.de" <bp@alien8.de>, "Gao, Chao" <chao.gao@intel.com>,
"x86@kernel.org" <x86@kernel.org>
Subject: Re: [PATCH v6 08/11] x86/tdx: Add APIs to support Dynamic PAMT ops from KVM's fault path
Date: Fri, 10 Jul 2026 01:34:48 +0000 [thread overview]
Message-ID: <6f19e79b49e6f6e32c34a87302a9ab475ad0f51c.camel@intel.com> (raw)
In-Reply-To: <ak9LDmWBIp52wv4X@yzhao56-desk.sh.intel.com>
On Thu, 2026-07-09 at 15:17 +0800, Yan Zhao wrote:
> On Mon, May 25, 2026 at 07:35:12PM -0700, Rick Edgecombe wrote:
> > When handling an EPT violation, KVM holds a spinlock while manipulating
> > the EPT. Before entering the spinlock it doesn't know how many EPT page
> > tables will need to be installed or whether a huge page will be used. For
> > this reason it allocates a worst case number of page tables that it might
> > need as part of servicing the EPT violation.
> >
> > Under Dynamic PAMT these pre-allocated pages will potentially need to have
> > Dynamic PAMT backing pages installed for them. KVM already has helpers to
> > manage topping up page caches before taking the MMU lock, but they cannot be
> > passed from KVM to arch/x86 code.
> >
> > The problem of how and when to install the DPAMT backing pages for the
> > pages given to the TDX module during the fault path has had a lot of
> > design attempts.
> > - Extracting KVM's MMU caches requires too much inlined code added to
> > headers.
> > - A few varieties of installing Dynamic PAMT backing when allocating the
> > S-EPT page tables. [0][1]
> IIUC, [0][1] here refer to design attempts that had various problems, right?
> However, [1] looks exactly like the one being adopted in v6?
>
> Did you paste a wrong link? Should [1] instead be
> https://lore.kernel.org/kvm/20260129011517.3545883-21-seanjc@google.com or
> https://lore.kernel.org/kvm/aYYCOiMvWfSJR1AL@google.com ?
Oh yea... I think it should be:
Kai's original idea: https://lore.kernel.org/kvm/aXENNKjAKTM9UJNH@google.com/
Sean's fixup of it:
https://lore.kernel.org/kvm/20260129011517.3545883-20-seanjc@google.com/
The problem with Sean's:
https://lore.kernel.org/kvm/aYW5CbUvZrLogsWF@yzhao56-desk.sh.intel.com/
TBH I'm a little on the fence about how useful the links will be in general. If
someone tries to rip it out, it would be good breadcrumbs I guess
>
> > - Using mempool_t to transfer the pages between KVM and arch/x86 doesn't
> > work because it is the component is designed more around maintaining a
> > pool of pages, rather than topping up a continually drained cache.
> >
> > So don't do these as they all had various problems. Instead just create a
> > small simple data structure to use for handing a pre-allocated list of
> > pages between KVM and arch/x86 code. Model this on KVM's existing MMU
> > memory caches.
> >
> > Add a tdx_pamt_cache arg to tdx_pamt_get() so it can draw pages from a
> > cache when needed. Not all DPAMT page installations will happen under
> > spinlock, for example control pages. So have tdx_pamt_get() maintain the
> Nit: In patch 9, S-EPT pages are regarded as control pages as well.
> So maybe
> "..., for example some control pages." or
Yea that is better. The patch 9 changes are after this, so it's technically
correct, but we can make it clearer:
..., for example TD and vCPU scoped control pages for
> "..., for example control pages other than S-EPT pages." ?
>
> > existing behavior of allocating from the page allocator when NULL is
> > passed for the struct tdx_pamt_cache arg. This prevents excess allocations
> > for cases where it can be avoided.
> >
> > Export the new helpers for KVM.
> >
> > Assisted-by: GitHub Copilot:claude-opus-4-6 Claude:claude-opus-4-7
> > Co-developed-by: Sean Christopherson <seanjc@google.com>
> > Signed-off-by: Sean Christopherson <seanjc@google.com>
> > Signed-off-by: Rick Edgecombe <rick.p.edgecombe@intel.com>
> > Link: https://lore.kernel.org/kvm/de05853257e9cc66998101943f78a4b7e6e3d741.camel@intel.com/ [0]
> > Link: https://lore.kernel.org/kvm/aYprxnSHKHUtk7pt@google.com/ [1]
> > ---
> > v6:
> > - Filled out log from Sean's series
> > ---
> > arch/x86/include/asm/tdx.h | 17 ++++++++++
> > arch/x86/virt/vmx/tdx/tdx.c | 65 +++++++++++++++++++++++++++++++++----
> > 2 files changed, 76 insertions(+), 6 deletions(-)
> >
> > diff --git a/arch/x86/include/asm/tdx.h b/arch/x86/include/asm/tdx.h
> > index 74e75db5728c7..191da84bbf2a1 100644
> > --- a/arch/x86/include/asm/tdx.h
> > +++ b/arch/x86/include/asm/tdx.h
> > @@ -155,6 +155,23 @@ static inline bool tdx_supports_dynamic_pamt(const struct tdx_sys_info *sysinfo)
> > return false; /* To be enabled when kernel is ready */
> > }
> >
> > +/* Simple structure for pre-allocating Dynamic PAMT pages outside of locks. */
> outside of spinlocks?
>
> Pre-allocating Dynamic PAMT pages are still inside mutex, e.g., inside of
> kvm->slots_lock, vcpu->mutex...
Ok.
>
> > +struct tdx_pamt_cache {
> > + struct list_head page_list;
> > + int cnt;
> > +};
>
> The rest LGTM.
> Reviewed-by: Yan Zhao <yan.y.zhao@intel.com>
>
Thanks!
next prev parent reply other threads:[~2026-07-10 1:34 UTC|newest]
Thread overview: 107+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-05-26 2:35 [PATCH v6 00/11] Dynamic PAMT Rick Edgecombe
2026-05-26 2:35 ` [PATCH v6 01/11] x86/virt/tdx: Simplify tdmr_get_pamt_sz() Rick Edgecombe
2026-06-04 16:05 ` Kiryl Shutsemau
2026-07-01 0:08 ` Edgecombe, Rick P
2026-06-11 18:25 ` Vishal Annapurve
2026-07-03 5:48 ` Chao Gao
2026-07-06 20:18 ` Edgecombe, Rick P
2026-07-07 3:24 ` Yan Zhao
2026-07-07 19:08 ` Edgecombe, Rick P
2026-07-07 23:22 ` Sohil Mehta
2026-07-08 1:23 ` Edgecombe, Rick P
2026-05-26 2:35 ` [PATCH v6 02/11] x86/virt/tdx: Allocate page bitmap for Dynamic PAMT Rick Edgecombe
2026-06-04 16:14 ` Kiryl Shutsemau
2026-07-01 0:14 ` Edgecombe, Rick P
2026-06-11 18:47 ` Vishal Annapurve
2026-07-03 8:26 ` Chao Gao
2026-07-07 3:59 ` Yan Zhao
2026-07-07 21:25 ` Edgecombe, Rick P
2026-07-08 0:49 ` Sohil Mehta
2026-07-08 2:07 ` Edgecombe, Rick P
2026-07-08 2:10 ` Edgecombe, Rick P
2026-07-08 3:35 ` Sohil Mehta
2026-07-08 20:50 ` Edgecombe, Rick P
2026-07-08 21:20 ` Sohil Mehta
2026-05-26 2:35 ` [PATCH v6 03/11] x86/virt/tdx: Add tdx_alloc/free_control_page() helpers Rick Edgecombe
2026-06-08 2:11 ` Binbin Wu
2026-06-08 2:18 ` Yan Zhao
2026-07-01 0:15 ` Edgecombe, Rick P
2026-07-06 12:31 ` Chao Gao
2026-07-06 20:23 ` Edgecombe, Rick P
2026-07-08 3:50 ` Sohil Mehta
2026-07-08 22:54 ` Edgecombe, Rick P
2026-05-26 2:35 ` [PATCH v6 04/11] x86/virt/tdx: Allocate ref counts for Dynamic PAMT memory Rick Edgecombe
2026-07-02 7:20 ` Binbin Wu
2026-07-06 20:26 ` Edgecombe, Rick P
2026-07-06 13:22 ` Chao Gao
2026-07-06 20:26 ` Edgecombe, Rick P
2026-07-07 4:53 ` Yan Zhao
2026-07-07 22:32 ` Edgecombe, Rick P
2026-07-08 20:49 ` Sohil Mehta
2026-07-08 23:21 ` Edgecombe, Rick P
2026-05-26 2:35 ` [PATCH v6 05/11] x86/virt/tdx: Handle concurrent callers in tdx_pamt_get/put() Rick Edgecombe
2026-07-02 7:39 ` Binbin Wu
2026-07-06 20:27 ` Edgecombe, Rick P
2026-07-07 5:54 ` Chao Gao
2026-07-08 6:46 ` Yan Zhao
2026-07-09 0:33 ` Edgecombe, Rick P
2026-07-09 2:50 ` Yan Zhao
2026-07-09 23:09 ` Edgecombe, Rick P
2026-07-10 2:24 ` Yan Zhao
2026-07-08 19:01 ` Dave Hansen
2026-07-08 21:03 ` Edgecombe, Rick P
2026-07-08 21:11 ` Sohil Mehta
2026-07-08 21:13 ` Dave Hansen
2026-05-26 2:35 ` [PATCH v6 06/11] x86/virt/tdx: Optimize tdx_pamt_get/put() Rick Edgecombe
2026-05-26 8:57 ` Chao Gao
2026-05-26 16:42 ` Edgecombe, Rick P
2026-06-04 16:59 ` Kiryl Shutsemau
2026-06-05 5:40 ` Chao Gao
2026-06-05 11:42 ` Kiryl Shutsemau
2026-06-05 16:23 ` Dave Hansen
2026-06-08 9:14 ` Kiryl Shutsemau
2026-06-08 9:50 ` Yan Zhao
2026-07-01 1:45 ` Edgecombe, Rick P
2026-07-01 5:37 ` Yan Zhao
2026-07-01 1:05 ` Edgecombe, Rick P
2026-07-07 6:45 ` Chao Gao
2026-07-08 8:46 ` Yan Zhao
2026-07-09 0:44 ` Edgecombe, Rick P
2026-05-26 2:35 ` [PATCH v6 07/11] KVM: TDX: Allocate PAMT memory for TD and vCPU control structures Rick Edgecombe
2026-07-02 8:55 ` Binbin Wu
2026-07-06 23:47 ` Sean Christopherson
2026-07-06 23:54 ` Edgecombe, Rick P
2026-07-07 0:25 ` Sean Christopherson
2026-07-08 18:30 ` Dave Hansen
2026-07-07 6:54 ` Chao Gao
2026-07-08 9:13 ` Yan Zhao
2026-07-09 1:12 ` Edgecombe, Rick P
2026-07-09 3:18 ` Yan Zhao
2026-07-10 1:04 ` Edgecombe, Rick P
2026-07-10 2:43 ` Yan Zhao
2026-05-26 2:35 ` [PATCH v6 08/11] x86/tdx: Add APIs to support Dynamic PAMT ops from KVM's fault path Rick Edgecombe
2026-06-04 17:11 ` Kiryl Shutsemau
2026-07-02 9:32 ` Binbin Wu
2026-07-07 7:25 ` Chao Gao
2026-07-09 7:17 ` Yan Zhao
2026-07-10 1:34 ` Edgecombe, Rick P [this message]
2026-07-10 2:47 ` Yan Zhao
2026-05-26 2:35 ` [PATCH v6 09/11] KVM: TDX: Get/put PAMT pages when (un)mapping private memory Rick Edgecombe
2026-07-03 3:15 ` Binbin Wu
2026-07-06 20:47 ` Edgecombe, Rick P
2026-07-06 21:02 ` Sean Christopherson
2026-07-06 21:52 ` Edgecombe, Rick P
2026-07-08 8:35 ` Chao Gao
2026-07-09 1:22 ` Edgecombe, Rick P
2026-05-26 2:35 ` [PATCH v6 10/11] x86/virt/tdx: Enable Dynamic PAMT Rick Edgecombe
2026-06-04 17:14 ` Kiryl Shutsemau
2026-06-05 5:25 ` Chao Gao
2026-07-01 1:20 ` Edgecombe, Rick P
2026-07-06 20:48 ` Edgecombe, Rick P
2026-07-03 4:35 ` Binbin Wu
2026-05-26 2:35 ` [PATCH v6 11/11] Documentation/x86: Add documentation for TDX's " Rick Edgecombe
2026-07-03 4:54 ` Binbin Wu
2026-06-08 5:45 ` [PATCH v6 00/11] " Tony Lindgren
2026-07-06 21:01 ` Edgecombe, Rick P
2026-07-07 16:17 ` Sean Christopherson
2026-07-07 17:25 ` Edgecombe, Rick P
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=6f19e79b49e6f6e32c34a87302a9ab475ad0f51c.camel@intel.com \
--to=rick.p.edgecombe@intel.com \
--cc=bp@alien8.de \
--cc=chao.gao@intel.com \
--cc=dave.hansen@intel.com \
--cc=hpa@zytor.com \
--cc=kai.huang@intel.com \
--cc=kas@kernel.org \
--cc=kvm@vger.kernel.org \
--cc=linux-coco@lists.linux.dev \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@redhat.com \
--cc=nik.borisov@suse.com \
--cc=pbonzini@redhat.com \
--cc=seanjc@google.com \
--cc=tglx@kernel.org \
--cc=vannapurve@google.com \
--cc=x86@kernel.org \
--cc=yan.y.zhao@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox