public inbox for cgroups@vger.kernel.org
 help / color / mirror / Atom feed
From: "Huang, Kai" <kai.huang@intel.com>
To: "mingo@redhat.com" <mingo@redhat.com>,
	"linux-sgx@vger.kernel.org" <linux-sgx@vger.kernel.org>,
	"x86@kernel.org" <x86@kernel.org>,
	"dave.hansen@linux.intel.com" <dave.hansen@linux.intel.com>,
	"cgroups@vger.kernel.org" <cgroups@vger.kernel.org>,
	"hpa@zytor.com" <hpa@zytor.com>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"jarkko@kernel.org" <jarkko@kernel.org>,
	"bp@alien8.de" <bp@alien8.de>,
	"haitao.huang@linux.intel.com" <haitao.huang@linux.intel.com>,
	"tglx@linutronix.de" <tglx@linutronix.de>,
	"tj@kernel.org" <tj@kernel.org>,
	"Mehta, Sohil" <sohil.mehta@intel.com>
Cc: "kristen@linux.intel.com" <kristen@linux.intel.com>,
	"anakrish@microsoft.com" <anakrish@microsoft.com>,
	"Li, Zhiquan1" <zhiquan1.li@intel.com>, "Christopherson,,
	Sean" <seanjc@google.com>,
	"mikko.ylinen@linux.intel.com" <mikko.ylinen@linux.intel.com>,
	"yangjie@microsoft.com" <yangjie@microsoft.com>,
	"Zhang, Bo" <zhanb@microsoft.com>
Subject: Re: [PATCH v5 02/18] cgroup/misc: Add SGX EPC resource type and export APIs for SGX driver
Date: Tue, 3 Oct 2023 19:33:56 +0000	[thread overview]
Message-ID: <dc441e64f0bf1ef02b7e86956edf95b767a02ca0.camel@intel.com> (raw)
In-Reply-To: <op.2b78ee0awjvjmi@hhuan26-mobl.amr.corp.intel.com>

On Tue, 2023-10-03 at 02:00 -0500, Haitao Huang wrote:
> On Wed, 27 Sep 2023 22:59:12 -0500, Huang, Kai <kai.huang@intel.com> wrote:
> 
> > On Fri, 2023-09-22 at 20:06 -0700, Haitao Huang wrote:
> > > From: Kristen Carlson Accardi <kristen@linux.intel.com>
> > > 
> > > Add SGX EPC memory, MISC_CG_RES_SGX_EPC, to be a valid resource type
> > > for the misc controller.
> > > 
> > > Add per resource type private data so that SGX can store additional per
> > > cgroup data in misc_cg->misc_cg_res[MISC_CG_RES_SGX_EPC].
> > 
> > To be honest I don't quite understand why putting the above two changes  
> > in this
> > patch together with exporting misc_cg_root/parent() below.
> > 
> > Any reason why the above two cannot be done together with patch ("  
> > x86/sgx:
> > Limit process EPC usage with misc cgroup controller"), where these  
> > changes are
> > actually related?
> > 
> > We all already know that a new EPC misc cgroup will be added.  There's  
> > no need
> > to actually introduce the new type here only to justify exporting some  
> > helper
> > functions.
> > 
> 
> I think previous authors intended to separate all prerequisite misc  
> changes from SGX changes.
> I can combine them if maintainers are fine with it.

That's fine.  But IMHO for this particular one I think you are mixing things
together:  Adding SGX EPC resource type and exporting APIs don't have dependency
on the code.

It will be easier to review if you separate this two parts out.  For instance,
at least it's not super clear whether adding a 'priv' is a right move here w/o
looking at the later patches.

Also if you take a look at:

7aef27f0b2a8 ("svm/sev: Register SEV and SEV-ES ASIDs to the misc controller")

Adding the resource type is added together with the implementation.

So I have no problem if you want to split out "adding SGX EPC resource type" out
as a separate patch, but this patch looks should be split. 

> 
> > > 
> > > Export misc_cg_root() so the SGX driver can initialize and add those
> > > additional structures to the root misc cgroup as part of initialization
> > > for EPC cgroup support. This bootstraps the same additional
> > > initialization for non-root cgroups in the 'alloc()' callback added in  
> > > the
> > > previous patch.
> > > 
> > > The SGX driver, as the EPC memory provider, will have a background
> > > worker to reclaim EPC pages to make room for new allocations in the same
> > > cgroup when its usage counter reaches near the limit controlled by the
> > > cgroup and its ancestors. Therefore it needs to do a walk from the
> > > current cgroup up to the root. To enable this walk, move parent_misc()
> > > into misc_cgroup.h and make inline to make this function available to
> > > SGX, rename it to misc_cg_parent(), and update kernel/cgroup/misc.c to
> > > use the new name.
> > 
> > Looks too many details in the above two paragraphs.  Could we have a more
> > concise justification for exporting these two functions?
> > 
> 
> This was added to address Jarkko's question, "why does SGX driver need to  
> do iterative walks?"
> See: https://lore.kernel.org/all/CVHOU5G1SCUT.RCBVZ3W8G2NJ@suppilovahvero/

Agree with Jarkko we need a justification (that what I said above too).  What I
am saying is you can make it more concise.  I can try to do if you want me to.

> 
> > And if it were me, I would put it at a relatively later position (e.g.,  
> > before
> > the patch actually implements EPC cgroup) for better review.  This also  
> > applies
> > to the first patch.
> > 
> 
> I was told to move all prerequisites to the front or separate out.
> 
> https://lore.kernel.org/linux-sgx/CU4H43P3H35X.1BCA3CE4D1250@seitikki/
> 
> 

I don't see any conflict.  Please see the first reply.


  reply	other threads:[~2023-10-03 19:34 UTC|newest]

Thread overview: 126+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-09-23  3:06 [PATCH v5 00/18] Add Cgroup support for SGX EPC memory Haitao Huang
2023-09-23  3:06 ` [PATCH v5 03/18] x86/sgx: Add sgx_epc_lru_lists to encapsulate LRU lists Haitao Huang
     [not found] ` <20230923030657.16148-1-haitao.huang-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2023-09-23  3:06   ` [PATCH v5 01/18] cgroup/misc: Add per resource callbacks for CSS events Haitao Huang
     [not found]     ` <20230923030657.16148-2-haitao.huang-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2023-09-25 17:09       ` Jarkko Sakkinen
2023-09-25 17:09         ` Jarkko Sakkinen
2023-09-26  3:04         ` Haitao Huang
     [not found]           ` <op.2buytfetwjvjmi-yDQzE4XY+yVaPPhiJ6yCxLKMmGWinSIL2HeeBUIffwg@public.gmane.org>
2023-09-26 13:10             ` Jarkko Sakkinen
2023-09-26 13:10               ` Jarkko Sakkinen
2023-09-26 13:13               ` Jarkko Sakkinen
2023-09-26 13:13                 ` Jarkko Sakkinen
2023-09-27  1:56                 ` Haitao Huang
2023-10-02 22:47                   ` Jarkko Sakkinen
2023-10-02 22:55                     ` Jarkko Sakkinen
2023-10-04 15:45                       ` Haitao Huang
2023-10-04 17:18                         ` Tejun Heo
2023-09-27  9:20     ` Huang, Kai
2023-10-03 14:29       ` Haitao Huang
2023-10-17 18:55     ` Michal Koutný
2023-09-23  3:06   ` [PATCH v5 02/18] cgroup/misc: Add SGX EPC resource type and export APIs for SGX driver Haitao Huang
     [not found]     ` <20230923030657.16148-3-haitao.huang-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2023-09-25 18:50       ` Tejun Heo
2023-09-25 18:50         ` Tejun Heo
2023-09-28  3:59     ` Huang, Kai
2023-10-03  7:00       ` Haitao Huang
2023-10-03 19:33         ` Huang, Kai [this message]
2023-09-23  3:06   ` [PATCH v5 04/18] x86/sgx: Use sgx_epc_lru_lists for existing active page list Haitao Huang
2023-09-23  3:06   ` [PATCH v5 05/18] x86/sgx: Store reclaimable EPC pages in sgx_epc_lru_lists Haitao Huang
2023-09-27 10:14     ` Huang, Kai
2023-09-23  3:06   ` [PATCH v5 06/18] x86/sgx: Introduce EPC page states Haitao Huang
     [not found]     ` <20230923030657.16148-7-haitao.huang-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2023-09-25 17:11       ` Jarkko Sakkinen
2023-09-25 17:11         ` Jarkko Sakkinen
2023-09-27 10:28     ` Huang, Kai
2023-10-03  4:49       ` Haitao Huang
2023-10-03 20:03         ` Huang, Kai
2023-10-04 15:24           ` Haitao Huang
2023-10-04 21:05             ` Huang, Kai
2023-09-23  3:06   ` [PATCH v5 07/18] x86/sgx: Introduce RECLAIM_IN_PROGRESS state Haitao Huang
2023-09-25 17:13     ` Jarkko Sakkinen
2023-09-25 17:13       ` Jarkko Sakkinen
2023-09-27 10:42     ` Huang, Kai
2023-09-23  3:06   ` [PATCH v5 08/18] x86/sgx: Use a list to track to-be-reclaimed pages Haitao Huang
2023-09-28  9:28     ` Huang, Kai
2023-10-03  5:09       ` Haitao Huang
2023-09-23  3:06   ` [PATCH v5 09/18] x86/sgx: Store struct sgx_encl when allocating new VA pages Haitao Huang
2023-09-27 11:14     ` Huang, Kai
2023-09-27 15:35       ` Haitao Huang
2023-09-27 21:21         ` Huang, Kai
2023-09-29 15:06           ` Haitao Huang
2023-10-02 11:05             ` Huang, Kai
2023-09-27 11:35     ` Huang, Kai
2023-10-03  6:45       ` Haitao Huang
2023-10-03 20:07         ` Huang, Kai
2023-10-04 15:03           ` Haitao Huang
2023-10-04 21:13             ` Huang, Kai
2023-10-05  4:22               ` Haitao Huang
2023-10-05  6:49                 ` Huang, Kai
2023-09-23  3:06   ` [PATCH v5 10/18] x86/sgx: Add EPC page flags to identify owner types Haitao Huang
2023-09-23  3:06   ` [PATCH v5 11/18] x86/sgx: store unreclaimable pages in LRU lists Haitao Huang
2023-09-27 11:57     ` Huang, Kai
2023-10-03  5:42       ` Haitao Huang
2023-09-28  9:41     ` Huang, Kai
2023-10-03  5:15       ` Haitao Huang
2023-10-03 20:12         ` Huang, Kai
2023-09-23  3:06   ` [PATCH v5 12/18] x86/sgx: Add EPC OOM path to forcefully reclaim EPC Haitao Huang
2023-10-09 23:45     ` Huang, Kai
2023-10-10  0:23       ` Sean Christopherson
2023-10-10  0:50         ` Huang, Kai
2023-10-10  1:34           ` Huang, Kai
2023-10-10 16:49             ` Haitao Huang
2023-10-11  0:51               ` Huang, Kai
2023-10-12 13:27                 ` Haitao Huang
2023-10-16 10:57                   ` Huang, Kai
2023-10-16 19:52                     ` Haitao Huang
2023-10-16 21:09                       ` Huang, Kai
2023-10-17  0:10                         ` Haitao Huang
2023-10-17  1:34                           ` Huang, Kai
2023-10-17 12:58                             ` Haitao Huang
2023-10-17 18:54                               ` Michal Koutný
2023-10-17 19:13                                 ` Michal Koutný
2023-10-18  4:39                                   ` Haitao Huang
2023-10-18  4:37                                 ` Haitao Huang
2023-10-18 13:55                                   ` Dave Hansen
2023-10-18 15:26                                     ` Haitao Huang
2023-10-18 15:37                                       ` Dave Hansen
2023-10-18 15:52                                         ` Michal Koutný
2023-10-18 16:25                                           ` Haitao Huang
2023-10-16 21:32                       ` Sean Christopherson
2023-10-17  0:09                         ` Haitao Huang
2023-10-17 15:43                           ` Sean Christopherson
2023-10-17 11:49                         ` Mikko Ylinen
2023-10-11  1:14               ` Huang, Kai
2023-10-16 11:02                 ` Huang, Kai
2023-10-10  1:42         ` Haitao Huang
2023-10-10  2:23           ` Huang, Kai
2023-10-10 13:26             ` Haitao Huang
2023-10-11  0:01               ` Sean Christopherson
2023-10-11 15:02                 ` Haitao Huang
2023-10-10  1:04       ` Haitao Huang
2023-10-10  1:18         ` Huang, Kai
2023-10-10  1:38           ` Haitao Huang
2023-10-10  2:12             ` Huang, Kai
2023-10-10 17:05               ` Haitao Huang
2023-10-11  0:31                 ` Huang, Kai
2023-10-11 16:04                   ` Haitao Huang
2023-09-23  3:06   ` [PATCH v5 13/18] x86/sgx: Expose sgx_reclaim_pages() for use by EPC cgroup Haitao Huang
2023-10-05 12:24     ` Huang, Kai
2023-10-05 19:23       ` Haitao Huang
2023-10-05 20:25         ` Huang, Kai
2023-09-23  3:06   ` [PATCH v5 14/18] x86/sgx: Add helper to grab pages from an arbitrary EPC LRU Haitao Huang
2023-09-23  3:06   ` [PATCH v5 15/18] x86/sgx: Prepare for multiple LRUs Haitao Huang
2023-10-05 12:30     ` Huang, Kai
2023-10-05 19:33       ` Haitao Huang
2023-10-05 20:38         ` Huang, Kai
2023-09-23  3:06   ` [PATCH v5 16/18] x86/sgx: Limit process EPC usage with misc cgroup controller Haitao Huang
     [not found]     ` <20230923030657.16148-17-haitao.huang-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2023-09-25 17:15       ` Jarkko Sakkinen
2023-09-25 17:15         ` Jarkko Sakkinen
2023-10-05 21:01     ` Huang, Kai
2023-10-10  0:12     ` Huang, Kai
2023-10-10  0:16     ` Huang, Kai
2023-10-10  0:26     ` Huang, Kai
2023-10-22 18:26       ` Haitao Huang
2023-10-10  9:19     ` Huang, Kai
2023-10-10  9:32     ` Huang, Kai
2023-10-17 18:54     ` Michal Koutný
2023-10-19 16:05       ` Haitao Huang
2023-09-23  3:06   ` [PATCH v5 17/18] Docs/x86/sgx: Add description for cgroup support Haitao Huang
2023-09-23  3:06   ` [PATCH v5 18/18] selftests/sgx: Add scripts for EPC cgroup testing Haitao Huang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=dc441e64f0bf1ef02b7e86956edf95b767a02ca0.camel@intel.com \
    --to=kai.huang@intel.com \
    --cc=anakrish@microsoft.com \
    --cc=bp@alien8.de \
    --cc=cgroups@vger.kernel.org \
    --cc=dave.hansen@linux.intel.com \
    --cc=haitao.huang@linux.intel.com \
    --cc=hpa@zytor.com \
    --cc=jarkko@kernel.org \
    --cc=kristen@linux.intel.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-sgx@vger.kernel.org \
    --cc=mikko.ylinen@linux.intel.com \
    --cc=mingo@redhat.com \
    --cc=seanjc@google.com \
    --cc=sohil.mehta@intel.com \
    --cc=tglx@linutronix.de \
    --cc=tj@kernel.org \
    --cc=x86@kernel.org \
    --cc=yangjie@microsoft.com \
    --cc=zhanb@microsoft.com \
    --cc=zhiquan1.li@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox