From: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
To: Matthew Rushton <mvrushton@gmail.com>
Cc: Keir Fraser <keir@xen.org>,
Ian Campbell <Ian.Campbell@citrix.com>,
AndrewCooper <andrew.cooper3@citrix.com>,
Tim Deegan <tim@xen.org>, Jan Beulich <JBeulich@suse.com>,
Matt Wilson <msw@amazon.com>, Matt Wilson <msw@linux.com>,
xen-devel@lists.xenproject.org
Subject: Re: [RFC PATCH] page_alloc: use first half of higher order chunks when halving
Date: Fri, 11 Apr 2014 21:34:05 -0400 [thread overview]
Message-ID: <20140412013405.GB18157@phenom.dumpdata.com> (raw)
In-Reply-To: <5348507D.50204@gmail.com>
On Fri, Apr 11, 2014 at 01:28:45PM -0700, Matthew Rushton wrote:
> On 04/11/14 10:05, Konrad Rzeszutek Wilk wrote:
> >On Wed, Apr 09, 2014 at 03:21:38PM -0700, Matthew Rushton wrote:
> >>On 04/02/14 03:20, Ian Campbell wrote:
> >>>On Wed, 2014-04-02 at 11:15 +0100, Jan Beulich wrote:
> >>>>>>>On 02.04.14 at 12:06, <Ian.Campbell@citrix.com> wrote:
> >>>>>On Wed, 2014-04-02 at 08:52 +0100, Jan Beulich wrote:
> >>>>>>>>>On 02.04.14 at 02:17, <mvrushton@gmail.com> wrote:
> >>>>>>>On 04/01/14 05:22, Tim Deegan wrote:
> >>>>>>>>As long as we don't also change the default allocation order in
> >>>>>>>>Xen. :) In general, linux shouldn't rely on the order that Xen
> >>>>>>>>allocates memory, as that might change later. If the current API
> >>>>>>>>can't do what's needed, maybe we can add another allocator
> >>>>>>>>hypercall or flag?
> >>>>>>>Agree on not relying on the order in the long run. A new hypercall or
> >>>>>>>flag seems like overkill right now. The question for me comes down to my
> >>>>>>>proposed change which is more simple and solves the short term problem
> >>>>>>>or investing time in reworking the Linux code to make large allocations.
> >>>>>>I think it has become pretty clear by now that we'd rather not alter
> >>>>>>the hypervisor allocator for a purpose like this.
> >>OK understood see below.
> >>
> >>>>>Does it even actually solve the problem? It seems like it is just
> >>>>>deferring it until sufficient fragmentation has occurred in the system.
> >>>>>All its really done is make the eventual issue much harder to debug.
> >>>>Wasn't this largely for Dom0 (in which case fragmentation shouldn't
> >>>>matter yet)?
> >>>Dom0 ballooning breaks any assumptions you might make about relying on
> >>>early allocations.
> >>I think you're missing the point. I'm not arguing that this change
> >>is a general purpose solution to guarantee that dom0 is contiguous.
> >>Fragmentation can exist even if dom0 asks for larger allocations
> >>like it should (which the balloon driver does I believe). What the
> >>change does do is solve a real problem in the current Linux PCI
> >>remapping implementation which happens during dom0 intialization. If
> >>the allocation strategy is arbitrary why not make the proposed
> >>hypervisor change to make existing Linux implementations behave
> >>better and in addition fix the problem in Linux so moving forward
> >>things are safe?
> >I think Tim was OK with that - as long as it was based on a flag - meaning
> >when we do the increase_reservation call we use an extra flag
> >to ask for contingous PFNs.
>
> OK the extra flag feels a little dirty to me but it would solve the
> problem. What are your thoughts on changing Linux to make higher
> order allocations or more minimally adding a boot parameter to not
> remap the memory at all for those that care about performance? I
Oh, so just leave it ballooned down? I presume you can get the same
exact behavior if you have your dom0_mem=max:X value tweaked just
right? And your E820 does not look like swiss cheese.
> know the Linux code is already fairly complex and your preference
> was not to make it worse.
>
> >>>Ian.
> >>>
> >>
> >>_______________________________________________
> >>Xen-devel mailing list
> >>Xen-devel@lists.xen.org
> >>http://lists.xen.org/xen-devel
>
next prev parent reply other threads:[~2014-04-12 1:34 UTC|newest]
Thread overview: 55+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-03-25 11:22 [RFC PATCH] page_alloc: use first half of higher order chunks when halving Matt Wilson
2014-03-25 11:44 ` Andrew Cooper
2014-03-25 13:20 ` Matt Wilson
2014-03-25 20:18 ` Matthew Rushton
2014-03-25 12:19 ` Tim Deegan
2014-03-25 13:27 ` Matt Wilson
2014-03-25 20:09 ` Matthew Rushton
2014-03-26 9:55 ` Tim Deegan
2014-03-26 10:17 ` Matt Wilson
2014-03-26 10:44 ` David Vrabel
2014-03-26 10:48 ` Matt Wilson
2014-03-26 11:13 ` Ian Campbell
2014-03-26 11:41 ` Matt Wilson
2014-03-26 11:45 ` Andrew Cooper
2014-03-26 11:50 ` Matt Wilson
2014-03-26 12:43 ` David Vrabel
2014-03-26 12:48 ` Matt Wilson
2014-03-26 15:08 ` Konrad Rzeszutek Wilk
2014-03-26 15:15 ` Matt Wilson
2014-03-26 15:59 ` Matthew Rushton
2014-03-26 16:36 ` Konrad Rzeszutek Wilk
2014-03-26 17:47 ` Matthew Rushton
2014-03-26 17:56 ` Konrad Rzeszutek Wilk
2014-03-26 22:15 ` Matthew Rushton
2014-03-28 17:02 ` Konrad Rzeszutek Wilk
2014-03-28 22:06 ` Matthew Rushton
2014-03-31 14:15 ` Konrad Rzeszutek Wilk
2014-04-01 3:25 ` Matthew Rushton
2014-04-01 10:48 ` Konrad Rzeszutek Wilk
2014-04-01 12:22 ` Tim Deegan
2014-04-02 0:17 ` Matthew Rushton
2014-04-02 7:52 ` Jan Beulich
2014-04-02 10:06 ` Ian Campbell
2014-04-02 10:15 ` Jan Beulich
2014-04-02 10:20 ` Ian Campbell
2014-04-09 22:21 ` Matthew Rushton
2014-04-10 6:14 ` Jan Beulich
2014-04-11 20:20 ` Matthew Rushton
2014-04-11 17:05 ` Konrad Rzeszutek Wilk
2014-04-11 20:28 ` Matthew Rushton
2014-04-12 1:34 ` Konrad Rzeszutek Wilk [this message]
2014-04-13 21:32 ` Tim Deegan
2014-04-14 8:51 ` Jan Beulich
2014-04-14 14:40 ` Konrad Rzeszutek Wilk
2014-04-14 15:34 ` Jan Beulich
2014-04-16 14:15 ` Konrad Rzeszutek Wilk
2014-04-17 1:34 ` Matthew Rushton
2014-05-07 23:16 ` Matthew Rushton
2014-05-08 18:05 ` Konrad Rzeszutek Wilk
2014-05-14 15:06 ` Konrad Rzeszutek Wilk
2014-05-20 19:26 ` Matthew Rushton
2014-05-23 19:00 ` Konrad Rzeszutek Wilk
2014-06-04 22:25 ` Matthew Rushton
2014-06-05 9:32 ` David Vrabel
2014-03-26 16:34 ` Konrad Rzeszutek Wilk
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20140412013405.GB18157@phenom.dumpdata.com \
--to=konrad.wilk@oracle.com \
--cc=Ian.Campbell@citrix.com \
--cc=JBeulich@suse.com \
--cc=andrew.cooper3@citrix.com \
--cc=keir@xen.org \
--cc=msw@amazon.com \
--cc=msw@linux.com \
--cc=mvrushton@gmail.com \
--cc=tim@xen.org \
--cc=xen-devel@lists.xenproject.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.