From: Boris Ostrovsky <boris.ostrovsky@oracle.com>
To: xen-devel@lists.xen.org
Cc: sstabellini@kernel.org, wei.liu2@citrix.com,
George.Dunlap@eu.citrix.com, andrew.cooper3@citrix.com,
ian.jackson@eu.citrix.com, tim@xen.org, jbeulich@suse.com,
Boris Ostrovsky <boris.ostrovsky@oracle.com>
Subject: [PATCH v2 1/9] mm: Separate free page chunk merging into its own routine
Date: Mon, 3 Apr 2017 12:50:48 -0400 [thread overview]
Message-ID: <1491238256-5517-2-git-send-email-boris.ostrovsky@oracle.com> (raw)
In-Reply-To: <1491238256-5517-1-git-send-email-boris.ostrovsky@oracle.com>
This is needed for subsequent changes to memory scrubbing.
Signed-off-by: Boris Ostrovsky <boris.ostrovsky@oracle.com>
---
Changes in v2:
* Return boolean (as oppposed to integer) values in can_merge()
* Return new buddy head from merge_chunks()
xen/common/page_alloc.c | 88 +++++++++++++++++++++++++++++-----------------
1 files changed, 55 insertions(+), 33 deletions(-)
diff --git a/xen/common/page_alloc.c b/xen/common/page_alloc.c
index 68dba19..15fd7f4 100644
--- a/xen/common/page_alloc.c
+++ b/xen/common/page_alloc.c
@@ -924,11 +924,64 @@ static int reserve_offlined_page(struct page_info *head)
return count;
}
+static bool_t can_merge(struct page_info *buddy, unsigned int node,
+ unsigned int order)
+{
+ if ( !mfn_valid(_mfn(page_to_mfn(buddy))) ||
+ !page_state_is(buddy, free) ||
+ (PFN_ORDER(buddy) != order) ||
+ (phys_to_nid(page_to_maddr(buddy)) != node) )
+ return false;
+
+ return true;
+}
+
+/* Returns new buddy head. */
+static struct page_info *merge_chunks(struct page_info *pg, unsigned int node,
+ unsigned int zone, unsigned int order)
+{
+ ASSERT(spin_is_locked(&heap_lock));
+
+ /* Merge chunks as far as possible. */
+ while ( order < MAX_ORDER )
+ {
+ unsigned long mask = 1UL << order;
+ struct page_info *buddy;
+
+ if ( (page_to_mfn(pg) & mask) )
+ {
+ /* Merge with predecessor block? */
+ buddy = pg - mask;
+ if ( !can_merge(buddy, node, order) )
+ break;
+
+ pg = buddy;
+ page_list_del(pg, &heap(node, zone, order));
+ }
+ else
+ {
+ /* Merge with successor block? */
+ buddy = pg + mask;
+ if ( !can_merge(buddy, node, order) )
+ break;
+
+ page_list_del(buddy, &heap(node, zone, order));
+ }
+
+ order++;
+ }
+
+ PFN_ORDER(pg) = order;
+ page_list_add_tail(pg, &heap(node, zone, order));
+
+ return pg;
+}
+
/* Free 2^@order set of pages. */
static void free_heap_pages(
struct page_info *pg, unsigned int order)
{
- unsigned long mask, mfn = page_to_mfn(pg);
+ unsigned long mfn = page_to_mfn(pg);
unsigned int i, node = phys_to_nid(page_to_maddr(pg)), tainted = 0;
unsigned int zone = page_to_zone(pg);
@@ -975,38 +1028,7 @@ static void free_heap_pages(
midsize_alloc_zone_pages = max(
midsize_alloc_zone_pages, total_avail_pages / MIDSIZE_ALLOC_FRAC);
- /* Merge chunks as far as possible. */
- while ( order < MAX_ORDER )
- {
- mask = 1UL << order;
-
- if ( (page_to_mfn(pg) & mask) )
- {
- /* Merge with predecessor block? */
- if ( !mfn_valid(_mfn(page_to_mfn(pg-mask))) ||
- !page_state_is(pg-mask, free) ||
- (PFN_ORDER(pg-mask) != order) ||
- (phys_to_nid(page_to_maddr(pg-mask)) != node) )
- break;
- pg -= mask;
- page_list_del(pg, &heap(node, zone, order));
- }
- else
- {
- /* Merge with successor block? */
- if ( !mfn_valid(_mfn(page_to_mfn(pg+mask))) ||
- !page_state_is(pg+mask, free) ||
- (PFN_ORDER(pg+mask) != order) ||
- (phys_to_nid(page_to_maddr(pg+mask)) != node) )
- break;
- page_list_del(pg + mask, &heap(node, zone, order));
- }
-
- order++;
- }
-
- PFN_ORDER(pg) = order;
- page_list_add_tail(pg, &heap(node, zone, order));
+ pg = merge_chunks(pg, node, zone, order);
if ( tainted )
reserve_offlined_page(pg);
--
1.7.1
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
next prev parent reply other threads:[~2017-04-03 16:50 UTC|newest]
Thread overview: 31+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-04-03 16:50 [PATCH v2 0/9] Memory scrubbing from idle loop Boris Ostrovsky
2017-04-03 16:50 ` Boris Ostrovsky [this message]
2017-04-04 11:16 ` [PATCH v2 1/9] mm: Separate free page chunk merging into its own routine Jan Beulich
2017-04-04 13:48 ` Boris Ostrovsky
2017-04-04 14:01 ` Jan Beulich
2017-04-04 14:23 ` Boris Ostrovsky
2017-04-03 16:50 ` [PATCH v2 2/9] mm: Place unscrubbed pages at the end of pagelist Boris Ostrovsky
2017-04-04 14:46 ` Jan Beulich
2017-04-04 15:14 ` Boris Ostrovsky
2017-04-04 15:29 ` Jan Beulich
2017-04-04 15:39 ` Boris Ostrovsky
2017-04-04 15:50 ` Jan Beulich
2017-04-04 16:22 ` Boris Ostrovsky
2017-04-03 16:50 ` [PATCH v2 3/9] mm: Scrub pages in alloc_heap_pages() if needed Boris Ostrovsky
2017-04-03 16:50 ` [PATCH v2 4/9] mm: Scrub memory from idle loop Boris Ostrovsky
2017-04-12 16:11 ` Jan Beulich
2017-04-03 16:50 ` [PATCH v2 5/9] mm: Do not discard already-scrubbed pages softirqs are pending Boris Ostrovsky
2017-04-13 15:41 ` Jan Beulich
2017-04-13 16:46 ` Boris Ostrovsky
2017-04-03 16:50 ` [PATCH v2 6/9] spinlock: Introduce spin_lock_cb() Boris Ostrovsky
2017-04-13 15:46 ` Jan Beulich
2017-04-13 16:55 ` Boris Ostrovsky
2017-04-18 6:49 ` Jan Beulich
2017-04-18 12:32 ` Boris Ostrovsky
2017-04-18 12:43 ` Jan Beulich
2017-04-18 13:14 ` Boris Ostrovsky
2017-04-03 16:50 ` [PATCH v2 7/9] mm: Keep pages available for allocation while scrubbing Boris Ostrovsky
2017-04-13 15:59 ` Jan Beulich
2017-04-03 16:50 ` [PATCH v2 8/9] mm: Print number of unscrubbed pages in 'H' debug handler Boris Ostrovsky
2017-04-03 16:50 ` [PATCH v2 9/9] mm: Make sure pages are scrubbed Boris Ostrovsky
2017-04-04 15:21 ` [PATCH v2 0/9] Memory scrubbing from idle loop George Dunlap
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1491238256-5517-2-git-send-email-boris.ostrovsky@oracle.com \
--to=boris.ostrovsky@oracle.com \
--cc=George.Dunlap@eu.citrix.com \
--cc=andrew.cooper3@citrix.com \
--cc=ian.jackson@eu.citrix.com \
--cc=jbeulich@suse.com \
--cc=sstabellini@kernel.org \
--cc=tim@xen.org \
--cc=wei.liu2@citrix.com \
--cc=xen-devel@lists.xen.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).